From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 05B4EEB64DD for ; Fri, 21 Jul 2023 04:20:56 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EDDB1280194; Fri, 21 Jul 2023 00:20:55 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E8E77280190; Fri, 21 Jul 2023 00:20:55 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D08C4280194; Fri, 21 Jul 2023 00:20:55 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id C1624280190 for ; Fri, 21 Jul 2023 00:20:55 -0400 (EDT) Received: from smtpin22.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 7D732140149 for ; Fri, 21 Jul 2023 04:20:55 +0000 (UTC) X-FDA: 81034318470.22.A20AEAF Received: from NAM12-DM6-obe.outbound.protection.outlook.com (mail-dm6nam12on2082.outbound.protection.outlook.com [40.107.243.82]) by imf16.hostedemail.com (Postfix) with ESMTP id 90E2F180017 for ; Fri, 21 Jul 2023 04:20:52 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=gVf1fRLK; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf16.hostedemail.com: domain of apopple@nvidia.com designates 40.107.243.82 as permitted sender) smtp.mailfrom=apopple@nvidia.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1689913252; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=KHSk+8/5VDxACQACFIBwnym//sdN5kA75aCShXzhdKw=; b=YoBwGeHzooOavQDCYOxUNmPMauNv4aqvHztgTMQ58lHGSe+FrRq0qO3AsW2nMqOMI0ZGH4 VD07ZmeeHBumMXC+te0whAJa4BsXNy1olcf/2NawTSPIIHj5sGqqUa9QXhjDTs9yeaPW0c R6tLaCIMJF5ND8Ifpfk8WiRFsSgtyFg= ARC-Authentication-Results: i=2; imf16.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=gVf1fRLK; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf16.hostedemail.com: domain of apopple@nvidia.com designates 40.107.243.82 as permitted sender) smtp.mailfrom=apopple@nvidia.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1689913252; a=rsa-sha256; cv=pass; b=37ArLWjXTu6U+ytROcSrMAoi38zzN5zkFr47g3skUWwM8mPtRJXZaiBSaUCk/CjvfrsQds 4VM6QiohzfSKjmw8PsKFWdjJxr9JJZn8tiE/uj4UyCMwYO/b2VPqfEGP/H9GFTE5DTpsmm 1lgD5+nD5mZZkj0Rf+jFeFeKgYth8dg= ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=LcE+FE4tAtY7xKpFvWb+oM/2yY7MrDkluSDMkUIY/CcsCKJW71bEOiCSE9m005gtT/tLNWgO1nnozJgzitOQEKTcEvds7z9Wz+GBXI1MuKUB3b+dcpv1IE4jLM/1AbotOF35Pk3WEBqBOxwjaVckYJPyQE7KE4qA3wLS7LoTxIJ79RxF/2GmUCrsLkGyT3XoobXeC39KrGSp4t8kn/TwkENKpdQeRLyNEB/KOGBk0cEUCzt4fXOVQfLyWsI9IkKXzHcJ+9F63tNO0GRE68sFTiD5EnatQqX/uZZrCL8MQXcWQDG+hGIecJCJXo8jfLlXA51lxKGhoZDkZ6smSHZI+w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=KHSk+8/5VDxACQACFIBwnym//sdN5kA75aCShXzhdKw=; b=Hltw1+gohUeIw3ui4u08hWAynRJlAzboYgp+MHKK1I8KtJ+3KEDotf0loaTUd76Z4gl5qnfyUExeQF+jMyq5R3YtuUdDKxXNuq0vI6fZl8SXL3W3kFJLTDl0s2Jj3n44NSOGcsPFZJOCjW5CCR6a45ASN0U6ESGFVLM+XkOWcn1VPz8MFkmuugWY5aQGgJMHSAFJAKHe0CSfbd6Y2Pk9fqL0DidmZ20fgP4EkH8tdi4xMBPsVVv0pSmo+/YCKFfY+RJlJvam0oo+lVude17+fEGVwj5iXK951UzUUB2tW/XIz6EXtZdx4stAdaafQ3J+wZhDCnXAH8WdkmTptTKbRA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=KHSk+8/5VDxACQACFIBwnym//sdN5kA75aCShXzhdKw=; b=gVf1fRLK/KpF9G5xlzVCu/SCnfTgQfnNEvCe1Z3gpTnUVBvGUOIJ/w4cPKZA/q5P8ZakjLpO5akkSeZiL0f7OX99rJ8F/3j0rRKENFog2luQ+ID0dbHbFBUYAJ//mvw26sr5f1Eow7exodQgaZdw37x31ZGYD1RZplqpn6dcdl8JQ6luvbAlpKVJxWriiEsbkVskNRnlCd3Y6eRVSAFFCrtrCc4cr9BlbXHsKruQjP03qnIxNM4MhbeKFBp+DyfxcqUWyFuMVvNjtK6OfSAns2a2YuW54Q3DW5sBvcjZHgBUJD5MG/wpUo4Ubz4LgZ2LiunOrb2wiFvSS8cSRc4plg== Received: from BYAPR12MB3176.namprd12.prod.outlook.com (2603:10b6:a03:134::26) by LV8PR12MB9270.namprd12.prod.outlook.com (2603:10b6:408:205::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6609.25; Fri, 21 Jul 2023 04:20:49 +0000 Received: from BYAPR12MB3176.namprd12.prod.outlook.com ([fe80::cd5e:7e33:c2c9:fb74]) by BYAPR12MB3176.namprd12.prod.outlook.com ([fe80::cd5e:7e33:c2c9:fb74%7]) with mapi id 15.20.6609.025; Fri, 21 Jul 2023 04:20:49 +0000 References: <20230721012932.190742-1-ying.huang@intel.com> User-agent: mu4e 1.8.13; emacs 28.2 From: Alistair Popple To: Huang Ying Cc: Andrew Morton , linux-mm@kvack.org, linux-kernel@vger.kernel.org, linux-cxl@vger.kernel.org, nvdimm@lists.linux.dev, linux-acpi@vger.kernel.org, "Aneesh Kumar K . V" , Wei Xu , Dan Williams , Dave Hansen , Davidlohr Bueso , Johannes Weiner , Jonathan Cameron , Michal Hocko , Yang Shi , Rafael J Wysocki Subject: Re: [PATCH RESEND 0/4] memory tiering: calculate abstract distance based on ACPI HMAT Date: Fri, 21 Jul 2023 14:15:31 +1000 In-reply-to: <20230721012932.190742-1-ying.huang@intel.com> Message-ID: <875y6dj3ok.fsf@nvdebian.thelocal> Content-Type: text/plain X-ClientProxiedBy: SY5PR01CA0035.ausprd01.prod.outlook.com (2603:10c6:10:1f8::12) To BYAPR12MB3176.namprd12.prod.outlook.com (2603:10b6:a03:134::26) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BYAPR12MB3176:EE_|LV8PR12MB9270:EE_ X-MS-Office365-Filtering-Correlation-Id: ee03a8cb-b6d9-4da1-abba-08db89a1dcf0 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: qkdBEG/bcymZu1lxrRj6Xq1kvu2znwPJyfrvd60+ARehyzFhte5I6zu4Rbva8oQSZUvxRe3IK+O2zEEI7xean57lkulI7v/+KRZgv9pb6UM4TpdGwdeo6eBPOmG1rqvrpM8tCeWbEVXJqNqUW4dY3nB2UAg7zisf/xFV7c7uqQtMVyv56fL10+8Md9/lDNPwwCce8PhXMN4yn3aU2puB7/HWkfDQS0MbWW38dMOFi97NU/fpwV+aFkipRVYBUmM4MaQRdHPd7X5wmeBBmYEgrFIF853PYFUrPRfiydWHBBPQhs2aLc4Hj+u9YduSMZtbUJMCteh14que3xx2maIuA7LP2BYBTef79jwAN9Nbr1Nte9CMHheZvmNW5ItQ2lhq81e61eIhotwJJrqzk50F0qqGmrkIlxxzIWXaBRuoXjlfOnjLH/VgHWly3JycaVvHjSx/nB/CYhqlmlLTFcWFdEXq70DUSYywX+iOXUBY7xzoTxtxcBAYo3s6QaUuI/ArCpPi84rYZ1SOW+dcbmzDEkhScXipuA8R0cvO/6bI/yX6rnMqCncNGW5xATRHXnIO X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR12MB3176.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(346002)(396003)(376002)(136003)(366004)(39860400002)(451199021)(2906002)(86362001)(38100700002)(4326008)(6916009)(316002)(66946007)(66476007)(66556008)(26005)(186003)(6506007)(41300700001)(478600001)(9686003)(6666004)(6486002)(54906003)(6512007)(7416002)(8936002)(8676002)(5660300002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?qu9W/T3YJL2rsshrfUjaX8VtiIb0ZSXlf3ZyKXnzFdBTTAIB0HbbZh3SKSRm?= =?us-ascii?Q?PlRa3pkrCLWCA/7Va6IhCNgzEKciXozxBC5/Lj/KEX+FRZ03CiLDzciKummG?= =?us-ascii?Q?1gCW4IJFH5LvKiVhiECKZfUczcgvuulVDm12JV2WK+n5TaWBWlP740wIPnSq?= =?us-ascii?Q?j//APa1XVag5/KNIxKzHNHkQmsbP9ivdjfDo3ALWo+ThjPTsjHcHUZNbcpmL?= =?us-ascii?Q?Sa1YsaLhgxWXzYfQ2sOUxsVDnYhwIcbAOn/uWt1mSBoPYM7ePOp6tyySuvwi?= =?us-ascii?Q?zL8HdUPpipf77GA9JWwbm+q8tABOGxaos2eVgiw49doJDHB4svzu9L09zNhM?= =?us-ascii?Q?EHIsPSBD/o7forf1USIa4juGSihYJZcl5QhkMo+8ePlfXLfmECB7bI4sRdO5?= =?us-ascii?Q?rh4Dl9W0eOp1q/UWT0q5u7k1MBMFAxOlpUFvt4wGML91ytACuIRLuV9YbTxl?= =?us-ascii?Q?nH5bIKJsV4xCxRwdmvLxwXSu9Iclp+VRARRZjtXhEsIIg/Ybm7133aQJE6wO?= =?us-ascii?Q?YG7ZjkXuXUDtOUIZUitXqypfmSfD+Bd5+WCA3WTly99wR0tAkSqVd2yGZ8Q+?= =?us-ascii?Q?wgU8RjZTbX+PQesJJsyo5wOL9kY1WLSYU9PpPYXh3CSu6nibJhCoyOyR6Kd1?= =?us-ascii?Q?3Up9WD9rjVWF4h6EFhfIjYppaDCyAzN8Epq+qUm908fJ6dGMQ1h0h/4HcuQf?= =?us-ascii?Q?Xf1lJsEt0WVM2LNfIhiGwRdkqPxd28lks9N24rAqQKMrqCSAHD0aomZecAio?= =?us-ascii?Q?dYXab/3XRdUNp2EwrPfsz5jeyPDegdIpJ0N5JoKtyPc3fRmsICm30R0HrOpm?= =?us-ascii?Q?lyc8ubBxafkG7gyENWL6xKpHbdcrObXjEUdBYc1a5noBFYMMBd68c5N+RNBF?= =?us-ascii?Q?x3eTKfGeG+tE3hmDAcnvzGvt9ZwGNcUF0a71uJWDbSkXXEaeXz2dtVbDWa0H?= =?us-ascii?Q?6k/vNw2JKjPDYW2w6cqSp4bqMc+rEI7J6z6SM7tbumILGGdqs/Liezp1BLrE?= =?us-ascii?Q?hoGFsArdoINd0uaXL0uxsaGD+gtlH5ZBMOayEthhlhTZpG0lZxNgMsTqGAtf?= =?us-ascii?Q?bmoRzobV2vgh5/pj5QTe0tJbYxvcUeOpL92xUNmJx05qnMAvGMvMbMnLxJIU?= =?us-ascii?Q?5sTh8CqB7vQmLjeyResWri1ECwZZfs/RMRTUwSItS38Q6qTREDTaiqX5Sk+K?= =?us-ascii?Q?flewlaoK1NODqhyr4bpc7m0o1+ghnbXbqPN171LTIS8zUzGVSX16BW7ad2yQ?= =?us-ascii?Q?Ko32VUQRcnvn068NrMb5ICLNxUtuJ4lqK+UdGaFfS9RrtA605XvxlmQCoKRY?= =?us-ascii?Q?KEj5CtyFdz1Q/InHndGJWKJbAImg1AAwZLLm+q6EbLi60dnSUMDN+2On92cV?= =?us-ascii?Q?C45m9MT6HVSq9Tim1LxyWuPtPQOgf4YvvnXJmh1CxOmLYxE467o6x/JjkhJz?= =?us-ascii?Q?RXHqmbFzEeHbQO8TVR1KzeHn9dfk6aieH02UgsjEemtX/6W5b2Pvtdq+ezA0?= =?us-ascii?Q?5QbHYFL9Ko2GzgixAM7xKpUalXcAVTkpo0TFTZE6GZoKY0EceheYybTGnnXP?= =?us-ascii?Q?DtTLFfjN0F3ZLk61oByv6eM0o04+cZqpaH67N05l?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: ee03a8cb-b6d9-4da1-abba-08db89a1dcf0 X-MS-Exchange-CrossTenant-AuthSource: BYAPR12MB3176.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Jul 2023 04:20:49.4135 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: u3YHg2iTc1PgvcB7Eyr+bK4n9IE0zxSF/tXPcdBkLLlaZBesIc/Ivg/bd5irJ2ztUUTVv+rvRK39U5GkGZ6Hmw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: LV8PR12MB9270 X-Rspam-User: X-Rspamd-Server: rspam12 X-Rspamd-Queue-Id: 90E2F180017 X-Stat-Signature: qzo3mrmaspz1wniqj1pqqkssyru4uo5t X-HE-Tag: 1689913252-811966 X-HE-Meta: U2FsdGVkX18XlHQ36qBt1xZMr9PyLBhn5x9BA/wsyLT50Fv0uLyhBJYm4cIEVFDg0SgDc05Q1JIMHB2I72GKw5Yt07aPJDEYwADT4Agh14mK1N36eIq2EG57MXp9068IDJ4LYe1wFW8gSL1NsB73W50tT0yhBQ3C6Pzk8Oo1r8Vg8pWc05OCGYep9vMafbWUCCfnguQaYPg+DCrllzWZ+ZQ95sHaKpsV9h6VAGCt4Jl535DxuV7d15mtK2PTKfYcEVtvCjEApsnTgB5bGAnQZTkJq3k3IJBeKByCkqtiKJgXVFF2zMtlQfkbmsx4OrGLMeSyMg/hXtzREJ2xhXIHfTqM2KHIlrszERUyn/z4EA4o1JsZJs8RV/H+0KZXNiSlXBXLpN/hSDbU4KjOxxNcaWI1TdphYJTWIHR1c840oW1jtyIJ0TmyDMa2JV7jVETIdIOWwBmDl+o7rYvGm7ca1EvxSsCp6Jop9ApoTsItoAEYxgryvWU9xL4bsSOfLNrBnFkbDnDVDRyE9oZxlFhsIF0cb8mEWWu6741peIj/dxdTDg1V/goGasnoFaYf/OMPY5pd56wZxne4wP1DLSL3UhPcLqWp1/APnmYvjc7qfbfGGkYOci978IVd6tQWertXfTvw5ZngJfHATnt4DhqFNLg6Ooo2wfgN3qy0lewvdgZo4BFzqQ5X07oL8DYz4vLv95PSDV47qkO5d7eLFPH7Qew8a+QhnxgMIBdJr04kgQ1yLTfTkaE2ldABdZXbKlVXdDD2UwscE7lvAcJaMSJGhe6YgYnibZsR5eEtyb+ye+vBYz8Yia6P7YKDud11I7Qpa36HV5d5O8MdqueGCkAmQsFzQYDAV3MUKbLqVY3Wvmm+owis8aafcvufgamqGvHX3xqAzv8uEsqF8srbKQYO1H5aFoi7bwdfYQn8Fa0rgTKW+bY/o/sZAs3PnCd40NooMIwP0P2bzsjDJWK0FaL YmvhNgEz pZ2xQLbRR5kvCQuCfkfVUQT8wIBLSNXACbuSbqv0Pej0dkKjqUxuIGPzb8d1PDD0QegW86vnsKq2wCqIzCayeFXlRSpghpULL9nREnz/eWDqNtslPumcANjtyBjS+qrpgsI5kfyehdXQzcU0= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Thanks for this Huang, I had been hoping to take a look at it this week but have run out of time. I'm keen to do some testing with it as well. Hopefully next week... Huang Ying writes: > We have the explicit memory tiers framework to manage systems with > multiple types of memory, e.g., DRAM in DIMM slots and CXL memory > devices. Where, same kind of memory devices will be grouped into > memory types, then put into memory tiers. To describe the performance > of a memory type, abstract distance is defined. Which is in direct > proportion to the memory latency and inversely proportional to the > memory bandwidth. To keep the code as simple as possible, fixed > abstract distance is used in dax/kmem to describe slow memory such as > Optane DCPMM. > > To support more memory types, in this series, we added the abstract > distance calculation algorithm management mechanism, provided a > algorithm implementation based on ACPI HMAT, and used the general > abstract distance calculation interface in dax/kmem driver. So, > dax/kmem can support HBM (high bandwidth memory) in addition to the > original Optane DCPMM. > > Changelog: > > V1 (from RFC): > > - Added some comments per Aneesh's comments, Thanks! > > Best Regards, > Huang, Ying