From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id EC9F4C28D13 for ; Mon, 22 Aug 2022 03:41:34 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 469886B0073; Sun, 21 Aug 2022 23:41:34 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 418726B0074; Sun, 21 Aug 2022 23:41:34 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 2B914940007; Sun, 21 Aug 2022 23:41:34 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 1CF386B0073 for ; Sun, 21 Aug 2022 23:41:34 -0400 (EDT) Received: from smtpin05.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id E12E01C5F57 for ; Mon, 22 Aug 2022 03:41:33 +0000 (UTC) X-FDA: 79825828866.05.C18EEFE Received: from NAM11-DM6-obe.outbound.protection.outlook.com (mail-dm6nam11on2059.outbound.protection.outlook.com [40.107.223.59]) by imf24.hostedemail.com (Postfix) with ESMTP id 4A95118004F for ; Mon, 22 Aug 2022 03:41:33 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=GDBuz8XcZl02hz+zuBeO/e6CUexdj2n1WOL4lUdFivUcd25pbKviIRDHhE8d9y70HH3z6KgGDbzZzKM6OVVIwyqmQbXN/rdpHJHV4YaztLlwgD/cBbaYGS5kcnjwqn2fi0ElR/Lyz4BLqcpaFISL7X+Djje2HCKZkORdFXnsNKTpIRD8qUtdixm8XUyYPcrsanIhCk6m0afHwZJNQ8QMDeblqOSXpFUYgkBi1TKq2RXnLtyZxDkDpdgL4QQdGTOsIQyAk33BgygGwjooznjylsLp8lWIBWRPBgc7kQA3NgHTp34BX0H33ubYwp/GQ2OK6YBSynQY/T4kKSSZsGEZWA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=xbQg0wNA8sg3genWxx+proDR0r3hfWcitSDF9qp8jGM=; b=U8NMYOmuDiAAeQqcNZ4h3IApu9D/n56ZKRDUXkWNFxruniLQCEs2gtMGuB0ebcAbRUlSkAtDzHOULGnZZ/TgyOCwz+zu2SLw7NlbopjALfAC4EM8YHPcnlko1QTIyMOPYTSKejCTVF/ONo3XxN6A/JtUdsaaZ2q/MT7SbmLFRjnVrK+PJYZvB6eNjXEX/hYdsy6D1tx1GMYAiHQsK0CIkvV1bsLzeFPCghTFGhfJ5s2dLSY2ivSINkrmLOzvduWk4REZGADptJUbvy1CM7u3Je+HRFiad/jphpQnYpNv0uiWOEybgKQYyE+LUn1YFCAq9qohOY8Ehx6U4oEo9tlDSw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=xbQg0wNA8sg3genWxx+proDR0r3hfWcitSDF9qp8jGM=; b=DKSIWVXCFc5Oim66mYqmIdTRFaDwumnDrbOBBqH2cFCDnUkoAIOiRj9rMzN7K+k5x7EBxTAgr7NRqZK7tl4THoO0pfENPCMjMykyjzjYtZ5hZIlBTzoL7XfCF2U9mcCbNkAYiGSs/TFbXhWh9wQldrWQeSEyRSHkJASO6daIoCo= Received: from IA1PR12MB6434.namprd12.prod.outlook.com (2603:10b6:208:3ae::10) by DM6PR12MB3276.namprd12.prod.outlook.com (2603:10b6:5:15e::28) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5546.21; Mon, 22 Aug 2022 03:41:30 +0000 Received: from IA1PR12MB6434.namprd12.prod.outlook.com ([fe80::bda4:d489:fb33:6edc]) by IA1PR12MB6434.namprd12.prod.outlook.com ([fe80::bda4:d489:fb33:6edc%6]) with mapi id 15.20.5546.022; Mon, 22 Aug 2022 03:41:30 +0000 Message-ID: <537a6b8f-547b-3f12-25a7-90718a1675f3@amd.com> Date: Mon, 22 Aug 2022 09:11:18 +0530 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.11.0 Subject: Re: [PATCH v15 00/10] mm/demotion: Memory tiers and demotion Content-Language: en-US To: Andrew Morton Cc: "Aneesh Kumar K.V" , linux-mm@kvack.org, Wei Xu , Huang Ying , Yang Shi , Davidlohr Bueso , Tim C Chen , Michal Hocko , Linux Kernel Mailing List , Hesham Almatary , Dave Hansen , Jonathan Cameron , Alistair Popple , Dan Williams , Johannes Weiner , jvgediya.oss@gmail.com References: <20220818131042.113280-1-aneesh.kumar@linux.ibm.com> <137cf90f-abf9-4a6d-08fb-ef3922685ba5@amd.com> <20220819173431.5c391297042eff209e821088@linux-foundation.org> From: Bharata B Rao In-Reply-To: <20220819173431.5c391297042eff209e821088@linux-foundation.org> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-ClientProxiedBy: PN3PR01CA0078.INDPRD01.PROD.OUTLOOK.COM (2603:1096:c01:9a::13) To IA1PR12MB6434.namprd12.prod.outlook.com (2603:10b6:208:3ae::10) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 6d3060a7-8ba9-4443-40ea-08da83f032f1 X-MS-TrafficTypeDiagnostic: DM6PR12MB3276:EE_ X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: QO2ikC5lL9O8EIhCe/fKXRhsh3Z8aVRfanJBEeEVghdiVD/u/hLN3+rYHT+o8nUhkoKbXC5mMeDM1BIfK/NiA8+Coy6mcBLsEvd2HXr2No+un1IWDgWqTTGlbRCAH36Ig2Vhr/ndayiFb7KgWXxUxqoOl0HYjl5oF5jLvZwNpLtei+vtVAzzDLrveKL+0WRH0DMU1OQ6wI3SeGumu0f6qr6qRDx5rjMHorRXgPI748cmCle1PbnZOdW8ga0BTb1UrQVniYxOtP3qbGQ9+tLVP5fAJWGklBRIy5gChxNQNu7/Xhf3ofUCHPM2JV5oxyO3aCisCTNRF2OWFUg4CyuSgo7K3rsdt7+zHy7fxP5tQW/Ve7NBMNm72IpzUPmEAtoDk5x4Y+2+pbZM+UuUsYYbqhGrBnnqccRiYCF+sfW9OFozel3pi6PG1ZA2Fzu1cYPmjDMBEpk3+ubdQnjtGTRy0uKZW4ZPKZpaduCgd0r52LXKtzisTDIYgGPBLTVAh81AiFvEExwuj5DMNdjLMXvl4XCHocOQwxzgIy7ipH9Q9ch5huRVE2nlvOwPwfkXcVxhA94eJ7yqZMLNIZWZyu5BytdNzRNKq3g+5Xug1LN/7Lf77+BE+hJs0MwHIGbmuPoMnv6f60GWAw/ly6VNX1+Ela5Is8PPSus00KPJ2+E0bjmBx3gx3eF3F/rIXlItVdqEBdeSVOx5J9tc7UjukbkajDmYABU1VzEpj0x/YPofpjgNNpWkuS0nMYc8QILTwgDeZtbZsDThdvghompSGl0M5eKTgvmmxvxKVRrbqqx1UzQ= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:IA1PR12MB6434.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230016)(4636009)(396003)(136003)(39860400002)(366004)(376002)(346002)(26005)(186003)(478600001)(6486002)(6512007)(53546011)(6506007)(38100700002)(2616005)(5660300002)(7416002)(6666004)(66556008)(8676002)(66476007)(31686004)(8936002)(36756003)(4326008)(2906002)(54906003)(86362001)(31696002)(6916009)(66946007)(316002)(83380400001)(41300700001)(43740500002)(45980500001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?blRqMnJ4MnkzNkQyQk1RY3ZZUTNicC9oK1pOYldlOWllNW5NL2JoTU1relRn?= =?utf-8?B?Yit5ZEJHWDYxaXc1aWZkT2orMklpdkNHVE1Tb1VPM2JWSHJIdGQ0Yi9aMHdP?= =?utf-8?B?S0VxaXJ2c3M1MWpJTXJFbks1Ny9wV2Yzdm1pamdBVmVxOFhaODNHeVRLaC9n?= =?utf-8?B?NkVKcEpad0pZeDFZTy9tRFZlRHRHTk0xamt5dlNaUnZUVStYZll0dHM3S0hP?= =?utf-8?B?SGdpOU4xcHFsUGZZbFpwSWRGN1QyUXc2d01sQ2RPYThmWkVUNFEwc3pOR0dE?= =?utf-8?B?RERodGtBUHRpRG5uY1ZzYXd1bE1jYXNzZExFcjd3SFdaWU0zQ1pnYjFVMWF5?= =?utf-8?B?bXoyZmhKaDNPZmdzWVRTRVBRNzJyZS91Ly9yV0pNaWdoTnZrOXVHY2pFUU9H?= =?utf-8?B?TkNBSG8wS1d4R3UwNWRHR29RbVlxSThZQmRHWnZEbzI2VnFOdjJVTE9xU01n?= =?utf-8?B?RmhyQWprRm1FMTVTdW9rUmVpM3diS1gyNlh1KzB1cS9QYWk3WmdyaFBDY3Np?= =?utf-8?B?TFlEdW1uVkU2TkJUUm4raFpIbG0zTFBvV3p1bEI0ZUdXOXhZQ2tibUpaU1dZ?= =?utf-8?B?QlJzSjdwVEhZeVlVSVJOV1Jib09mcmJsdTd2ZVQySHBUR1BRTXB0bDk2OWpS?= =?utf-8?B?RlhrTTNTbnBORzd3QVBjMFRPcjJYQVBYdSs3ZWRqbEYvdm4xenZqZWlsVDFq?= =?utf-8?B?cjdXKzUwcHpjdGZ5cmNMbkhZWElPZ3p2dEhlZmF4K0RrN2RIdU9wSFVQTVgw?= =?utf-8?B?dnRrMEg5VG1UelNSbENQMDBCSkZNWUFtMG1XN2hFaURQL2I4Z29uMHJMRElL?= =?utf-8?B?Tzl0SnlzU3RJaFgyN21YNmR1SCtKdmpIdkdFejhvdXErSEtKUkQzTU05V1g5?= =?utf-8?B?VnhUKzlNb1JSRmtBbzEvQjkyalJvZjNrdXBjSWJBb2pYVzlBWmJTUklJSGdQ?= =?utf-8?B?YURrMGFDMlM5S0E0SXhWdkppUk5LdWQyaHArYVU0bWJIbllNNWVvanZtR2l2?= =?utf-8?B?eUxyaUNJWUlwQWl0M2NXR2I2TCs1bHBDNUZUdE1NMWp0TTVNR0FBNzVjSk56?= =?utf-8?B?TDNMODZNd3E0VFZLbmVBUnBMTVVzTkUzdkVyRGx6ZXppV2tmZzQyMWx2cjhq?= =?utf-8?B?QXFtVjE3SXVPakxWVUVIK1VDMGQ5eFFJck5MQktkRFVSZHptSnB0UXVVVzFt?= =?utf-8?B?UVRNZVJUODN3TWdUOGoyalAxYmYvSDBEalQxWTJlcFpQeUJnekRydFNRZDVo?= =?utf-8?B?SExzeWxLMkR0KzNaNUYva0dKZ05yY3JyR1BMaWRpcitkVElnRy9HVE9hdFhG?= =?utf-8?B?L251M3g0enZLWW5zNm5tZWp5ZWY3Rit0ZFBmbzlKV0xnRENJWXZCZTZZRTlh?= =?utf-8?B?Ukt0c0ZKdUI1QU43dkdDWENUaU5pYUF3OTBTemdweWF1dTY2UlNQWWE4dVFl?= =?utf-8?B?cksrVWpTMit3Tjd4VitCdU5sbzNZK3ZBcGc1UGJ5Ymo0dGhLbERFd2RHVktU?= =?utf-8?B?eWUvV2Y4SDZ1eU44YzExTS9lb0pidWVYTnlmaXFYUlJkUmgrZzB2elgxNS9x?= =?utf-8?B?TlZCWm1ZT2xabVRoY3NXL1h0LzIwOFNTZ1BzeXkxd1pZTWVDc08rL1hzc2V4?= =?utf-8?B?djhldDRrb0xKMUtSR29hWFE3YWQvTDl0TWlONURlTTJoRDlJdE5rY1VJZ3Fm?= =?utf-8?B?TXBKaW1UT3c3WWh2c1orMDdsQXpwZG1UdkpnaTI0NGZ0dG5qMjF5R2h5d3FK?= =?utf-8?B?RGlxcFdGQ3ppblZpeVp3ZmFuYkxFcjB5SUxKdGhQRDBoY3FiVWg4S3NrQytP?= =?utf-8?B?MXVsUklXWDhydkw5eFRjb0VVRFJnclg0MjhocDh1TlBYd2JKYjRGWFdUYmxs?= =?utf-8?B?Q04rRW4wOThpOURONEJweTVJRjV2b01LZDMyVW0vRjF4Rit1cCtOZVk5VW55?= =?utf-8?B?UkI0V08xNUlWb0laTVFuNllKWDdiOTBGVmthTjNRYU9pVFAvT2g2YU5RRlRV?= =?utf-8?B?a0hvMUMvaDdHTFUzcGhQclRLSW5NTXh2c2REQTF2dXY3TzU2RG1ndnFvRi8v?= =?utf-8?B?ZFRNZFh3bkI5endMZFRJQnhJdStFMU5LZTFJQnBPZU9EZ2U4YkRzaWpISlc3?= =?utf-8?Q?In6J+EWratyy0QXjchgs1vTHc?= X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: 6d3060a7-8ba9-4443-40ea-08da83f032f1 X-MS-Exchange-CrossTenant-AuthSource: IA1PR12MB6434.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Aug 2022 03:41:30.5014 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: H405WhkP3D1c+omaUBJrLzcYWzUNDHOQaDFQP5gxJKa7ztjbXmXGSVAaRHPL8It7JCTeKeEaFsk3Ig2eE2n5Bg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB3276 ARC-Authentication-Results: i=2; imf24.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=DKSIWVXC; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf24.hostedemail.com: domain of bharata@amd.com designates 40.107.223.59 as permitted sender) smtp.mailfrom=bharata@amd.com; dmarc=pass (policy=quarantine) header.from=amd.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1661139693; a=rsa-sha256; cv=pass; b=nN6TrOsMh/I0r8psvzztAISumWtt679pUBzR0QaiDL5/ElhvXSDUH/7PY680+YgLdgsa3X Tlgq15mU14QrwFPEuMIRVbrJB9RfRKcmPhQEzMVwA7mpsrbID+CCEW6CVbdeEX7DwS35tV p4cMSVD66LUWocWQr9Nqw0NqQmx/slI= ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1661139693; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=xbQg0wNA8sg3genWxx+proDR0r3hfWcitSDF9qp8jGM=; b=fzU9Z5k1fYI03kddkr+MJBjg0mdz8JrbyFH3s9HBMEEjFEw0aZn1tLDvLU9P06Uf8/VXBl 6DsxwLojOqZhGV0O8EVp224flTLjsTzwk/kGjflaRVB/eH+FT1WjX2jOF7LKK3UO1M/GsI qjHrJu71VlbNeYFXi13WwkHHUIKrEGU= X-Rspam-User: Authentication-Results: imf24.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=DKSIWVXC; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf24.hostedemail.com: domain of bharata@amd.com designates 40.107.223.59 as permitted sender) smtp.mailfrom=bharata@amd.com; dmarc=pass (policy=quarantine) header.from=amd.com X-Rspamd-Server: rspam02 X-Stat-Signature: sh9s1rj13on5dou9dohzbp5df6q5xcuo X-Rspamd-Queue-Id: 4A95118004F X-HE-Tag: 1661139693-518796 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 8/20/2022 6:04 AM, Andrew Morton wrote: > On Fri, 19 Aug 2022 11:57:18 +0530 Bharata B Rao wrote: > >>> The kernel initialization code makes the decision on which exact tier a memory >>> node should be assigned to based on the requests from the device drivers as well >>> as the memory device hardware information provided by the firmware. >> >> I gave this patchset a quick try on two setups: >> >> 1. With QEMU, when an nvdimm device is bound to dax kmem driver, I can see >> the memory node with pmem getting into a lower tier than DRAM. >> >> 2. In an experimental CXL setup that has DRAM as part of CXL memory, I see that >> CXL memory node falls into the same tier as the regular DRAM tier. This is >> expected for now since there is no code (in low level ACPI driver?) yet to >> map the latency or bandwidth info (when available from firmware) into an >> abstract distance value, and register a memory type for the same. Guess these >> bits can be covered as part of future enhancements. > > Should I add your Tested-by:? May be not. I have done only a very minimal testing of specific scenarios as mentioned above. Thanks for checking. Regards, Bharata.