From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id A49B3C3DA6E for ; Wed, 3 Jan 2024 08:48:06 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 3D4538D0049; Wed, 3 Jan 2024 03:48:06 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 384788D0035; Wed, 3 Jan 2024 03:48:06 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 1D6B48D0049; Wed, 3 Jan 2024 03:48:06 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 0E1918D0035 for ; Wed, 3 Jan 2024 03:48:06 -0500 (EST) Received: from smtpin08.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id D59D8A12EB for ; Wed, 3 Jan 2024 08:48:05 +0000 (UTC) X-FDA: 81637372530.08.6C2B7D9 Received: from NAM11-DM6-obe.outbound.protection.outlook.com (mail-dm6nam11on2044.outbound.protection.outlook.com [40.107.223.44]) by imf30.hostedemail.com (Postfix) with ESMTP id B87E68000C for ; Wed, 3 Jan 2024 08:48:02 +0000 (UTC) Authentication-Results: imf30.hostedemail.com; dkim=pass header.d=micron.com header.s=selector2 header.b=FVRaWZdd; spf=pass (imf30.hostedemail.com: domain of sthanneeru@micron.com designates 40.107.223.44 as permitted sender) smtp.mailfrom=sthanneeru@micron.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=reject) header.from=micron.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1704271682; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=WEsXh66kM8P58ua7Lkwa03E9wD/Yvwhy5j+i02EIsPw=; b=GdzEFXe+KofJUyHHiOhYQ0gvu6KMFbTlI2oaTlZrCgOLJjBgPm0+MqKv8nGrflvIiXjwBK MaWU2gtEbDlloyK7xeM21anQ4c8GY77kEGNShIdIvicBHgiz4AIPS8CUSEbYHGBAcmS3MG pE2pCfaBgK+6fqgMik7ixpOgeOYCh+o= ARC-Authentication-Results: i=2; imf30.hostedemail.com; dkim=pass header.d=micron.com header.s=selector2 header.b=FVRaWZdd; spf=pass (imf30.hostedemail.com: domain of sthanneeru@micron.com designates 40.107.223.44 as permitted sender) smtp.mailfrom=sthanneeru@micron.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=reject) header.from=micron.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1704271682; a=rsa-sha256; cv=pass; b=I3wjaZFzF+Yfx+95A9z3MwkRW7bSaUSQKqiaxI5Myw30b5eCrtgeQ+U4HWc91EOC/6Nje2 1eZkB2gJvL1HxK/8DHELrYKlBCZwOCYgK4zps3CLSOlBJcIr3itC7WywGKXU/KK/pJaj5P c0IHefS3bBXJUmfzoZp1Ochtve/Ir18= ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HJK9T3iqDr4KvjMvCq74g719+ulMV670tyNryyyV1aJluBeaqFAmgiPsg42xXdfHQY58LExu7IkF/44iAAopJ/yhT4wQ+2/TUOMfF/7u1pgOkeSFe72ud21jwsfF0OZoJr/58bx2CAcW7nBNaqXs8ID9Z26XDsMn32lms7yn8W9tfHkUSvqDVBMw+pgJC94NN8xbF/HA9gqonRt7z+ROMPuxSpdUx9cw4qJn09kWyHKaw0g2NjTUOeT8ljteAbW4Uym5koNAqOkyKUjHntjy7zTDf8a7bY4xBB1UumKm5FgWk64c78TV7Z8WygM9CtXYMt8YI9Xl6qrJRjqX62Nt8A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=WEsXh66kM8P58ua7Lkwa03E9wD/Yvwhy5j+i02EIsPw=; b=EA4QB3edw10nD4tDjNjR/7rtJqTQp+QbRJvLLlVRefUw89ZIu7AlepaAKbYSo263oihZxT7j3kVUWFLQ+kdals/Km14n7DPtorCAEZ96oJiseeaiWQD5s1zaimt7m21k4wdWpO6Fbo05L+BMj4EW/FdoR+I0OyrniJLCnI5M9iOo09mYvNf+wTl/pfS0eWdFpl1bp4+xAoWp8pFWscEb1REYqXa0QUdeZu2La1tIse84eh80g4/qel0JWMCm3KYmsjmWanC6p4v7rBb2TVxh1EcTEdIME/6nnptCDnierOOKJ6stx+3lkZzXovSORQhwkKyYZQkz4fDEcT4K7qMuOg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=micron.com; dmarc=pass action=none header.from=micron.com; dkim=pass header.d=micron.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=micron.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=WEsXh66kM8P58ua7Lkwa03E9wD/Yvwhy5j+i02EIsPw=; b=FVRaWZddT9R/tpJ9GOcRTWsrl7/IGe2EbO/IHVxLe97fNHxTITCUnSml8E2Kw6vNASfEgXfEFNrHhI/WvVwWyDxDb1bv574Lag1yO7oRYgfmKe4xzXQuJ72J40D3f8ZuFw+mhqqfVgMPDa+zBE9dGtn3P1dM5aTfAKLQmVpScshaa4X3012NFkG0V1eUGmzTW+qOIjfcqogOpsN1j2B9ZwnQzpwaNGSstLlWXLeksZKnALb1/3QjuAZuBf+zWBwhALVehVxqxqOkVSdQFZZKaa1CmBFLY9nmt24HFz/HtqT6DbrPjAxYlwNbWabmIyKc5FWbyisKqe9LDi2sbBEidg== Received: from PH0PR08MB7955.namprd08.prod.outlook.com (2603:10b6:510:11a::17) by SA1PR08MB7037.namprd08.prod.outlook.com (2603:10b6:806:1ab::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7159.13; Wed, 3 Jan 2024 08:47:58 +0000 Received: from PH0PR08MB7955.namprd08.prod.outlook.com ([fe80::5049:9abf:ad65:9974]) by PH0PR08MB7955.namprd08.prod.outlook.com ([fe80::5049:9abf:ad65:9974%3]) with mapi id 15.20.7159.013; Wed, 3 Jan 2024 08:47:58 +0000 From: Srinivasulu Thanneeru To: "Huang, Ying" CC: gregory.price , Srinivasulu Opensrc , "linux-cxl@vger.kernel.org" , "linux-mm@kvack.org" , "aneesh.kumar@linux.ibm.com" , "dan.j.williams@intel.com" , "mhocko@suse.com" , "tj@kernel.org" , "john@jagalactic.com" , Eishan Mirakhur , Vinicius Tavares Petrucci , Ravis OpenSrc , "Jonathan.Cameron@huawei.com" , "linux-kernel@vger.kernel.org" , Johannes Weiner , Wei Xu Subject: RE: [EXT] Re: [RFC PATCH v2 0/2] Node migration between memory tiers Thread-Topic: [EXT] Re: [RFC PATCH v2 0/2] Node migration between memory tiers Thread-Index: AQHaLe1WCWEmLbBSRk2O5Sdey42WeLCpzLPHgADTuACAA/H6xIAZGhOAgAAO84SAABl24IAADebegAACPiA= Date: Wed, 3 Jan 2024 08:47:57 +0000 Message-ID: References: <20231213175329.594-1-sthanneeru.opensrc@micron.com> <87cyv8qcqk.fsf@yhuang6-desk2.ccr.corp.intel.com> <87fs00njft.fsf@yhuang6-desk2.ccr.corp.intel.com> <87edezc5l1.fsf@yhuang6-desk2.ccr.corp.intel.com> <87a5pmddl5.fsf@yhuang6-desk2.ccr.corp.intel.com> In-Reply-To: <87a5pmddl5.fsf@yhuang6-desk2.ccr.corp.intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: msip_labels: MSIP_Label_6fdea275-d6f3-438f-b8d8-013cab2023d3_ActionId=e613c07d-f699-4fa0-baf6-de8be7204408;MSIP_Label_6fdea275-d6f3-438f-b8d8-013cab2023d3_ContentBits=0;MSIP_Label_6fdea275-d6f3-438f-b8d8-013cab2023d3_Enabled=true;MSIP_Label_6fdea275-d6f3-438f-b8d8-013cab2023d3_Method=Privileged;MSIP_Label_6fdea275-d6f3-438f-b8d8-013cab2023d3_Name=Public;MSIP_Label_6fdea275-d6f3-438f-b8d8-013cab2023d3_SetDate=2024-01-03T08:40:17Z;MSIP_Label_6fdea275-d6f3-438f-b8d8-013cab2023d3_SiteId=f38a5ecd-2813-4862-b11b-ac1d563c806f; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PH0PR08MB7955:EE_|SA1PR08MB7037:EE_ x-ms-office365-filtering-correlation-id: 10486dff-c85e-4e7d-d593-08dc0c38af60 x-ld-processed: f38a5ecd-2813-4862-b11b-ac1d563c806f,ExtAddr x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: n7TFjNhhXtHjZ01LKBy41yEOuJ25kUParIstsChmAg+3A3ct7wOOLVXiOWtHKI25MW8v5jpRvZq9ynRsj5B7RzxKwW7NJWoThsMTJReMmyN98/Rlq4zG/Tc/3TBxQDoMJshF51eOpeMA1d3i+q4Nb7enNTYfrWoIBEor6JpAbkm/W92CPY7mVKKAo72/et6J7xFSFGB4+J0LjzODKW0ZoElSF0JxT/HV98jXE6DtC0ueTjXHZx4AzY7YQ7eaVw6bxptqs4birrW9Czy3oKCkAzXl7mwGFhlpBl3DaurmVnAZ/vkFC5FSp0TzMe4s5C57o8LfHUvdqr6yJbTArYm66YwJ8jhLEUbNL9VAxFg3KpO4ejHXS4zYiN883E0/D7MBuWhPQsLlNYd5yHjzfVYZM9/Q/f4MyjBiAUpcbO/AC/o9wIfNUT5q34+TQ3DEJ7DA7VjUxTg+UV+hduLsXaqho9D6Qxf5caP2Y+SQ/+Yihfk5Vcs1CoLWXnUB6btsjGGuLVj/9be18tqfzywTOohyf9BPwpDIqJuIEK2P91vjLBe4ZZvtUkLsIe1u6J6z+Due8TBlejffF5NdrHPE6JWlZHR7fZlHs32Qhlz9lllcN3rm/Cpe6vZC7FREkVXrzaFJDsr3V0WqGFbrafuKy9K5WA== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH0PR08MB7955.namprd08.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(366004)(396003)(346002)(376002)(136003)(39860400002)(230273577357003)(230173577357003)(230922051799003)(451199024)(64100799003)(186009)(1800799012)(7416002)(2906002)(5660300002)(41300700001)(478600001)(86362001)(966005)(122000001)(38070700009)(38100700002)(33656002)(53546011)(83380400001)(7696005)(6506007)(9686003)(26005)(45080400002)(71200400001)(52536014)(8676002)(8936002)(4326008)(66946007)(76116006)(316002)(66556008)(66476007)(66446008)(64756008)(6916009)(54906003)(55016003)(66899024);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?BbblkOtCN8FComOX3V9WdhuOZoA1BAyeinBOxMkKsflwx+RgAPVFgC2qnU+O?= =?us-ascii?Q?k+9F1/XlivEKAUpeP091V46h2R3lQSlF3niE1aLX0+qn71Hfna02RqpIBr0x?= =?us-ascii?Q?20qexyoMgWcITUCusoYJcmnkuWIq18VBwH+7rBWoYTA3KihegIFWZkJ3VVIE?= =?us-ascii?Q?GOnoEBV/vX4MELIn0P10HfnMtlkduikFIA6DwzpB+fZyGcQDOv3ZT/s9VOjl?= =?us-ascii?Q?njc/+ftawCCFdbGXsrNg0NIUGF7rl99nI7JjJiRm0nxxiOPU9kTNjT0tavHt?= =?us-ascii?Q?O7mS01rRvXn730Kd/nslwfpFYqDFuNYojc1a0kLzsQIDcShfUpLSArE5eXL+?= =?us-ascii?Q?VP7HjRi/8H3heCIfzzbGUOXiQCwDH18MYq9cVV7+CeJbu+nbE/kRJSrnWt5z?= =?us-ascii?Q?06/zI4C0xWMW2PLoJCx5XEls2MXzuIl7l44L4HFWbRmqlBBQUWCEyVFtUv7Z?= =?us-ascii?Q?9chcfMU0vjqnDH2rKb3Z5tKR8L2jvYAjgLEOy+q7lI1BpCE2Y61aTiOk9mdy?= =?us-ascii?Q?54A03BOu07k5O24OTKtTsi6BA/iu+JkvZPkSTpzPWK3iQ3XQIolOI2O2iyC4?= =?us-ascii?Q?AOuJEEbwdU2jRdqCqAOofQxNwJPS9jIEqW6izYZEgbAflB1JoLRCF3qZcuyM?= =?us-ascii?Q?NdH2lQeFOkES2KOF0pVPa2U9FIl4BTt8sNDGvVnmYjxk6GxWdYN8TmI8MpuB?= =?us-ascii?Q?YMT3CnxZwbtsGADVO2NImlVTYmNspl+9+KDm6gWYIlJ1asMnFVsz7p84zLPy?= =?us-ascii?Q?8OMJYww3oMvWLtYW86fBUYz0jB4NRuGvSe5YeZa/uXJv9QXz0v+oBtK+zeFO?= =?us-ascii?Q?A+fNWhMv4BDjIKjESzOrfk70kRU3TND2Tt2hCJn2fFPK+D30pDblrSsosbu2?= =?us-ascii?Q?O46GD+twrpf5/jvt5w5i7PwmPQOFYo70z7VkEhOhz7FhfW/XBJ/nz/GwhOC4?= =?us-ascii?Q?o9AP3Md3IMFcV59fsOXONvNobvYgYOXeSIxzfwNYj1uOUQ6ZHLkv/F41bxOm?= =?us-ascii?Q?3pVRdxrCztYACndZ6vQQIAMpV/p4yOkc1E2G+uAMUlTB/yEh53Pk81DVoc8i?= =?us-ascii?Q?2OLnqjHhKYp3nqjTi1ZMVosAh17iYr6X/Ukr0p57qtjggwlhFnADGhqShV/D?= =?us-ascii?Q?guJeQwCmV1lJYGYSKtTzmhKS4+txRFzM1ejJSC65J6FW+u7ue2LfpAEDyDpb?= =?us-ascii?Q?RG3EYnf8l/OsI51tq9dmhwfUO1SoVBGT3xjo85hh0Lu3LplpGKN6HkQKJ3KH?= =?us-ascii?Q?wI6xpYWx9ck2AikzL2S4uQ433FzdCSax6QKtgTZQtroe/neMYD45vtL2NM9Y?= =?us-ascii?Q?CHDSlCJeZpmcwMgwwg1ZEJKDTueYJlvgjVREmoENfrjhBOwA6ZiSY4eFsvFW?= =?us-ascii?Q?XY2sObk/dzdhk2wQTMCI/GTC2h7KcE7rXfFOFd5TUvb0N4SpzycMne6gNESA?= =?us-ascii?Q?j2ZhgQ62n41qFzEoPz+DuDQl/tSCZRznj5rZBwYR2mK5RbO8D2IVhYumKfbX?= =?us-ascii?Q?/GWoRfdVux/9L64ofsKdnlWAkgxMjiGBE46TE8azh45wUDlnGSDco6Jgq+Fl?= =?us-ascii?Q?lDhlC+sQ5nIbysu2909CQk3FdoMgSAnefhlY/iGK?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: micron.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH0PR08MB7955.namprd08.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 10486dff-c85e-4e7d-d593-08dc0c38af60 X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Jan 2024 08:47:57.9629 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: f38a5ecd-2813-4862-b11b-ac1d563c806f X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: I2r0iPMTDICvM0MvrFOjwQRtceRFtBE9PZq2sXVJ4ePZS5MQy4XNSE6VqC8stDm7ULK8477trrV5lw0Qz38MhQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR08MB7037 X-Rspamd-Queue-Id: B87E68000C X-Rspam-User: X-Stat-Signature: o8ieipp6bw1c9rf3nof56ue1sgoci3i8 X-Rspamd-Server: rspam01 X-HE-Tag: 1704271682-981747 X-HE-Meta: U2FsdGVkX1/0RviHOUtnC1nIpRMSw1p7r4iolQZcWEaeT+hnKxKHTHftbohAq3lQLHi9bfkkNtPFELQLs6atVf6dsehZ4e8UpN3A0tFLrKVdxgeYSNozM8FBbtT4AOL6FrNe1U4XiWj63UAx2aWuAmusK/ofA6mf4yrQOwuxbiYzVvsp6cvHaorLjQsFkK5eiNJiNXlZSwAhIxDpaCH87IofUQPqGVtQKXFT1iChPfzUs+hBNoTDmXlBSimCTH2NBkle0MMKUv17YQNE+uBiWOfnfCWjT2CCs+Pl+2VgTo519HsUsmAjO/0UeM0Q7ev1lj783JCTgHqpYFVxWyBhvnuhg4kz0gvi5m4imDZcQy8dcrlmsRTJjXsQcq8AF7Pu9y1RK0fw8bqSLTQpyYMxd4U3LuZG8X8ObUEsRfeh4rSepwKCFgGcGOpifKVoSbKDMBesAoA/hoBCTyagwpHkrCgI7w1PpLfapcOeelnz+WoApbZvAA3WQaZWHp6wpy6uaykQ3SPOb6oFdpZciEaT4Pknp/qCkMfTezUqKWSu13GuKXoeX+NeIirORpJ6VaZt4EeHmyHAZRV3wculsI3mIh9ROvSsdWD6Uv9bl1ZjusZYoRA5fV0g7Cj1o3QvYQ7wbpiG8+3VTAtsTaKtpfLvPQlHi/MB6zoY9bvwlkBK60cMJq6rBfCvrg4dZvse32H3Lnfn3+YdzQ3o48cHuzhrU1Wn5YFmlY2xEw2mD6NMO72qU7gUwbYqeVo/BHnFTVe23fc2Bsdf0A3XXuZG9S7EIRRGuGWNhWNP0GtZs+kVP3grPCYUqXA/Pw6skHmyNONCtpyxd/rx/XB40IWW8JotbQARr99R/UeDVsgHwMkNC7en6Vm4nP1Mp0Hu+5aWyAANOp9qI4WvAS6axkUWK+k5GZVRIRFuBouFwr5g6+v/6r4GoSesZvbAEBCt2O4CRV9JKp0B6a+6w+SrclisCIm UQL6Ykzt 237Tf8ESsHU21s/eD1JfrHzGk7IFH+oxqckmue4oQC3VXDQ2B4EfPsX/7ItLQ+x/7133IIceQMJUkxVd8cqCL6Ts5iZh5KqQXrPJHCqg7RDaucOlSUvIdATLARWzFZfSiHgijF9xnksX9aKcXV/sv1RjSUFz4GW8BU/8qcqXmQ24x+zLBkc9SytrUAtFG7JXR//dCcghaIGmBLFTgfDeNVOfBOalEa1LwNEYoe5YSKSi/r4IQf+KCQXpobQoN/c/6CSPGAa8OBH2Yi5GoRsEh6PLWq8HP6O2ftWadbGGOltXCWY3Vg6A6MV8Gt+T9FoqN57SA1SplNiUyxkkQ8J908onWBPROIEubV22abX20pztZ+B4U0Gxf8+9NslCIEG0BlW6gfNpB0DYCH4qxcLlUBaadnZopk/ObVaMADE8TM4q99NWs9aNSKw9olENhyDYifRYAZVLRu9yaI+lmFPOEQp69TyY6715E9vQCJkc3Bw14Kg8OpyKb8fFeLNMFErxcl3lBU5gE3yDLwsZkRylVhFkzyjnFOkwgvjrymYnN0xmxxBXEm+SFqIhqeLNb8IeTX2cthQKNYR42kb/bFePd7c60LGRrLcSRqOhbLIJr7dvm8Y9qHRz5waZGRuaYgNO3v+FgOzER0iaFA4iJ/osx9WMW9qB5Q2wJDoL8fI3ldevz8wwJ38+IuIDFR5KfxMrPebp9gIO1rVMYWtrb5wFs5tHiUp2MAXgQ3fv8DWVBSsSBcF4hAoPWeQ8r78SZev1zUbNnzN8XCWdsAinXoFaCH724hnQdiT4fnfPzUpMIw4W5EHh2rEtVNiGY+jbOl0Ag0WnsbQd/tXDUwyWx79wS34PRwXiENCWzq39K5Fvzh1WBvCZROZJuA9gF6sdVZSGDyRanxGnwX5zipbk0CCVizm/gnzfDVcWDQE3ddzCxceP05C++FnZVWxoI/EP1ne3kjpkZ X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: > -----Original Message----- > From: Huang, Ying > Sent: Wednesday, January 3, 2024 2:00 PM > To: Srinivasulu Thanneeru > Cc: gregory.price ; Srinivasulu Opensrc > ; linux-cxl@vger.kernel.org; linux- > mm@kvack.org; aneesh.kumar@linux.ibm.com; dan.j.williams@intel.com; > mhocko@suse.com; tj@kernel.org; john@jagalactic.com; Eishan Mirakhur > ; Vinicius Tavares Petrucci > ; Ravis OpenSrc ; > Jonathan.Cameron@huawei.com; linux-kernel@vger.kernel.org; Johannes > Weiner ; Wei Xu > Subject: Re: [EXT] Re: [RFC PATCH v2 0/2] Node migration between memory > tiers > > CAUTION: EXTERNAL EMAIL. Do not click links or open attachments unless > you recognize the sender and were expecting this message. > > > Srinivasulu Thanneeru writes: > > > Micron Confidential > > > > > > > > Micron Confidential > >> -----Original Message----- > >> From: Huang, Ying > >> Sent: Wednesday, January 3, 2024 11:38 AM > >> To: Srinivasulu Thanneeru > >> Cc: gregory.price ; Srinivasulu Opensrc > >> ; linux-cxl@vger.kernel.org; linux- > >> mm@kvack.org; aneesh.kumar@linux.ibm.com; > dan.j.williams@intel.com; > >> mhocko@suse.com; tj@kernel.org; john@jagalactic.com; Eishan Mirakhur > >> ; Vinicius Tavares Petrucci > >> ; Ravis OpenSrc > ; > >> Jonathan.Cameron@huawei.com; linux-kernel@vger.kernel.org; Johannes > >> Weiner ; Wei Xu > >> Subject: Re: [EXT] Re: [RFC PATCH v2 0/2] Node migration between > memory > >> tiers > >> > >> CAUTION: EXTERNAL EMAIL. Do not click links or open attachments unless > >> you recognize the sender and were expecting this message. > >> > >> > >> Srinivasulu Thanneeru writes: > >> > >> > Micron Confidential > >> > > >> > Hi Huang, Ying, > >> > > >> > My apologies for wrong mail reply format, my mail client settings go= t > >> changed on my PC. > >> > Please find comments bellow inline. > >> > > >> > Regards, > >> > Srini > >> > > >> > > >> > Micron Confidential > >> >> -----Original Message----- > >> >> From: Huang, Ying > >> >> Sent: Monday, December 18, 2023 11:26 AM > >> >> To: gregory.price > >> >> Cc: Srinivasulu Opensrc ; linux- > >> >> cxl@vger.kernel.org; linux-mm@kvack.org; Srinivasulu Thanneeru > >> >> ; aneesh.kumar@linux.ibm.com; > >> >> dan.j.williams@intel.com; mhocko@suse.com; tj@kernel.org; > >> >> john@jagalactic.com; Eishan Mirakhur ; > Vinicius > >> >> Tavares Petrucci ; Ravis OpenSrc > >> >> ; Jonathan.Cameron@huawei.com; > linux- > >> >> kernel@vger.kernel.org; Johannes Weiner ; Wei > Xu > >> >> > >> >> Subject: [EXT] Re: [RFC PATCH v2 0/2] Node migration between memory > >> tiers > >> >> > >> >> CAUTION: EXTERNAL EMAIL. Do not click links or open attachments > unless > >> >> you recognize the sender and were expecting this message. > >> >> > >> >> > >> >> Gregory Price writes: > >> >> > >> >> > On Fri, Dec 15, 2023 at 01:02:59PM +0800, Huang, Ying wrote: > >> >> >> writes: > >> >> >> > >> >> >> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > >> >> >> > Version Notes: > >> >> >> > > >> >> >> > V2 : Changed interface to memtier_override from adistance_offs= et. > >> >> >> > memtier_override was recommended by > >> >> >> > 1. John Groves > >> >> >> > 2. Ravi Shankar > >> >> >> > 3. Brice Goglin > >> >> >> > >> >> >> It appears that you ignored my comments for V1 as follows ... > >> >> >> > >> >> >> > >> >> > >> > https://lore.k/ > %2F&data=3D05%7C02%7Csthanneeru%40micron.com%7Ce9e04d25ea7540100 > cf308dc0c366eb1%7Cf38a5ecd28134862b11bac1d563c806f%7C0%7C0%7C63 > 8398675187014390%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMD > AiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C > &sdata=3Dk6J1wxcuHTwR9eoD9Yz137bkn6wt1L9zpf5YaOjoIqA%3D&reserved=3D0 > >> > %2F&data=3D05%7C02%7Csthanneeru%40micron.com%7C3e5d38eb47be463c2 > >> > 95c08dc0c229d22%7Cf38a5ecd28134862b11bac1d563c806f%7C0%7C0%7C63 > >> > 8398590664228240%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMD > >> > AiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C > >> > &sdata=3D7fPxb1YYR2tZ0v2FB1vlXnMJFcI%2Fr9HT2%2BUD1MNUd%2FI%3D&re > >> served=3D0 > >> >> ernel.org%2Flkml%2F87o7f62vur.fsf%40yhuang6- > >> >> > >> > desk2.ccr.corp.intel.com%2F&data=3D05%7C02%7Csthanneeru%40micron.com > >> >> > >> > %7C5e614e5f028342b6b59c08dbff8e3e37%7Cf38a5ecd28134862b11bac1d56 > >> >> > >> > 3c806f%7C0%7C0%7C638384758666895965%7CUnknown%7CTWFpbGZsb3d > >> >> > >> > 8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3 > >> >> > >> > D%7C3000%7C%7C%7C&sdata=3DOpMkYCar%2Fv8uHb7AvXbmaNltnXeTvcNUTi > >> >> bLhwV12Fg%3D&reserved=3D0 > >> > > >> > Thank you, Huang, Ying for pointing to this. > >> > > >> > https://lpc.ev/ > %2F&data=3D05%7C02%7Csthanneeru%40micron.com%7Ce9e04d25ea7540100 > cf308dc0c366eb1%7Cf38a5ecd28134862b11bac1d563c806f%7C0%7C0%7C63 > 8398675187014390%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMD > AiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C > &sdata=3D%2F0AW8RYpTIa7%2FiScnkzmmTeAE9TYqjsuWWjTuxBPptk%3D&rese > rved=3D0 > >> > ents%2Fevent%2F16%2Fcontributions%2F1209%2Fattachments%2F1042%2F1 > >> > 995%2FLive%2520In%2520a%2520World%2520With%2520Multiple%2520Me > >> > mory%2520Types.pdf&data=3D05%7C02%7Csthanneeru%40micron.com%7C3e > >> > 5d38eb47be463c295c08dc0c229d22%7Cf38a5ecd28134862b11bac1d563c806 > >> > f%7C0%7C0%7C638398590664228240%7CUnknown%7CTWFpbGZsb3d8eyJW > >> > IjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3 > >> > 000%7C%7C%7C&sdata=3D1fGraxff7%2F1hNaE0an0xEudSKSUvaF3HgClMkmdC7 > >> n8%3D&reserved=3D0 > >> > > >> > In the presentation above, the adistance_offsets are per memtype. > >> > We believe that adistance_offset per node is more suitable and flexi= ble. > >> > since we can change it per node. If we keep adistance_offset per > memtype, > >> > then we cannot change it for a specific node of a given memtype. > >> > > >> >> >> > >> >> > >> > https://lore.k/ > %2F&data=3D05%7C02%7Csthanneeru%40micron.com%7Ce9e04d25ea7540100 > cf308dc0c366eb1%7Cf38a5ecd28134862b11bac1d563c806f%7C0%7C0%7C63 > 8398675187014390%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMD > AiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C > &sdata=3Dk6J1wxcuHTwR9eoD9Yz137bkn6wt1L9zpf5YaOjoIqA%3D&reserved=3D0 > >> > %2F&data=3D05%7C02%7Csthanneeru%40micron.com%7C3e5d38eb47be463c2 > >> > 95c08dc0c229d22%7Cf38a5ecd28134862b11bac1d563c806f%7C0%7C0%7C63 > >> > 8398590664228240%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMD > >> > AiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C > >> > &sdata=3D7fPxb1YYR2tZ0v2FB1vlXnMJFcI%2Fr9HT2%2BUD1MNUd%2FI%3D&re > >> served=3D0 > >> >> ernel.org%2Flkml%2F87jzpt2ft5.fsf%40yhuang6- > >> >> > >> > desk2.ccr.corp.intel.com%2F&data=3D05%7C02%7Csthanneeru%40micron.com > >> >> > >> > %7C5e614e5f028342b6b59c08dbff8e3e37%7Cf38a5ecd28134862b11bac1d56 > >> >> > >> > 3c806f%7C0%7C0%7C638384758666895965%7CUnknown%7CTWFpbGZsb3d > >> >> > >> > 8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3 > >> >> > >> > D%7C3000%7C%7C%7C&sdata=3DO0%2B6T%2FgU0TicCEYBac%2FAyjOLwAeouh > >> >> D%2BcMI%2BflOsI1M%3D&reserved=3D0 > >> > > >> > Yes, memory_type would be grouping the related memories together as > >> single tier. > >> > We should also have a flexibility to move nodes between tiers, to > address > >> the issues. > >> > described in use cases above. > >> > >> We don't pursue absolute flexibility. We add necessary flexibility > >> only. Why do you need this kind of flexibility? Can you provide some > >> use cases where memory_type based "adistance_offset" doesn't work? > > > > - /sys/devices/virtual/memory_type/memory_type/ adistance_offset > > memory_type based "adistance_offset will provide a way to move all node= s > of same memory_type (e.g. all cxl nodes) > > to different tier. > > We will not put the CXL nodes with different performance metrics in one > memory_type. If so, do you still need to move one of them? >From https://lpc.events/event/16/contributions/1209/attachments/1042/1995/= Live%20In%20a%20World%20With%20Multiple%20Memory%20Types.pdf abstract_distance_offset: override by users to deal with firmware issue. say firmware can configure the cxl node into wrong tiers, similar to that i= t may also configure all cxl nodes into single memtype, hence all these nod= es can fall into a single wrong tier. In this case, per node adistance_offset would be good to have ? -- Srini > > Whereas /sys/devices/system/node/node2/memtier_override provide a > way migrate a node from one tier to another. > > Considering a case where we would like to move two cxl nodes into two > different tiers in future. > > So, I thought it would be good to have flexibility at node level instea= d of at > memory_type. > > -- > Best Regards, > Huang, Ying