From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7A13DE77184 for ; Thu, 19 Dec 2024 06:38:55 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id F1C256B00A1; Thu, 19 Dec 2024 01:38:54 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id ECB546B00A4; Thu, 19 Dec 2024 01:38:54 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D44536B00A7; Thu, 19 Dec 2024 01:38:54 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id B5FF86B00A1 for ; Thu, 19 Dec 2024 01:38:54 -0500 (EST) Received: from smtpin03.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 33E9C141463 for ; Thu, 19 Dec 2024 06:38:54 +0000 (UTC) X-FDA: 82910754192.03.380DB53 Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2084.outbound.protection.outlook.com [40.107.244.84]) by imf24.hostedemail.com (Postfix) with ESMTP id 081C4180006 for ; Thu, 19 Dec 2024 06:38:46 +0000 (UTC) Authentication-Results: imf24.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=IfDxO3pD; arc=pass ("microsoft.com:s=arcselector10001:i=1"); spf=pass (imf24.hostedemail.com: domain of shivankg@amd.com designates 40.107.244.84 as permitted sender) smtp.mailfrom=shivankg@amd.com; dmarc=pass (policy=quarantine) header.from=amd.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1734590309; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=5cZt2H4veQ5VXn4g2efMiJl6sc15/CGpw67hCElmBWI=; b=WNqbY4MICn82pps9AJIH8dRQX7RnPkktpM5bTaHAZ6Au/skqTTnwxMT4ei+QMq5KYRPy2v SlX19MqIo5S3ax7hTXh1o5zlDjX06loHQcUnwZ56ettiRxq7aCoLI6/FzowH0JiXN+UOkD eHaJYcXMQhu+53d3UbEPuybjSw5CKsM= ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1734590309; a=rsa-sha256; cv=pass; b=QlsG/Qow06Ur4ab9h6zWM/ft0zflVz4aPJ3DNX/2dH28C7wrMn5B3vFhEz8YluPBQEbaOE TQSSKIfL6AT0pLNLQK3oJ3BzPF0EY94FwCOU5BJY2Lzg70gVh5boOn4/aF0lFu6R0yAZzL qUrI+1t5lijGh93Kay0V/uG6kk91itQ= ARC-Authentication-Results: i=2; imf24.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=IfDxO3pD; arc=pass ("microsoft.com:s=arcselector10001:i=1"); spf=pass (imf24.hostedemail.com: domain of shivankg@amd.com designates 40.107.244.84 as permitted sender) smtp.mailfrom=shivankg@amd.com; dmarc=pass (policy=quarantine) header.from=amd.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=Zm99jnwjFs3l50xO+W8bUwmVZeEtF08m9dYWca2XwjUxWxmYHB6cLH8BepO8FNzCaWDNOx7Y+QF+NkRaEtFK6fanMGSdcUNB+sgQsMXCVeFCkQM9kVwgQeERCeXia6Ruy/Q1wfG59GDTI7/KYBcopWG0LRUkTIBf9uJuGcMFCKo52vCjPN7h7n1dKecMedAByNNTaHPCg5MqpV7mNPfAPEl7R88yq36WsECTBIdSJm0yR3stJybQ6g+GdWZO9VukKoVrT1Z3aedLf7T2us9r6VhCpoZMVowYPZ0bRSUiB4f/EagC5htRKDRQg2NB1QfZCBxumHmPS2CPBkUW7sTHXQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=5cZt2H4veQ5VXn4g2efMiJl6sc15/CGpw67hCElmBWI=; b=Fn4kntbMrTzpObuxfdaUI8BkxY3I07Et3pi9X0ODW2xMmnlKW1jwehyQiyjpeyhkSMr0cgU/Eu6dj9PQuyb/aCR4oJHAV7rdrT2FBAcaoK1v3XGL9gJDUwfB5pAejwAyLyKIkkodQzvmuusCR4OeL54JutUsvbxWVSrEDr8AKsScSijLkDRQCHfAEgJyrRonRxPx2eDQombj3TpVGyFcQkYrR5VAmfVTlHfkvV91KB+KzQFZK8TTGi0FUG6VkdcDwy9SGuLVABUPK0p/k3r/NXEpAOOu66QYHHAsf0+iX8s1/djMQq2BxONa5NRcIezWma7o+LauUZkbleqQQVFzpA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=5cZt2H4veQ5VXn4g2efMiJl6sc15/CGpw67hCElmBWI=; b=IfDxO3pDiQYzBs/LJpZMp+V1Qc40MqWXoexOXcoy1fREciQTN2/yDdM9VYwgBK5bF6Bx2Dqb31dcQUNZltq9jOOx3c8KV9NYvlHxlYBFuJRMWXVnHAWJRQY2DYR2W90Eg4w3k4ISCki5cgj3MgIaekMwQcrTZJrXEQD6blUXNOk= Received: from CH2PR12MB4262.namprd12.prod.outlook.com (2603:10b6:610:af::8) by PH7PR12MB7161.namprd12.prod.outlook.com (2603:10b6:510:200::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8251.22; Thu, 19 Dec 2024 06:38:46 +0000 Received: from CH2PR12MB4262.namprd12.prod.outlook.com ([fe80::3bdb:bf3d:8bde:7870]) by CH2PR12MB4262.namprd12.prod.outlook.com ([fe80::3bdb:bf3d:8bde:7870%4]) with mapi id 15.20.8272.005; Thu, 19 Dec 2024 06:38:45 +0000 Message-ID: <1c424899-d394-452f-9e13-d8cf77660c4a@amd.com> Date: Thu, 19 Dec 2024 12:08:05 +0530 User-Agent: Mozilla Thunderbird Subject: Re: Slow-tier Page Promotion discussion recap and open questions To: Zi Yan , David Rientjes Cc: Aneesh Kumar , David Hildenbrand , John Hubbard , Kirill Shutemov , Matthew Wilcox , Mel Gorman , "Rao, Bharata Bhasker" , Rik van Riel , RaghavendraKT , Wei Xu , Suyeon Lee , Lei Chen , "Shukla, Santosh" , "Grimm, Jon" , sj@kernel.org, shy828301@gmail.com, Liam Howlett , Gregory Price , linux-mm@kvack.org References: <6d582bb6-3ba5-1768-92f2-6025340a3cd4@google.com> <9093302B-95A9-4133-A0E0-75A47CE4336F@nvidia.com> Content-Language: en-US From: Shivank Garg In-Reply-To: <9093302B-95A9-4133-A0E0-75A47CE4336F@nvidia.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-ClientProxiedBy: PN2PR01CA0065.INDPRD01.PROD.OUTLOOK.COM (2603:1096:c01:23::10) To CH2PR12MB4262.namprd12.prod.outlook.com (2603:10b6:610:af::8) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH2PR12MB4262:EE_|PH7PR12MB7161:EE_ X-MS-Office365-Filtering-Correlation-Id: 71ed18ff-8087-45a1-8a47-08dd1ff7c8f8 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|376014|7416014|366016; X-Microsoft-Antispam-Message-Info: =?utf-8?B?RGI3NXFrUjNITWhwek8walhaTkdXVHdXYjNHZnBNaWwyVFZaRE5TNXNmVEsw?= =?utf-8?B?ZXQwd0cwTGZjZ0MzT3ZIYjNQQTd2YzR2RHkwVWdZM1NSL2E0NU9qNnRYaXpo?= =?utf-8?B?dmcyaDd4VnM1eVNxRW9YN3kyaVRoVUZYSkJtVDgxT0o2QzdqRjVtNys1T3Qz?= =?utf-8?B?YnFoWlYvbmlvbEZESTN6em8vYXhKQzh6QkFjT20wblh6WDlMZ24xZmFIYlE2?= =?utf-8?B?d2xwMWtuN2ZGMVFQWkZtandVcWNkNHNSaE5pd1VwZTRpZDZ4cklNaHBwWS9J?= =?utf-8?B?d2dPajJQSlJTcEVvTStyc3JPaW9YSVRSeXorRVNwZVY5c3dINGV2QWxoRWpH?= =?utf-8?B?ZWJSSzhkOHhMZElVc1FwSzUvMElWK015ZU8yVEE1M3BaaUFVd0MvWEdoR0dr?= =?utf-8?B?aUZHSlJUSXNUaVRlZ29zVERpOEpzT0xzdUE4LzR1eWcyakNqVUtUTmJRYkNR?= =?utf-8?B?VVkyOGJQT1YyWTBrSVNPSWpKWG12WW9TNzhPM2pFK3J3YmhuMDB3d3pKc1pC?= =?utf-8?B?SUxkK2F6V2JZU3RNRzBXWS9aZmFPYUtEVXczbDVlRjJsd2YySzlMQ3JMclYy?= =?utf-8?B?bHlrdjMzZ3hrSFZhUjVtOVpkWHZmZ21IZ1lKYUx1V1pkL21CdXg3SlFGQnFq?= =?utf-8?B?NzFHak5sYmx3Tk03TDFYZUdRdUN1UVN0TkxyVDF4WnZ0VzB2OWJGYld5SG90?= =?utf-8?B?OUtPQ2wzMW9jdEhSQkdjV1ltMzlxSFJVWTVOeGJsdnRsUlZOQldjdkVzWHN6?= =?utf-8?B?bFBPWkFnN0I1djFVUUt6NHRuTktIN1RpcC9RTjZyWFFocGtCMmE5M25LTmVK?= =?utf-8?B?aEEzV1p1L3ExdTVUZFZnK2NaQzNLWGNMRFpMdnFjRGtLQ0FYODduUXp0K0xj?= =?utf-8?B?WnBYY1hmdHFUOHlOeVBYNHQyeVBVN01KYzh4a0Q5QXhsK2Y5dWZ6RTVYNFJi?= =?utf-8?B?cHZ6eHBsSWptRkl6ZTBwdE5NM1k5NS9MMFRxZWtGc1pwU25SRDFyVlFGZUpK?= =?utf-8?B?ZFpFRERNREp5V3plUkM3NXJaOXJLZG9RYlpRRUJhWSs1RWQ5akxuVmVKK0pY?= =?utf-8?B?OXhlbFZGVWw2d0hPdWsvUVJ6T1pRbjhKWDFhU2NIUXhqN0hyT3JnTnIwQ1Z6?= =?utf-8?B?eCs1cEFUSy9lM0hBaEx6MTJ0WnU1WXMvYk5qL092Tjcvd2ErTmJjeVRIdkxh?= =?utf-8?B?eVloR3pVSHoyRzFtRFNaMlJ3RUpUUTRvSEQySjlwMC92ZTF0Vm14d1F4VGhS?= =?utf-8?B?MEFranIxVmQ4KzVyMFB5Y2VaZDIwa09xbjRyK3l6SEo4anJ5TFZXZkFwVU03?= =?utf-8?B?a1NrL2xLdTczSGt5VVhmc042bjkwRnlXWWF6Z0ZwSUpnbGFnYXVSUlZtbG44?= =?utf-8?B?K2RIdFg0Qmx0Z1lJbk9NM1BoRFp5WXNqWlptY1Zrc0NFalYrb0pKRmxmUmo2?= =?utf-8?B?dldKR0ZWdW0wTmdqSnRNQTJvQWNvOEFVa2VJYUpLNDV1RUNJVGg4a0RuTTFi?= =?utf-8?B?UWxzOW5MaFFTK3I4dytNVXE4TklMTHpIZ2Y4SlpUZ2dVblFCblRqVUpVN0k0?= =?utf-8?B?RVRMeEJlY0NMRWZQWHIxL0ZHSms3WC81UGhKZThPWFZNeGtDZEY3ZzhlRi95?= =?utf-8?B?ZWpEM0J6U3Z2RFNFeTBZdjAzbDFoQmsyNnE4TkxNUy9nRFJuVEhTMFZHOUZ6?= =?utf-8?B?ZUpWOHJqMS92akxLM2ZWWVc0N1R2ZjNiOVNhTGhFbEtuUDJ3emRQUTVEVXVu?= =?utf-8?B?UFFtMnZaWUVTRWRtNzN1OVp1c0pva2hCOTg5SEVGVlNUcTU2c2lNTXVXbmJs?= =?utf-8?B?ZTUvZkszbjc2R1ZuT01KdWxwQ0VFQlNWQ3l2WG8wcTlxMDI2UHl4eThMTkZR?= =?utf-8?B?ZGVUYmcyVzlYeFBram9sUU1URGxKUlFiU0NxUW9zNHFaL2c9PQ==?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH2PR12MB4262.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(376014)(7416014)(366016);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?K0J3TEd2WHdPelN5cXd1RldUNTNCQUFOSHY4K0FCcGlmbERFdlZXZHQ1R3c1?= =?utf-8?B?MDI0eXF6TFhyM3VxL1FIV3N3WkRTTkh2a1NXYVpHVWRIL29zVzJDb0dqVkVa?= =?utf-8?B?VXc5RXQwOVdGQUN4cHM5UkRhc2VqVmNEMjZiNklkRSsxUjEva1YxMkpMeDY0?= =?utf-8?B?RU1HVllSOWYydGx2SE5rUmFtU0s2ZXEzdXRjbk1hM3g2VEJvWis2SjE3NXhk?= =?utf-8?B?ZHJyOTRDekUxekQ0SGdCdTkveXRCMHlneUxKeTgvU2tDR3VYTmlLZ1YrcHVG?= =?utf-8?B?am9WVEZ0a1BHWTZ5TjQ2UTBmdlBRVVprK2dlYy9pYXJxVjRWQUhHT2dOQi9i?= =?utf-8?B?aVNBd08xQkk0VkhBd3lrdGx2ZGNCZG1aZEJwdGxTRFB5dWpYU25xc0V1cDJk?= =?utf-8?B?YzJMOFRBTHdHdnRYenR3R0pxVklBczR6aVNhMllpRkcvYXZIdnc1WkpOQ1g4?= =?utf-8?B?T1BvMlFUcGkxVG1VYytQZ0c3Mi9PMXhLOHRLMFFIWEdjckhZY1NuMVgza2lZ?= =?utf-8?B?ajRrelhhTGx4TkUrMUNCNnYrS1VPUjhXd3BQeDNjZkNVQm9jUkRwa2NEZ3N3?= =?utf-8?B?c3o5QkpYUGRLNmxXaGptU0lBOXo0aUFWNk1hbytvRDB2bE5qK0gxd3RYNDdP?= =?utf-8?B?b0luS0Z6cjRVeW1XUzRWMGZ2UWhydXpKYlRrZFNDVVZpL3cvTmhaZk1uYXdj?= =?utf-8?B?amE0Y0JXOHBXR0pOQ0k4WTJpQjdHZlhLY2RxeTVVdkdaMnJGTXIwblgzSGJS?= =?utf-8?B?SHNERE1pQy9jbE9vc2ZWNVA0dXJJWGM0d3pXVWRvZURBMG1JSmlkRUtVd2ti?= =?utf-8?B?VlVJUEtzQzVjQUtWUFFLUnJWTC83L3RpRXQrdE5qaTVLc3lqNVNyN3VYNjFJ?= =?utf-8?B?UXQ5blFFY2RMNXpCemhPM1hxUFluSE5IYU5FOS9yVERiRUdDOW9XRlFUcG0y?= =?utf-8?B?Q1NsbldXRGlPWjhocUUzWSt3RmpQdUVJSUZwcld5NlZPSkxyVHdONURvMWg0?= =?utf-8?B?Zis3MXZpM0RQNmNQaGY4SjJzQlViVTQ1NlROb1VtWVB3ajFaWWFpaGVTdGRJ?= =?utf-8?B?VjRvbjQ3aEhRMjAxMXh4QitIWWNEbkQ2NmxqYlU4aFAvN1orM2FMcGlMZmxk?= =?utf-8?B?M0xsTFRyaWJFeGcxSzdsaXU1RVc3YWpBbHNiUWU4aGFueVduWnJ3TkN0Y0pI?= =?utf-8?B?R3Bic256OG1UZlRqWlJDait1UVZLdVRQNmYwblRObWZ3QzdMaWpncTRuc0Ju?= =?utf-8?B?aDVXY1Y4SS9EWlJlTGpkUHM1SmRxWURxa2tSdXpqZ3VSTStTUEFobGY3WGRn?= =?utf-8?B?WDNZTDFYY01Jb1hqcm1kN0ZxZEdWaVQ0SU5HM05qbWNXSHdsZ2VtYWQ3Y1N3?= =?utf-8?B?eG95NjB4dVVhUjA5NithU01BdmNLMXBGUldTa2F1ZVZmL0VudWVackdOdlNo?= =?utf-8?B?SlhTUzltSnpZanhBdmdFTnNDOXYyaVNqOE5sTmlYQzAzWE5HY3RMNjdJVjRC?= =?utf-8?B?U2Z5V0YwZ0J2WWxXVWM5N2xjRXZaZmhEbm5hTXVnVzBPVWc3dlU2ZjRRM3hB?= =?utf-8?B?WVY2MlBkaWFUSTJ1bERCeDBlM2szOENiR0orbGc0anRqWXdHTGFucFNDWWpo?= =?utf-8?B?TGFreHB1RGJab1pWZmp0eFhYNjVLTUVtTXZkOE1vYlFWZUNVMG0xU3cvZFB0?= =?utf-8?B?K00va3ZpR1orRE9UcFVlZS9aakJlWW1PbzBleWVYK1hCTlU3VW1hRXJuWWZB?= =?utf-8?B?NjFHaEJHVjZod0o3U2JCQmRRWWVKWFZ4SHJHWkMyRk92YXlsL0UyRUZUUDdy?= =?utf-8?B?NGlyUng0OVhYT3N6QnlDNXdQc1hhMDhLd3hwemJtdTFOY3pRRmRwU1JTQ3E3?= =?utf-8?B?amVKNjdXT3A4V3kzd1lUZVZxRC9XVlVRc2Z2VWVOblVGV0tycVFtbEJCREdL?= =?utf-8?B?eGxTQ3N3L0ZWRi9KUGZUU29YVi9wM0lud1gweFFKOUFFSCtKL2laWEFkNTBQ?= =?utf-8?B?T2JCZWNidUVlZUo3OEpqQ2RhUzFudkQrWC8xdVRlWjdVMXdKaWpaRjZiLzBj?= =?utf-8?B?L1Y5aUNSbjNIdDA0YVhJcDY2Nm5NS3JUMys2cldSMXVEb0RERXJSMkVDc2h4?= =?utf-8?Q?WqcuI1gqdORPAl7lAmgo8jvDc?= X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: 71ed18ff-8087-45a1-8a47-08dd1ff7c8f8 X-MS-Exchange-CrossTenant-AuthSource: CH2PR12MB4262.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Dec 2024 06:38:45.6613 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: kSgGj1aLDeHfYD86PcW+MPKHPKyYE3BWRS1xU1Bt34WZ0Xnipo/QXpzHWD87Qy71Mbv+qe2t6sVVtu6rQD4Y8g== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR12MB7161 X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: 081C4180006 X-Stat-Signature: u9wpiwg9xo5nxn8798wazmtfrrs4cynt X-Rspam-User: X-HE-Tag: 1734590326-126266 X-HE-Meta: U2FsdGVkX1/lU10/9TyZdxBpn4e61hDtwUWbqhv2VKYAsGfXAIKEHOVYjqEBt0FNzgml9OTN4JCp9zdl+vIpUksyiR0ovZgBUechRiAs5eyOGHJ+GZ0hklzeNsxUrxiSXnDtkBVLXnINkdQfoGu/+BGbfSR04sWkwYki7PFllBIHXjyliwdIMAFToR8YTmSlUi3nUdZqPCuuOXpyGH2nJr8g/ldmIipMIz/apDeJKA/CTj3G7+590uTUqFl8Xn6hVc29d4l/I3vuBIjkdVRizdMofuXiQVOmJl2ZTbtIhlx8HvcnpbADwfZCEj0q+pglVPFakZHCuF+ARYgvuIwtRNsEWdhInET/c5opOhKtNjbhfgb9rBZY6E6sbtw07Lkz0eIvwaR60ySOGmni6DBEmx86ASNVYnXnvhVYyxjnC5ALzikNhlWU7kzGyDZeNC25r+RsYGVyNchjwUL9YToRft0Zhmkjkztacy6ENt3aOoEVs5EyptXjWyooHhj5hpsEQFm+6Ga9Q/KKqSwAEmrTs37kh+VjNsYxpkyGHR2GdmmythNP3kFkRMeCKOzOr1w3AN6jP78v9csPzUgY6baW5OD75B8MWdj2BeqvmT+rvKtAF3srgSff4SPsaOAPaCatteARK2Wmah1hrtY7fwH4Z1pKJ4TJmVnSphu8KOiBHXrDaed9wszKagUo2tgO67l6kSTcB7A6dcm6DCjo3lX80aDI6FYXyILyhAfDsOii3tyqjP8UHRK25/fsAXVQheJAhasToCB+mc8AujaQiqokf/f6TzclzFIQA/QrhuElBJfxGF+ncsfN1lhguZJZHZaD90tOzZ1FiwZsb+6aFh+pAvcI1KqiTdgNn9aCTl2EiZI8XVi2eP+kNpUAj+TKpG+cDzEVlM0fVVabGGXGTnmhpD1i/wtc/L6vAuBQg7IXr3iEnDcP4cgzwR0S4OsqiB++zBJ91CG/mez5RYeZavm 1S7GMY/S MPnTOsolqtjjoyax8XIIW55KlZcQvDLhU/ERXG4KtnUbG6947t+U6/QczrHtD14IVBNyV+QQ6zwtmFIRdkqKaz0kaipniBPDXN4EqCLoMFoL91Cq0sTD0yuMKfB4DwlKTenVr3zlLC1qPffw4mCACnh9OgH7sWtCB2OQbXIOC7iWNrm6jCpAj49CHm3Kru1HLZFde2uI3FrVZqz2GFLogiYsCdfjhRimj1PT95bb8biMoynU/tnqq4xhy/CWPA9VJvi7cGFROtoV+lj4AyFsNDDh+8+u3h9u2+VXkllx/wCIMUp6XDiQzzkMNib92VFsWBJk3gOin7QzfdMrCHJFnPotfDVd8Rq0nB/DnCULnIwUzRTfjSopwCcGM5EOccIQJyv14BbujiZt6mqpEHFSe8AqV8vJ+RzTKZYaCqzQVfWicayRRWefxfL68qvsm0feiTsksVLQzRzxiPyHaa/oCAAxIC9IqOQVfgVgRYcffzq8oMNY/93YhCbflG4jxBHDM6IM++yj72JbiO9ClPdrznNODXiEbTZVwG5po X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 12/18/2024 8:20 PM, Zi Yan wrote: > On 17 Dec 2024, at 23:19, David Rientjes wrote: > >> Hi everybody, >> >> We had a very interactive discussion last week led by RaghavendraKT on >> slow-tier page promotion intended for memory tiering platforms, thank >> you! Thanks as well to everybody who attended and provided great >> questions, suggestions, and feedback. >> >> The RFC patch series "mm: slowtier page promotion based on PTE A bit"[1] >> is a proposal to allow for asynchronous page promotion based on memory >> accesses as an alternative to NUMA Balancing based promotions. There was >> widespread interest in this topic and the discussion surfaced multiple >> use cases and requirements, very focused on CXL use cases. >> > >> ----->o----- >> I asked about offloading the migration to a data mover, such as the PSP >> for AMD, DMA engine, etc and whether that should be treated entirely >> separately as a topic. Bharata said there was a proof-of-concept >> available from AMD that does just that but the initial results were not >> that encouraging. >> >> Zi asked if the DMA engine saturated the link between the slow and fast >> tiers. If we want to offload to a copy engine, we need to verify that >> the throughput is sufficient or we may be better off using idle cpus to >> perform the migration for us. > > >> >> - we likely want to reconsider the single threaded nature of the kthread >> even if only for NUMA purposes >> > > Related to using DMA engine and/or multi threads for page migration, I had > a patchset accelerating page migration[1] back in 2019. It showed good > throughput speedup, ~4x using 16 threads to copy multiple 2MB THP. I think > it is time to revisit the topic. > > > [1] https://lore.kernel.org/linux-mm/20190404020046.32741-1-zi.yan@sent.com/ Hi All, I wanted to provide some additional context regarding the AMD DMA offloading POC mentioned by Bharata: https://lore.kernel.org/linux-mm/20240614221525.19170-1-shivankg@amd.com While the initial results weren't as encouraging as hoped, I plan to improve this in next versions of the patchset. The core idea in my RFC patchset is restructuring the folio move operation to better leverage DMA hardware. Instead of the current folio-by-folio approach: for_each_folio() { copy metadata + content + update PTEs } We batch the operations to minimize overhead: for_each_folio() { copy metadata } DMA batch copy all content for_each_folio() { update PTEs } My experiment showed that folio copy can consume up to 26.6% of total migration cost when moving data between NUMA nodes. This suggests significant room for improvement through DMA offloading, particularly for the larger transfers expected in CXL scenarios. It would be interesting work on combining these approaches for optimized page promotion. Best regards, Shivank Garg