From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2A309C35FFC for ; Tue, 25 Mar 2025 05:21:00 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id A726C280002; Tue, 25 Mar 2025 01:20:57 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id A21BA280001; Tue, 25 Mar 2025 01:20:57 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 89C2B280002; Tue, 25 Mar 2025 01:20:57 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 6BFEF280001 for ; Tue, 25 Mar 2025 01:20:57 -0400 (EDT) Received: from smtpin03.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 78A8514144A for ; Tue, 25 Mar 2025 05:20:58 +0000 (UTC) X-FDA: 83258924196.03.FF972DB Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2075.outbound.protection.outlook.com [40.107.244.75]) by imf28.hostedemail.com (Postfix) with ESMTP id 6F6EAC000F for ; Tue, 25 Mar 2025 05:20:55 +0000 (UTC) Authentication-Results: imf28.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=5LOxKKvT; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); spf=pass (imf28.hostedemail.com: domain of shivankg@amd.com designates 40.107.244.75 as permitted sender) smtp.mailfrom=shivankg@amd.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1742880055; a=rsa-sha256; cv=pass; b=0WEaw0TRbFbV+uNqHRiqrIGx2slFvJVFmY8oWejLgyykRUrTgjeUxw35fl4+AaWB62cGnI pp4IJ/J6DQ2ExqbcGVyyZeSM9O17K9Srbinaqtc8NEz2Qqdn8FY2PWBt0CX4USoSuH+AgC zYWu8fcRbXFGiBlFhKs8YtWFfo4FOBM= ARC-Authentication-Results: i=2; imf28.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=5LOxKKvT; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); spf=pass (imf28.hostedemail.com: domain of shivankg@amd.com designates 40.107.244.75 as permitted sender) smtp.mailfrom=shivankg@amd.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1742880055; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=FJLzNy+0T194klZKJw2/J7hUGW1yhZjOp/XLblAyLMg=; b=B8PUOqdO/q79EaNH/kgEHMUl7x2I3A4i2ABVdOJTkzlBB8RXmEVN3q2KqCetEXYDVBVtBK IVcAnVvCFsLXs4bflLreD9SrTSrDS4ofn22k4qa4s5fCEkpeUyWtqmJffMB0APZ25eAybx om+TirCjurqfkcmtPh1b5op71f7+9Us= ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=Z2szNmD+ETD7rwjAVBfmF/XfxHn1qOJkwWhLFv3hLGeNfgeRZ8chkpNsptvy5APiNVStMhsO2OIIfTkazkPO/qAKrK5cmEZWLSjhJivwPRKLpsFwV72AYMhf4k6BnhA02olNzX+0SDKLziCEue3s4kDqn5nxP1yYuEd01pryW16BP9x6/x6lOtHSnicgGDtNrkQUq3aSXlqkINSUeqRNlEJXfGXJPSdBSiGxxgdOiTTeEE1yvnlQ8WSrSpJ7QJG4Js1/Lpa7l7NqME1hYzubzcJxzo0HZvq85pUrfQ2kqfCocSDIxNxoFKq+XHy6ybnRWSqpHMigeoT4RexlXZEEYg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=FJLzNy+0T194klZKJw2/J7hUGW1yhZjOp/XLblAyLMg=; b=pVOiNw43k0hK+bvnc1LoUMMB+dQLzw8iu/oSRECUaMeT4YgWJBgHIUTHMvFToOhk/LmCG9xF1ms9Ee/Vu9owTsdaoabfbhfHOIBi5QaSTuL8u0u6E4OzO1zY0/R9x0vRr7Fvs33tYZAcVNAiCMSoBL53ZzWnja1LMB2l/6KYZB3OoTjG3hI7SQahxxLI4rYFXiV2KcUEw5eEwiXlcyNJC4CRZg26fg+XcP1rsKVeXAeGtkItLJuPX/+D0hWUZb5wkQu4wjMCZaoIJ5U8+J5L8QuDFkrTBJ7CmWb2jZ1jP0gZpuTIaEW7I6v57usyIvtBdQSJkBp+bpjTtqA5V0jMXA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=FJLzNy+0T194klZKJw2/J7hUGW1yhZjOp/XLblAyLMg=; b=5LOxKKvToRl8Om6H6RNJYsaQvl16Et2/smqP21uweYGPL23iYe+lPgF2mQt/6G1nQnK+lwyeXUlzuqjBXnQZ8SRWexe29rqw6DybybcCS2HRmh9ZG5S//nJ3mxFOvrNWlMsprcz2ZfZ83nIwu0olRywrFRha6aPHaIs7Sy/MLus= Received: from CH2PR12MB4262.namprd12.prod.outlook.com (2603:10b6:610:af::8) by LV8PR12MB9408.namprd12.prod.outlook.com (2603:10b6:408:208::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8534.42; Tue, 25 Mar 2025 05:20:51 +0000 Received: from CH2PR12MB4262.namprd12.prod.outlook.com ([fe80::3bdb:bf3d:8bde:7870]) by CH2PR12MB4262.namprd12.prod.outlook.com ([fe80::3bdb:bf3d:8bde:7870%5]) with mapi id 15.20.8534.040; Tue, 25 Mar 2025 05:20:51 +0000 Message-ID: <02548b27-2442-4172-8f4f-a6fb7588d705@amd.com> Date: Tue, 25 Mar 2025 10:50:39 +0530 User-Agent: Mozilla Thunderbird Subject: Re: [LSF/MM/BPF TOPIC] Enhancements to Page Migration with Multi-threading and Batch Offloading to DMA From: Shivank Garg To: akpm@linux-foundation.org, lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, ziy@nvidia.com Cc: AneeshKumar.KizhakeVeetil@arm.com, baolin.wang@linux.alibaba.com, bharata@amd.com, david@redhat.com, gregory.price@memverge.com, honggyu.kim@sk.com, jane.chu@oracle.com, jhubbard@nvidia.com, jon.grimm@amd.com, k.shutemov@gmail.com, leesuyeon0506@gmail.com, leillc@google.com, liam.howlett@oracle.com, linux-kernel@vger.kernel.org, mel.gorman@gmail.com, Michael.Day@amd.com, Raghavendra.KodsaraThimmappa@amd.com, riel@surriel.com, rientjes@google.com, santosh.shukla@amd.com, shy828301@gmail.com, sj@kernel.org, wangkefeng.wang@huawei.com, weixugc@google.com, willy@infradead.org, ying.huang@linux.alibaba.com, wei.huang2@amd.com, Jonathan.Cameron@huawei.com, byungchul@sk.com References: <0f9e697e-d01c-4559-9c1c-7dd2ce76045b@amd.com> Content-Language: en-US In-Reply-To: <0f9e697e-d01c-4559-9c1c-7dd2ce76045b@amd.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-ClientProxiedBy: PN3PR01CA0124.INDPRD01.PROD.OUTLOOK.COM (2603:1096:c01:96::12) To CH2PR12MB4262.namprd12.prod.outlook.com (2603:10b6:610:af::8) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH2PR12MB4262:EE_|LV8PR12MB9408:EE_ X-MS-Office365-Filtering-Correlation-Id: c41cc8b5-1e10-427c-e792-08dd6b5ccefd X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|366016|7416014|376014; X-Microsoft-Antispam-Message-Info: =?utf-8?B?cml2ZDZHOVZjYVpqMW52d1UvTk9JNWF5WUZ2VlVwNHpLMnNNcE1LTjNMYnRI?= =?utf-8?B?ZjRXa3Y2UC9CZ0NYNXJPZ3NuWnI4bEtXZkFDL2VvQy9Sb04xeStqTXFQajhp?= =?utf-8?B?Lzh3RVc4MGdtUDBmQ3c5VjRsdFhaOUo0dWJiODNTS3o2dmZxVnlMbk5WZXBH?= =?utf-8?B?Kytva05DT0VmMHZSR2pTWTZWU3VZb05JNVpwMmtZRkd3alFvRkRyUUkzdWRB?= =?utf-8?B?QXRNRE1VNW1jVUlrVjU2Z0NXNEZBZ0dndVUzbVpORUg1RXFKeGFoc2k3USs4?= =?utf-8?B?cTB3ME4vME1CSkwxK0FCR2xKM2MvOVVGSjZNUGxFMy9zdWdacHZ4ZXhLMTdm?= =?utf-8?B?K2VuR05SYzVoamFmdjhubm5OaWtIZVNJcXJvcXRsdUF6VUhuKytUQS9va29S?= =?utf-8?B?UlpvRmlvRGFTSUp6TEo2WTI4am9UYXpNaTNVeXdCWndpeEtPdmdvODQ1dXUv?= =?utf-8?B?ZnVKTmdPdTVDc2VFVTRKWU55b3g0Q2dxUTlHV1NId200a2NDb1Z6Rk5KYk82?= =?utf-8?B?VHAzVkdHc2pKKytJRUtZMTdQS0R1U3BHWjJZMS85M1F3bTZXdjVwM21BNk9X?= =?utf-8?B?QmlnUXVKcHRkbm9aMTE1amQyaHRxcStnQ3dCNVJqWklmczZpbVgxNENodkhC?= =?utf-8?B?RzFObUZQZ2VIOFNNSjFSamRQcUtSTlIxNTd4QnpveTVxam5RSm05Mk5KUHJ5?= =?utf-8?B?NlE4bUh1eldPWGEweGN6OGlCdjlDZkJrQk5MWXE0SXN4cUVkL2NKMlcvQlRJ?= =?utf-8?B?WlpySUwxSytkQjZuU1VQeGdIaVpLWUgyYXhwaXdXLzlnSHFZQmtqdWoyQjR1?= =?utf-8?B?Qnpkd3ovZ1Awb2FsVTMyd0VMQlM5SktpOHZvK3hLTkJTcmRXMysrQW1MaXZr?= =?utf-8?B?SkNsdGlMK1Z2RmpwSTFydGYvenlsS216Q0VaQldlMW90cnN0cW1iUzJUTEM2?= =?utf-8?B?MFhUT1Z4QnZCZlFWeHdWZzhpMWFLNHJsQ0V0L01hK3NjMW03VDRhcTlYK0ZQ?= =?utf-8?B?eGR2WndYUXJCdnhOa3VVeFU2aDVSSFEvU1pzeldmYndtRUdRcGRGczhUUGhy?= =?utf-8?B?RjVNOUZiYkkzckEwMEcvVE90elJsLzI2Rk1iM2VaU0FKK1VpK0NWSlBhV05v?= =?utf-8?B?QmxlYkdCek1VT3doMCtTK0NiRVBObE5Ecyt6Q3htSzZzNjVwcHVaeEdGVEZu?= =?utf-8?B?azJGWmdaZnlHcGE4M1UrSWtsKytBSGxGcWZuajh1ZGkrL0hvNGV0MFRnc1BY?= =?utf-8?B?RUtSTEo1Y25CaUNHc2dQVXUrNjgvTjltL3FoQno5R2srRHVDelNFZS81Qll5?= =?utf-8?B?TUpyZWVNblRrVmJPQVZqL29UZmpObnE0cFp0eE5yb2haK25DYVhZbTAySE5E?= =?utf-8?B?ZkxFMjV0U2ZqWXVySnZyQUNuRENKSmdvazVnMW5IaVkyUTRaZ2d0UlVqWnR5?= =?utf-8?B?U0l4U1djREFtcWo1UlJCQjBNekl3dzNZcG5QcHNjNkgrcUE1REp5RWRnaXpt?= =?utf-8?B?eGxLQWl0ZEZxc1hmQ0FoY0lYNVd2d1BldVgxZEFsaE9IcTZJWVo1RlhocGl4?= =?utf-8?B?R0lnemdvaXI4b1RUclJzSmFOYW5ITXJaZEd4MTlua0JQTVRaQ3l5MC85bW9Z?= =?utf-8?B?UWdSNjZMazNhaUFIbVBLSEZPbkVwK1JWQ2ZYb3VNM0U2NERtWTVIN0d2UGNj?= =?utf-8?B?djNTNUliRDhzRmRDUDZJQlVMaWhOQUN1SWY4MnhpWDlCNlFiZldPR2xzR2lP?= =?utf-8?B?UWpzUStDNHA1aDRObld5WmdvZWRPWWNuUVJ2djNYTXh5ejRHMy9LQnlWaWdX?= =?utf-8?B?RWc3eTJLRHY2S3F3TXl4dz09?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH2PR12MB4262.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(366016)(7416014)(376014);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?SXB0bGpSa2dGV1FFSURDNEVGWCtmRTlQejVyR1hLd2V2aU40RnlwNXFNS3Za?= =?utf-8?B?QUdHcnhvdlhsdVV5TVVMY2tPaHV3blVwUzBNWlg3ZGFmNzFQa3J5bWtUOGVw?= =?utf-8?B?bWNBL2lrdlRveUFPMUhBK284eUJQT016ZitWNlhOT3hCUkRuQlhFUmtPeWNF?= =?utf-8?B?Z2hwMWlEcm1qcWJvTjVOTmFNRVdWa3d6cUpnNXRkdExjRTd5b0VjOVZ5eWhi?= =?utf-8?B?aE1IcXhkSThSSFRseHpZa0Vua2NSTjlRMkdOWWNVbTE3Q3ZtcmhwenRmdXpR?= =?utf-8?B?K3NtOVh4clFxTk5JK0haWVZlZTc0cWtma1J6WnNQYzZVVUdpc0ZiU1drdE4x?= =?utf-8?B?aUtSSGk1aGpXdmFCdWFET3lJd090dUdPU3ZUWk5sWEdEWXVCYmY2TkNKVStu?= =?utf-8?B?Vk42aHlhdFFLaC9jbDAxT2hFSW5hVWlEdWlOSVh6VXgvL1pBeU1VMHFQS3A1?= =?utf-8?B?RzN5dUZ5RG9FSFR5eVBHelIvNjZTUlFvamRyekl1c3BuYWIrdkV1T280ZTVv?= =?utf-8?B?ZlNwMXNsZk0za2ROeTRUai9nOWk0UzlnbWl4Sk5GYlA0MFAyOVZFRUYwVS93?= =?utf-8?B?RUltR0NLczBxUWJGeWV4czd0UXBCSUVLVXpxN1VWU2RRdWE3dTlhWXdtUCtl?= =?utf-8?B?Z0l6YXhaVWNKOWM2SEROdjdlMG1udkRQWENVU1cySW9pSkdhVmd4c25wdUR2?= =?utf-8?B?b2RmdW9NMUtWdlZmTjlTT1hhb1FwVUlYSVVZTk5jMzhsaThWdURTOExnbjN3?= =?utf-8?B?S1l0Mm1rcENNOFJ2MHVHMFgvTXlhREpvS1ZkMXhvZ1FzcU9FenAwUU9Bbkcy?= =?utf-8?B?aFJEbWpXYmo5d2NTTFhHWWJmcTcrbVZ2MW5uMGpqNHlKejJOR3A1MjNWeHBG?= =?utf-8?B?RExqZ0daSEl4VWQ2bzd1VmRNMHVRQ2R5SXVCUXJVTmlhdkpBR25nWktZaGxv?= =?utf-8?B?QkVSNnhIYmdJU1VzaVVpRlRiTDJzcjh3TmtmaksxdVV0ZUQxWE5sODVOWG5x?= =?utf-8?B?Wnpjb2g2eDlOQndLWXBvSkt3Rjh0RFVTdnBwWFN1MWY0ZmNBdUlJbVQydSt6?= =?utf-8?B?RWd3WDZoSUZxdWo2NTJLOURmUHppd3ZCZHJoeVRCdGN4ZjJ1aVM3MFlETDVE?= =?utf-8?B?SFhLUmxzSkxLdVhucjNOYnlyV1RTK0xPdFgzcjlPajNObUVlOVZxQ25WZzR5?= =?utf-8?B?dnlCekQ3L2xsRDU1dUVqa3A3b0pKNFBwMlBQbGVheFJDWWxKckV2amw5VGQy?= =?utf-8?B?R01tSHdONnRJOTdSdFh3bWZMMnFDUmNrUVBNaFF3ZGNDNDFHSllsVzNCUW9L?= =?utf-8?B?YW50NExCUFI0VUVzRm5BUkh5SDhMb1NWVEZ0V0lQZGp1aUJybThlb04rYk9S?= =?utf-8?B?b050eDFDNnMrOEdmemF6S095UjcySFNQcWJCcldtKzA4eWR0SWRtZ2luRFJG?= =?utf-8?B?aUQwYUYrNzJBUWY5ZnF2eUtNb0hyMi9ONUFVZUpnZkVHUnBmTHZHMUJKaHhK?= =?utf-8?B?Q0JaWWJIOGJvWnRTdmJZRGZtUjlrM3A1YTFEK3FFNXJtaXZkbEkydTFoUzdi?= =?utf-8?B?YnIvdTRzVnNMRWJCdGhJZnBtb2ttU21OSE1iaWR6cW1JV3RTMXdsUzF3YmUz?= =?utf-8?B?SmhRWVZHUlEzdGZPNE9xM1Z0dUprcFBTMDA2aHhEYXJpSU4zR2xTRmhIYU5k?= =?utf-8?B?N3RTc0dBam0rWHRzZkM0T3U5TWR0ODRReVUvQzNpTjZyd2M2TDRhbkZtOGM1?= =?utf-8?B?TDlmZCtuWEVWdW9jdXNZZUluMGVyU1ppQ2hvNDhHdmhNTzZPNEUwcmx4M3Nq?= =?utf-8?B?c014c3F1QWVhOHN3OWF5dGdtYlR4L2VvV3ZURHplb0o4Mlkzc2xoTUtHYWkx?= =?utf-8?B?SThnNFR4YWhaOXdMVUZGV0xheWlycUdaSXZyS01TN2lGQklJNm1uOXhEZTFZ?= =?utf-8?B?aTlDQ3RzSGhWdWJTZVMya25hRjdIYmQ0MWlic2pzbmkxUnZtSFIzdmV1NG5v?= =?utf-8?B?RDdpNHo5R2dCek1QVXhTNUdaZDRFM0h0T1F5SWpTWUJtVXdjMlE0NDJGSDZL?= =?utf-8?B?VXUyZlRYekxReUd2ZzdHbk8vR1lXenE2VmpxaFhuNmNVamhsYzZIY09ybE5n?= =?utf-8?Q?5hKi0yOfRLofK0ooJ5PT7+hz5?= X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: c41cc8b5-1e10-427c-e792-08dd6b5ccefd X-MS-Exchange-CrossTenant-AuthSource: CH2PR12MB4262.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Mar 2025 05:20:51.4110 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: OP+RycWkkwB0kIuqmFgfVubIqBMgrWEOpXdr3IRAS1sBCKNrTbeGmwLPvTToblYLRzd0fuqT7wxhp0HgNsYLIw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: LV8PR12MB9408 X-Rspamd-Queue-Id: 6F6EAC000F X-Stat-Signature: 7s9ar8qtrcp6pos1786qqt4575gawc4t X-Rspam-User: X-Rspamd-Server: rspam06 X-HE-Tag: 1742880055-987624 X-HE-Meta: U2FsdGVkX19Xzr0Ca62Lv0VdDJZmayZDegO3FB7CMoLDxWpVrv1YhdxNtT0NAe+eD7lFFdQXdBSKOqjwx0i0CzDq97pI7OfvkuUPrjpgwVUE3kwXsRvAusj9e+ijcBpSJOh+G10ZxJVElI77s5tdw8rFBTcMMp2nMVwN3nuFxY4+TLVbd7+0TPKxi6NT/Vb4e7qiyN18+gbhBjOL3pI9xCByEip+nCrAwsD9c7+GV4e/GPhshH1rNdoXD1C68FQ9VoQx+aMoK1i5qj3S/Ncgwj4XXxQa++Eoq9JqjmDMGzBfwonr3jKaqqEfXi3eS8rD+V5Ei/9wPm7Vnp8D7FqYzR+Jsya3C6nl1nhjvAcPEDKwBbuonn72MvpnXUpTDREHDsjWuIq6WDo2I4re3IxSzjZ6n0AZzupN6cZoVhW4OjJBlE/fH7wtrcdmYp7njNq9K7W/oxxg85XuJh42xuOmv7sZglEkTQcX5TSoN1Dc9ECoWFKT4pGOodfF3W0F/MpOaYQWDrdRKW6B9EzqXfIswbEgvo9zwbH26Q0dCwaIea6UOGIb49KO67IgbdX5aGEqdXO8jkwcDCBxDLydiutSIhY402v2biXuZQXDth6wLzn1pb5nGQ9F0n9XB190luKSJ+vKBq+ncGBbCDWR3bUgyUu8iZ8A0vWVz56Qs+SXYqQICB6R63xgPAOeuBm+EJYQ1E6PAh2odqmlAO1vPdRpBD9LpUzDbr/+2AOHAlA5N9QyAZLQSVJOUvIoXd5o4NWtySeQXWfghEcuducLz8sAMaz6bKUI1iZDn3KfJUTnjJD0g0Uo4e0omu8XacnbCSIih6uBXYbAUka8xLHfTZ9SXMJkaY6G8wcKfN23IAbXaB3UNMnsdGFbPCTd3HjIGkCf0rAvfKNd6OWMTGPws1uwNNnhUNV1fkI7/Kc3AO9xRdnVWEQH+WUuI66X3ReFI7CO1AyoGK7zoXB3k3g4Qfn Vt4HSQ9q zT1sPvABzQtSUt/UGWDvXCWAphRhynzInn9idRy5jbvH/gGJC6QjDh2Ld1/d/Htjv9YoGqOL/ZHsSxdBFgd2hCUWFJxfAykeeb/9lxlg8UoOLffqmSA2dMlB44z7dW2GFXkf0WXdut5SmRpqNsoNYu9qXKyKM2fv8Hk81jzKFsx3oKLiDwn0gH6B8b56lfefHSElDqAXQTBW3ZBEauhk1c4dc7rq4+8KAuw52FspvH2OJap+lG31EKG35ral0X9Y9d6Yep0tPuJvnB4kVbphgrv0490f2kixYpXfYGAWw/xcPDTES3dhCkQH5+kNodOWNUCGM16NipNm0e9RD07pqyhSltcWWXbwoXJH5j1/hdOFGEfayqxbzQ/rkx5rDI/olz0Z0lQ+Ai5xnuTG8pAvavD13+r18g1T3cT7U54gwUFGp9DXWrlRJWwYVNoHbfXCm6ZevZPnJNOHUyHpfpWkKqtFKPMO23GBq086hYJSwVYVTY0L3QYKcF2vdxL95y4C30Pg1bOq9ex95xeBralY2N1L8tHgMG3ihH3Px2CDCG+lndPNtR1mxtrjIwZfouGLFaj1OHqimYXO4OOHSKooI2AlPG03QmsAkJ9PRpbTyK9F9JDfvKTQvYYVxJ+MLERNDX3R3kcR3ndX0Qfg= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000131, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 3/24/2025 11:31 AM, Shivank Garg wrote: > > > On 1/23/2025 11:25 AM, Shivank Garg wrote: >> Hi all, >> >> Zi Yan and I would like to propose the topic: Enhancements to Page >> Migration with Multi-threading and Batch Offloading to DMA. >> >> Page migration is a critical operation in NUMA systems that can incur >> significant overheads, affecting memory management performance across >> various workloads. For example, copying folios between DRAM NUMA nodes >> can take ~25% of the total migration cost for migrating 256MB of data. >> >> Modern systems are equipped with powerful DMA engines for bulk data >> copying, GPUs, and high CPU core counts. Leveraging these hardware >> capabilities becomes essential for systems where frequent page promotion >> and demotion occur - from large-scale tiered-memory systems with CXL nodes >> to CPU-GPU coherent system with GPU memory exposed as NUMA nodes. >> >> Existing page migration performs sequential page copying, underutilizing >> modern CPU architectures and high-bandwidth memory subsystems. >> >> We have proposed and posted RFCs to enhance page migration through three >> key techniques: >> 1. Batching migration operations for bulk copying data [1] >> 2. Multi-threaded folio copying [2] >> 3. DMA offloading to hardware accelerators [1] >> >> By employing batching and multi-threaded folio copying, we are able to >> achieve significant improvements in page migration throughput for large >> pages. >> >> Discussion points: >> 1. Performance: >> a. Policy decision for DMA and CPU selection >> b. Platform-specific scheduling of folio-copy worker threads for better >> bandwidth utilization >> c. Using Non-temporal instructions for CPU-based memcpy >> d. Upscaling/downscaling worker threads based on migration size, CPU >> availability (system load), bandwidth saturation, etc. >> 2. Interface requirements with DMA hardware: >> a. Standardizing APIs for DMA drivers and support for different DMA >> drivers >> b. Enhancing DMA drivers for bulk copying (e.g., SDXi Engine) >> 3. Resources Accounting: >> a. CPU cgroups accounting and fairness [3] >> b. Who bears migration cost? - (Migration cost attribution) >> > > Hi all, > > For reference, here is the link to the latest RFC v2: > > https://lore.kernel.org/linux-mm/20250319192211.10092-1-shivankg@amd.com > > This version combines the ideas discussed in [1] and [2] and includes details > on performance improvements and experimental findings to provide more context > for discussion. Sharing the slides from today’s presentation: Main Slide Deck: https://docs.google.com/presentation/d/1mjl5-jiz-TMVRK9bQcQ_IsSXrIP82CqWS8Q6em3mJi0/edit?usp=sharing Multi-threading Slide Deck: https://docs.google.com/presentation/d/10czypcUbRMOUn6knp340Cwv4bf83Ha2gUX8TwNXUwCs/edit#slide=id.p6 Thanks, Shivank > >> References: >> [1] https://lore.kernel.org/all/20240614221525.19170-1-shivankg@amd.com >> [2] https://lore.kernel.org/all/20250103172419.4148674-1-ziy@nvidia.com >> [3] https://lore.kernel.org/all/CAHbLzkpoKP0fVZP5b10wdzAMDLWysDy7oH0qaUssiUXj80R6bw@mail.gmail.com > > Looking forward to your feedback! > > Thanks, > Shivank >