From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 35140C02182 for ; Thu, 23 Jan 2025 05:55:27 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 5C7D3280001; Thu, 23 Jan 2025 00:55:26 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 5775F6B0088; Thu, 23 Jan 2025 00:55:26 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 4223B280001; Thu, 23 Jan 2025 00:55:26 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 238606B0085 for ; Thu, 23 Jan 2025 00:55:26 -0500 (EST) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id 85351160C8D for ; Thu, 23 Jan 2025 05:55:25 +0000 (UTC) X-FDA: 83037654210.12.73D6148 Received: from NAM12-MW2-obe.outbound.protection.outlook.com (mail-mw2nam12on2086.outbound.protection.outlook.com [40.107.244.86]) by imf28.hostedemail.com (Postfix) with ESMTP id A1335C000E for ; Thu, 23 Jan 2025 05:55:22 +0000 (UTC) Authentication-Results: imf28.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=J2nJYzGq; spf=pass (imf28.hostedemail.com: domain of shivankg@amd.com designates 40.107.244.86 as permitted sender) smtp.mailfrom=shivankg@amd.com; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1737611722; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=6plYs8vUjfPZ+fLzcZrKEWfi+l0IIt+Ma09ALV0FZkE=; b=ML5YaThqXR7tzXeHo2+kqXnMDdhWrYbnsgxyA/5PZKAm7RTXuSqhRv+m6ob4bWuyEeMEs3 yP9EyeHVr9C71AkSKG2u7vcdysgIGXd/KWESAy0NqX9bb2e6oYas2yaKl9cHm9fDHzU61q MBvn2FzdSIN9seGTvU1sxLXuTGHJmfw= ARC-Authentication-Results: i=2; imf28.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=J2nJYzGq; spf=pass (imf28.hostedemail.com: domain of shivankg@amd.com designates 40.107.244.86 as permitted sender) smtp.mailfrom=shivankg@amd.com; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1") ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1737611722; a=rsa-sha256; cv=pass; b=uADC/hstQihEFrQriZQvaMV0qte0sPq7xDtQsgdCaY+2Urp0b0Mw9GHyixMgg6jQwttoyi CrBhaW2Jx9YrEHvq0BKVmby/0WSjr+VpII9+OmmNIc2AR6NJs5KPYTAxJKr+TJlxQAF+w5 jpkYDjkCuZqfcj80MeC46NFJvheZ/EY= ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=lBxV6aFDuuHFcpiMfW2aatWLEz5W0UVUTKlY8Pxy6SDjIS9hNDnxteOgaODydsVPoFz9w0XZRKG9m8dWA32V/wP0C9dwKmHYF/BBFIEP1DA9RJBPgvkUlZFadUGBUezslbh/w+/3g3wQ8B+Cfm/WDwm7Ed0jzXq8Drld2YCDPdox0htGQoNWvH4WVuNkIqxzK24gnLPhaSB0pYAS3NOh2IF++sJvmd+9tZzxEEbYlFpxT+yQwQVQMKr5Oo7t2nEhgiL1U6OeTNQHuuEGXjoGkLy5UWGJXoeIeLhqM1GgDOW202WcSxV549ST8wxa2xirBiMIAFDfFvQ7HX+Uz5Weyg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=6plYs8vUjfPZ+fLzcZrKEWfi+l0IIt+Ma09ALV0FZkE=; b=kjujcGaaYMLMidET0Fc+npN+UXsDspkQ9lcjb0iGfujsNaU/ijEIWOl0iveuGRP29jccrTJuxtclm3YwytoyfCr2BofRQ4ZnwyJbgv8q7zzafeKnXfGItYtlHvu9F6g2Y5T8yTAZFwEyf1ravteBPtseOWAXQJj6R2eMPCeO1SRTDLPzZcElc8a5uHA7KjkdOxGq7ng4OiWxwow2X882K/JI3bUFMrm7hkKgorc0BivgRMLQRM6YV0H7ZRFbwkaW+sO3DWt5a0Qywg/xCa1tvWDp78wUAGVDgwAoQvQbiepn09E+ci6py2kfaniMkoH+sJRzrxMSFxiLDAs2jjKMfA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=6plYs8vUjfPZ+fLzcZrKEWfi+l0IIt+Ma09ALV0FZkE=; b=J2nJYzGq2mTNsg2lbHAeE+WgTXu4M4G5vbnnPBRRnW5PvVw1dZPi/ZxCE7PnjMKX+mHvdRY645x4rCgBZtStdxlEe9WAlTrjvjzxbvq7knn/p0jopplFDpRxxLj74NyNsw7jX9yppIhh9RyT+ESMVekp7MGcm1vYzpGXwoM906o= Received: from CH2PR12MB4262.namprd12.prod.outlook.com (2603:10b6:610:af::8) by MW4PR12MB7333.namprd12.prod.outlook.com (2603:10b6:303:21b::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8356.21; Thu, 23 Jan 2025 05:55:19 +0000 Received: from CH2PR12MB4262.namprd12.prod.outlook.com ([fe80::3bdb:bf3d:8bde:7870]) by CH2PR12MB4262.namprd12.prod.outlook.com ([fe80::3bdb:bf3d:8bde:7870%5]) with mapi id 15.20.8377.009; Thu, 23 Jan 2025 05:55:19 +0000 Message-ID: Date: Thu, 23 Jan 2025 11:25:05 +0530 User-Agent: Mozilla Thunderbird Content-Language: en-US From: Shivank Garg To: akpm@linux-foundation.org, lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, ziy@nvidia.com Cc: AneeshKumar.KizhakeVeetil@arm.com, baolin.wang@linux.alibaba.com, bharata@amd.com, david@redhat.com, gregory.price@memverge.com, honggyu.kim@sk.com, jane.chu@oracle.com, jhubbard@nvidia.com, jon.grimm@amd.com, k.shutemov@gmail.com, leesuyeon0506@gmail.com, leillc@google.com, liam.howlett@oracle.com, linux-kernel@vger.kernel.org, mel.gorman@gmail.com, Michael.Day@amd.com, Raghavendra.KodsaraThimmappa@amd.com, riel@surriel.com, rientjes@google.com, santosh.shukla@amd.com, shivankg@amd.com, shy828301@gmail.com, sj@kernel.org, wangkefeng.wang@huawei.com, weixugc@google.com, willy@infradead.org, ying.huang@linux.alibaba.com Subject: [LSF/MM/BPF TOPIC] Enhancements to Page Migration with Multi-threading and Batch Offloading to DMA Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-ClientProxiedBy: PN3PR01CA0045.INDPRD01.PROD.OUTLOOK.COM (2603:1096:c01:98::8) To CH2PR12MB4262.namprd12.prod.outlook.com (2603:10b6:610:af::8) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH2PR12MB4262:EE_|MW4PR12MB7333:EE_ X-MS-Office365-Filtering-Correlation-Id: f2f4dc04-9b06-4afd-6b2a-08dd3b728481 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|366016|7416014|376014; X-Microsoft-Antispam-Message-Info: =?utf-8?B?UEEzMUpMdlVlMk50RjBtT1hGQ0RpVWxyRVFTTFJpWWFhUEZlcHREVEdxUFlP?= =?utf-8?B?SmJ2WWFSQndkckNCcmJXRThrdVlmNGFVSTE4b0pJSVh6ZWZKK3RFQjlrT0oz?= =?utf-8?B?SlI3ejREZ1VsZU9MeldQTElBN1E3YWhSWGNZa0I2S0FRclZmOWtLbWpGaExJ?= =?utf-8?B?dmN5em1ld3dRblh5OGRpUS9xT1dCbnlTUVV3eFRuQTFMZkpUekVrSUdaQStH?= =?utf-8?B?eGVCU1NyWTZ6TzVkOXJkY2R5amNLWUh0Ymk5c0p6YjRSM0EzcVA0TE5aMVlQ?= =?utf-8?B?bTU4bXh5dUw3Y1B6VVZpSEpRejczM2o1eUJLVmVlcWoyRUVFUkdJcVNXWVFQ?= =?utf-8?B?YXI0T1ZlM2d4Nm5EaFBYRlpkbFlTQkg2alpYaS9DcFh6L1orYi9hMXA4Sjg2?= =?utf-8?B?THllQlNWcW1NaThvTWRwS3FvNjZwNnl3NE1RVnFqWDFHWWxHS3ZuRnVVZUYx?= =?utf-8?B?amYyUVpSRFFQcFNpT3psZFUyeCt3RnBVSFkvRGpxSTNRcmlOMy9uWkdYQkJK?= =?utf-8?B?MkNPUjlNYlBLRVNlK01tdkszc0lBdjl3dWt6cWR4RWpLNytlbzFYSzk2WEdY?= =?utf-8?B?WG9QejlOdjc4WjIrZ2x1UUlnbDVSOS8vY04rOVBpZEo0dUw1bkQzdjN1bUp2?= =?utf-8?B?ajAzOVNFZlVzbnRnMXphRnoyV3pWZ2U2MDFiSTJ6TEVvYmE5RWFTVHFuSVlp?= =?utf-8?B?TFRKdmJBakRkYnRZM0llQ3p6b0tpc2UybVBQQUd5ZnNWQTIyekQrRGMwenhy?= =?utf-8?B?Q3IzTVBRVVRtVDJPNjlDeTJOS1pWMGR3MWhUNkxidnVrK3AzbkNiK3E2d1Rr?= =?utf-8?B?ZW41ZFNzaU5QaStPSTNCR0FKMjlUWElJajE0VGYrdVJWMWR5QXRHcmhPd3o5?= =?utf-8?B?Wm1rc1VYbWduMFdiWW1HeFpVTHRaK2FIend4bUlMeVh1WldaNXNQUktmbGo1?= =?utf-8?B?cWZGOWswTkpSdm1BZnpoV0NNSzczV1Bmdm5CVmkxT3E0ZXU4OW5FN0hPRm1w?= =?utf-8?B?M1ljbUt3elVpRTM4cVBWRUlUTTQyOFpXc3ZjNmUrYy9NU3RIby9OU1NrWmdx?= =?utf-8?B?eVJFeTNrVExPUGVUK1NoYWdUZzMwV2pGaGV0eTROVU1oOGdSRkFjUzJFTWxq?= =?utf-8?B?L25xazIxTkgyWGRNcGY4SFk3ZnZJSXBKRTdET05uMkJVN01pOFFiOXVSTEEx?= =?utf-8?B?OGttblpUM3NaajNYMTVnQkpQTzBrd1hGYzF2MngzSFQwZnBhZlFJS2ZOYTF3?= =?utf-8?B?ZFAyeDY2ZU5RaFBNZkdENG4rSHk0WHdkdW9FanBaLzV5ZTUwOGlqZkxhVSt3?= =?utf-8?B?RzMyNzJ1ekJLQ1RvT3pCYTFqUGh0QVhDTnQ5RTZYNUlDby9sQ1FYZ1ltYmpJ?= =?utf-8?B?TDlNOXhsMkZsLzB2clBZRE5UYTJCYUhUd0ExenlXQ1RkdFVuWGxwdm52MlVG?= =?utf-8?B?Z0FKZHgrSEFqMGMvOHdYMlN3b3Ixa2VLV3ZLWTVCNHNBSlZUMTFudzluTkhZ?= =?utf-8?B?cGpnMWJDYTlTbGF3Z1RWQncwR3pneFhEcTR2ZE1CdVFJOU5UUnlHYWp0RS9I?= =?utf-8?B?ZDVnK3l1S1FPa2JCN3ozY2phcEJtejQ3NW1TS3FHNmtqangyTDhObk84WFpR?= =?utf-8?B?NlVrZW9zZnFCY0Q0eFRZSCttVlduTFVIcVFVWGY0TmxLcjd4ckphQ09PUlkv?= =?utf-8?B?VnM3MXZqdDg2czVzeC9vbFBYWHJOenBsbi90QjdXejkrQWgzcnhqM0FiMlJn?= =?utf-8?B?TVVBSEd1WEx1WnNqVVAvVXg4aFkrL0xtb3cySVh1TFArWWlhVkorSEo5WVZN?= =?utf-8?B?MTR3amxzL1VBbklrdXZ2Zz09?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CH2PR12MB4262.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(366016)(7416014)(376014);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?QkJpaVFjQUxqNlhvcTVvWUhRb1JzeTBacThPSWxhcGx4L21VR1FDNUt3MWRN?= =?utf-8?B?UUdYc0dHT2F3ZUxia2czOTFtaVp4dzV5RkQ3aFZsVnFCKzNybkJZTmV6ZUc4?= =?utf-8?B?bzZsaTFwSG5SYXZmM0F1RUxaYjkwRlkzTjMyakZDSDRmaXdLV0g1R0d5Sm82?= =?utf-8?B?ckFTS2x1Z0VHSEt1U2hDcklIY2YrQ1VOdTh3anh3ZlhXZWkydjcrd1gwdDNa?= =?utf-8?B?SkJhcHYzWDFqcUswVXlib2ZURlQ3cXhpbzgvak5QUzJKcG5ZNHU5bytqQkk3?= =?utf-8?B?bFJwTEVadEtBeGxQM1FsdENsam5MTGNYT1lFa0l4MU9oYkR3OVd2TGtKbno4?= =?utf-8?B?SkxiY2x3NFFPZExQKzhkOGEzNnlsd3ZibjQ3K3dZdjZWYm0vZFBTTkhuTGM1?= =?utf-8?B?ZzFmMmZGcFRuQ0J5d0hWTWpMMno5TWQ1ZnNTa281bVF1Z0szS3AyZllaaE1y?= =?utf-8?B?VlVsdnJDSnNpZkZjeHMzbm1KaGxUMEt5Y0dsMU1pZXVFUTdYUkR5b1ZKb1J1?= =?utf-8?B?bTdneTZqeWpGWHVYb05sNmtUZ3U2TVBESm5uUW9vWjQyaWNIcmN4RmpzWkl3?= =?utf-8?B?NmF5am9hdU15WjF1TUdmdE9GS2p2czE4N3VNaDdqd2xFTk9HSGVVejlvNVk4?= =?utf-8?B?US96aFZYd1dPT1M1enQ5ZUFIaWxLZW5DeDVPK1I3RkpBUDh2NDBvZ1hBdFlV?= =?utf-8?B?cmNibGVuYlpsMUxETVdqQnpIYUZCWmpJQ3RLTFVmR3JzYUhDRERjQ3gwb1Fx?= =?utf-8?B?R0N0ZksvSElobERiNXYxMDBBNXF3YmM5WWlEbW8waUNmRjl1Y2dWSElsc3pw?= =?utf-8?B?emsydzU3WDFqcXNBQk93anFTMVBMaStscGRJNERvT1dWRzY2NkFQYjZhbksx?= =?utf-8?B?SlRpdkRhUml1TzRsWHgxd1BTRnZrc0RsZldlQkZSUW0wMy9Pa2ZuaEFld2Zk?= =?utf-8?B?alJHN2piN0p4YlhwN21MUjRlb3UvQTc4cEd2KzNCUlRkWDlsSEdBSTlUdkxC?= =?utf-8?B?ZmJqdTV6WEloaFVUajRLTVA2YWhZRkJHNXk0bitCWVlnNTEzVGhOZyt5YUt4?= =?utf-8?B?MWkxdlNYVDhCeXRDc1FlNERkaUxhVElMYWRmeHhucENvWEZENVcvb1I3R0F4?= =?utf-8?B?NWJRclJzbjlMeSttWGQ2NkljQjVacS8xNjdaRVJtSzlWTGxZdGllaWM1TmtG?= =?utf-8?B?bHJtTytRTEhPY2YwbzdVZnYxbVArYzJPbzNpWGdtUTM3TXVWYzRVSjBDZnpo?= =?utf-8?B?L1JJcEwvMkptMkJCdnVDYmpSa1FlMjdNWWpZbDc2N1dNaU1Cbi9HT09pQ2Za?= =?utf-8?B?dlJrOEQ2U1g1ZnZnWUx1b1hQTjRMMEtxZmtUQ3RaMW1oWlJMay9tVW1tZDU3?= =?utf-8?B?YVpIM0NXS3duOG9HNDU3RGc5WERESGxsRzdaTm5FUDlXUHE3YUh4eXNPTlYz?= =?utf-8?B?cTFHTWF6bHQrM250QW80ZjFqaWZUdUpRSjhuVDBuajc1ZWloRWppbVRpUitR?= =?utf-8?B?cWZDR1NOUldQVno2U3MxWmg3cWNNUXFJY2NUNmJubmlsQ2xjNEhvWTFNa2Fu?= =?utf-8?B?aUNEMlYvWEIzUEFyYTFqeWhIYlRJYitXZUlHSGE2MzdydkJHRmZGTzVRNVc3?= =?utf-8?B?aWlpbzRmMWpjdHlkbDhlK2s0MVUvQWc2d0FvY00xcXhlTStUaXEyVXlHb2sr?= =?utf-8?B?L1ZxS3NnUlhEVmFaREtWci8xK3hlNEF5c0dKK2xvTUZoU0hsMUN6M29QbjBJ?= =?utf-8?B?Z0RZT0VkQW1BQjUvMDZlQ1dCT0M2eGk1Zk1nQm9reTdLOVhLU2hlZUdkZW13?= =?utf-8?B?d1Z5Y3U4MzV2Y05BM0NrZ2xhNk54VFIzaUQ0K1VJMktYM2xtOExkQ2c2Undj?= =?utf-8?B?dTVVZzlYaDBMSXhDalNoTWtTOVpDODl2YXE4cFliUHV1aTVtWWpKT0lNQkRX?= =?utf-8?B?WkREZmtTeS9HaGpHTW5sKzdMUFlHVkk2VG1sc3pJRU9mVTVEU2UxRlNHN2lK?= =?utf-8?B?OEpUVUhsZ2pmdk9PL01CalJIQjQ3SjJJSGJPZE4relBkT1hkZUljNFh5b0xu?= =?utf-8?B?ME8zNWd1NkhlNVh4VGdsbko2dXV4MGZJN0ZRSTVtUmlmR0VJU2FkV2REeUVi?= =?utf-8?Q?qFXlwJB16jK2cymd8JoJnTUBJ?= X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: f2f4dc04-9b06-4afd-6b2a-08dd3b728481 X-MS-Exchange-CrossTenant-AuthSource: CH2PR12MB4262.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Jan 2025 05:55:19.7053 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: L6cORtYqomk0CWZBHHmPzvfDTkTpT6hqEBLd1GV2Xz2K56QyzfplQNGhHGpqVbdw+uaoIkgvcMh0nW8IpgpOHw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR12MB7333 X-Rspamd-Queue-Id: A1335C000E X-Stat-Signature: f5m18qup7pxxptee6e8z496d9tq8fy3a X-Rspamd-Server: rspam08 X-Rspam-User: X-HE-Tag: 1737611722-231172 X-HE-Meta: U2FsdGVkX1/W2wkh7JIQjlssVX3PLzUVBAowDMegpRZKOBEk5105aiheuePDR5s8FN8lJWIB32ytBphy4F6iprYqcJGdaK8Gv8BC5CgyJeLNhVWR3hXrtNCICqd4it7m2Nxa5t7Ch7Q7u4nXgfmdzZ0RsWa4jbGj5ShGnEhSYHzWgprxFwvzLz1P6YY66KJCDjGeIf3zfVemOoDBBbldzdgU9AkyUWGVCon4RWDkDIiCSpvJ5oaQNdTOkis/yw0WNxGmIY0p+UCkhzFUJWAJCL/PP1eAmE2QmSKdd2vY218Y809NkxgtdIhb8Ksn6iJH/5/0DQGutsHh7l70k1eBhmiZxLsg1GHuKsUZpE2J6mTxPo4WFWY8EYv+wfjwh5l5+n2BWRTLt82g6tzSKcLfPfmhWf6XO9uw3DNTtaGhUIcLlrx9druIzehg07Ye6FHmZ/tMZM+C7EK1eYD3AkespbJYTyRhLxFEo2xgbO3kVR2kBfvhT0QQidDVfnoJ1ghfZ/z3c6SQf4XMq1GKmEjhS9l8ECnY5SE9/vWNL6fesneLXWLo2xhPlAUl03sxAMg0lKUA8kG2ylWPb6pjuleVz47cbz3IebISvNH6QJFGXzGRjNeFuq/7Grleg+44jBt8rIffNbmN3Kdr52VHBHHgltYPVsjpJNxRapvgEN9BDZ2k4P+8IqHibvIBnnXQWP2u+CIwPSrQywwIEuxFqVDagwenOZEU4Aav/WTT2qbHUuSilvjaQXS1GCo7K2zKLQfruHYLngGlz7gH5nTvE2ZG/Cno5CqOM3ChESXMKB4a1g4Qur0cYRHIO6+nL6yvakd5yq9yyOAATEP3qIWLJSFBlp/f1R2t8+eCwHhddDqhvhqK9E3eWaXw0hq/VcXhPTURh72Wzh8+J0iJcQFnfGvAEPxqmZGGuonTLYzCtrR06jQKwNzt91eC7YgpkAxU6d+tkxGAOC/tIAigz7DM0O0 1+Wz9c8O Us6Pag2kYY86N4Eaal6RGUrth3JILeyZDUpHxJ428fkL18VbK/5U52EZrNzdnpxrJ9WDzzdIYFHszaOU6okbpfKFpQxwZgzEClWAt8SZndVnk4oaqbbdoPPV5v/lXtEZWEned3tj6MeAG3wQ6nbic58UY/keuMR8vqvwttt70fHlPYPfSytNYDOVbGXMHE3YNe0RoYC0zsFdarSLiiTG/TKoD/zjg3Y+Kj0w2j85+priiDxCAM7HPPxdegYm6KYq8VttIvkaGUPF7d/dVko9e8iHaKOyWr5GVXHhHcvebMmP5KAnCo7p/5/IAN/7eF07ktCldxiOyQ0VNI9+eihFFolDJHFIOWj98wHUpYP7D2TpHzc00gUx2WL5xkn42BUVLt9TfXdFva491+L/I78zhijQOhCwdcGCPOgIaA1xVxme+pm3cFgahqrjVM1JcXIyj2VgtRcSmG5ai7dqdNssVCEdMkDob/a3FF1Bc8khwbiuLKwvZb1AsM3rmAxGpp1XFKPmjC1MDl5bJlRAtHj2v99E0ew== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000204, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hi all, Zi Yan and I would like to propose the topic: Enhancements to Page Migration with Multi-threading and Batch Offloading to DMA. Page migration is a critical operation in NUMA systems that can incur significant overheads, affecting memory management performance across various workloads. For example, copying folios between DRAM NUMA nodes can take ~25% of the total migration cost for migrating 256MB of data. Modern systems are equipped with powerful DMA engines for bulk data copying, GPUs, and high CPU core counts. Leveraging these hardware capabilities becomes essential for systems where frequent page promotion and demotion occur - from large-scale tiered-memory systems with CXL nodes to CPU-GPU coherent system with GPU memory exposed as NUMA nodes. Existing page migration performs sequential page copying, underutilizing modern CPU architectures and high-bandwidth memory subsystems. We have proposed and posted RFCs to enhance page migration through three key techniques: 1. Batching migration operations for bulk copying data [1] 2. Multi-threaded folio copying [2] 3. DMA offloading to hardware accelerators [1] By employing batching and multi-threaded folio copying, we are able to achieve significant improvements in page migration throughput for large pages. Discussion points: 1. Performance: a. Policy decision for DMA and CPU selection b. Platform-specific scheduling of folio-copy worker threads for better bandwidth utilization c. Using Non-temporal instructions for CPU-based memcpy d. Upscaling/downscaling worker threads based on migration size, CPU availability (system load), bandwidth saturation, etc. 2. Interface requirements with DMA hardware: a. Standardizing APIs for DMA drivers and support for different DMA drivers b. Enhancing DMA drivers for bulk copying (e.g., SDXi Engine) 3. Resources Accounting: a. CPU cgroups accounting and fairness [3] b. Who bears migration cost? - (Migration cost attribution) References: [1] https://lore.kernel.org/all/20240614221525.19170-1-shivankg@amd.com [2] https://lore.kernel.org/all/20250103172419.4148674-1-ziy@nvidia.com [3] https://lore.kernel.org/all/CAHbLzkpoKP0fVZP5b10wdzAMDLWysDy7oH0qaUssiUXj80R6bw@mail.gmail.com Best Regards, Shivank