From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 80968C35FFC for ; Tue, 25 Mar 2025 08:19:08 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id F1430280002; Tue, 25 Mar 2025 04:19:06 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E9A9E280001; Tue, 25 Mar 2025 04:19:06 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id CEE24280002; Tue, 25 Mar 2025 04:19:06 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id AEB47280001 for ; Tue, 25 Mar 2025 04:19:06 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 55E6681A1F for ; Tue, 25 Mar 2025 08:19:07 +0000 (UTC) X-FDA: 83259373134.19.0A806D7 Received: from NAM04-BN8-obe.outbound.protection.outlook.com (mail-bn8nam04on2050.outbound.protection.outlook.com [40.107.100.50]) by imf05.hostedemail.com (Postfix) with ESMTP id 57FE1100007 for ; Tue, 25 Mar 2025 08:19:04 +0000 (UTC) Authentication-Results: imf05.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=1SkOXbqH; dmarc=pass (policy=quarantine) header.from=amd.com; spf=pass (imf05.hostedemail.com: domain of bharata@amd.com designates 40.107.100.50 as permitted sender) smtp.mailfrom=bharata@amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1742890744; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=WS4zD5SUO0vgeUE68xkbIh672reDzoC7iykbswdmRnY=; b=kVz3o0yQaIskTEjbRohC84AcU4Ay+1dDfl465MCkMyHewNpUMEhbgWNdUlRP6X3gMS3QDK yzWidI+N5cnJf6qmwuKlOXqJkQZuLDVHgZkt0rX45fe37z6t/LH88XlGUc1+Bc24vdifQu /COU4P2A57CHliBnIKtvQuDVAIIEZBM= ARC-Authentication-Results: i=2; imf05.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=1SkOXbqH; dmarc=pass (policy=quarantine) header.from=amd.com; spf=pass (imf05.hostedemail.com: domain of bharata@amd.com designates 40.107.100.50 as permitted sender) smtp.mailfrom=bharata@amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1") ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1742890744; a=rsa-sha256; cv=pass; b=eNs3dpXpRd75jOhRTO2wDM0aFkCtUGtbmvgsfPoDULPCw7pCZiFoiwojAYw6zvf/3WHEuq o1nyrqcaS40MKxoo1egCKWH9XHHIxelHytAMUJ1dCN1iJEM5+zVQFsGtWq/h+vLurDf7WV VVWcKCFdgPd3aoiN3Yl+vMlLmW9hz50= ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=FfeNfH1mK44AWVy0/yaeXDgYvQvD0PQ5GvddDYFIRJWa3qELr1JcVv8ijnTRmZLYAyvRnkZW0TSqE+jYPsDSBWH1EpblT0rDZia8dYj+lr4vJDirNr+JebyRqyK/1nA+LpllL2G8s3yAGUX/r78ToAtbw1UzXS856BaYe30uZMsWvLisclnAM3WwyyK0/5AgV7uhILAxUsek081eAt7sTjK4xLgHGFHY8CeKzbbubPObmgtA+igyaurIRW7cnLZEtoGRTXi0eAA811/iWN4nFmeidhtxnWXxwPN8VUjev0vipr0YRQIrJPqj3Fwv/B98Ri1DBJBJ0m5HbP7p8UWw8Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=WS4zD5SUO0vgeUE68xkbIh672reDzoC7iykbswdmRnY=; b=RpY347KhXESUvUtLhP8PCZdAcyzt2EMVuBZhgqdF4nDGhLPOrjhJRNFpLCLUEEFvzc5dwzkOPN6tA9XjrSq7SWuy7UGUqVBaY+pchHLtNBf65h54Io2ePepozlNHue11ym2L1Zd/B7WNkoYlONBnAi/gPyG0mR9zorLrZbCjD9mlZpVd5XezZHXjVjfb66HfcRNXbI2Zcm3X+Vh5tClCl2KoM+LGiqlsowlYknyuYHvP9GGFJ4VHuwL68vF+hODYzlL0Z/mgwpUp6ajhbq5X2HMHKueS3118COXWhd8fkFWh5EZJMV4TelYdRkUhcWFWycBz40S+9Rs8conv9Rbajw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=arm.com smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=WS4zD5SUO0vgeUE68xkbIh672reDzoC7iykbswdmRnY=; b=1SkOXbqHkfNPF35FSLJRO3pvHs7kO6ONmZkRrmvzDtlvTanaBcnkzSYcgFb7q3uDp4amQRmNA7+mqwZjHn1KXCHVZWn9apa1fsnt7Xzc8AzKyZT854CrSmSJOTL9pkDzvwz1tfyXN/OLDb64T7z6N2pHsEHRSt/19TOAnEESKQs= Received: from CH5PR04CA0023.namprd04.prod.outlook.com (2603:10b6:610:1f4::23) by SN7PR12MB7810.namprd12.prod.outlook.com (2603:10b6:806:34c::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8534.42; Tue, 25 Mar 2025 08:18:59 +0000 Received: from CH2PEPF000000A0.namprd02.prod.outlook.com (2603:10b6:610:1f4:cafe::69) by CH5PR04CA0023.outlook.office365.com (2603:10b6:610:1f4::23) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.8534.38 via Frontend Transport; Tue, 25 Mar 2025 08:18:59 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=SATLEXMB04.amd.com; pr=C Received: from SATLEXMB04.amd.com (165.204.84.17) by CH2PEPF000000A0.mail.protection.outlook.com (10.167.244.26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.8534.20 via Frontend Transport; Tue, 25 Mar 2025 08:18:59 +0000 Received: from BLR-L-BHARARAO.amd.com (10.180.168.240) by SATLEXMB04.amd.com (10.181.40.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Tue, 25 Mar 2025 03:18:49 -0500 From: Bharata B Rao To: CC: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , Subject: Re: [RFC PATCH 0/4] Kernel daemon for detecting and promoting hot pages Date: Tue, 25 Mar 2025 13:48:32 +0530 Message-ID: <20250325081832.209140-1-bharata@amd.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20250306054532.221138-1-bharata@amd.com> References: <20250306054532.221138-1-bharata@amd.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-Originating-IP: [10.180.168.240] X-ClientProxiedBy: SATLEXMB04.amd.com (10.181.40.145) To SATLEXMB04.amd.com (10.181.40.145) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH2PEPF000000A0:EE_|SN7PR12MB7810:EE_ X-MS-Office365-Filtering-Correlation-Id: 5bb88b75-c323-471e-f4af-08dd6b75b1ab X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|376014|82310400026|1800799024|7416014|36860700013; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?dcE/Q4Qos7ADtkER1uqR2rstwJmPgDBKKbcxrkab4E5XA9/OX11IiU1XaqBa?= =?us-ascii?Q?Bye6etf2BCw22DrrUDJmw/VCNKok1Z+UU1t8olsDFl0MfZkXHKBDvPzaY+T4?= =?us-ascii?Q?2ZZ0xTmtpgkM7G25C4s5o7AQkW8mjivelSK88hH5amLvpjft19FnSuZQsFN+?= =?us-ascii?Q?AFhp5YDkiR3d/59yDV28aw7bk471HCXag4gfuRjlEvHFCmx1rts30JkbrCbB?= =?us-ascii?Q?+8ha+1Wz941f0Nt7wywpEJfMT4cp2MGIMlKpFTEIw5DV1f8DfCCGBTQuLym6?= =?us-ascii?Q?MPp+4Su3MAZpmhHysDhLchqIodXyboI+wsukYrbcNtz5BQcxh6Ls35YLmkFy?= =?us-ascii?Q?lIrVIGzh+21zfwjqVHeJ3iC6wU3QpAwoB/4vGrNxh4NPoXUwxgP8GJyCOKOX?= =?us-ascii?Q?p7uGs9dHOGXG1IX1Y85cMMjflR3sgZ55E2ARdoEaK36dEvZM1XTUmm8i6zrx?= =?us-ascii?Q?sr2/bHWQtYkc9zQOM0CZEKws54Pi2OCPiqVKVvGT54cIHpD6P34y9zeSvatq?= =?us-ascii?Q?sjZc4Vvv3P68aJQKOn73psKXCVXrRD3XviBg6U+aD1wYm6aE4NS7oeK0YUw7?= =?us-ascii?Q?uIqKdHOc+NyAS3pvIfPfqarVTDDvDt6zUNJhSVDPNt4AONsUUeaaVrip3LbS?= =?us-ascii?Q?YPQDGhk58UMjT8bzRpLdTBKS5mXpk2cE+hHZt2tZOWw1qYcCoqPZ6cJsIt4X?= =?us-ascii?Q?i8lDWqCOu5i2zKMqI7f6lj8ah2yy03i26RxbqF/pN3ceh6jXz3E52KSSV+3W?= =?us-ascii?Q?KFpnjthBrbV4zInbDc4Hh6Paa3n05M7/KLoee1baPQH2j1eII1b67ezrPtmp?= =?us-ascii?Q?xjkRZaczVh3P+v5B8knxqAsGBEa6C0cUuk73ecZypsCdU7H8EjHrPesfx07C?= =?us-ascii?Q?dnMzIZbQU3fbdRgERmKxLmd3yRK8Bg+7+K0yIR5FBFCLHTmV9lSVUuTZQGRO?= =?us-ascii?Q?I9bM6DoxE3KxT++uUavxA1K+/AEyV/XlJapt9dnRlcHK/eV9XXsFDgx5wtjF?= =?us-ascii?Q?uM/s+nO8i0Rq+/ezzmw3sTN+KyAhze4rv4Iaj4sUxdIJBJ3TWrZlUmflPBKm?= =?us-ascii?Q?/vBIyBlKfpjrumVjjOP72PJZEf4Papoa3Kxl8yMxvOgJyiNUFREvIvL6MaQi?= =?us-ascii?Q?NBVlrCGyBYhJzy1bSAF6jbWtYV84S13D6+xDX2NXLLNFLOYVp7NRvLvmzARq?= =?us-ascii?Q?8yhPzmhXIycUksfm2Mw+ZoucPU/NzsNDUmOr1odhSaUpw2p6NRVgYKrF5amF?= =?us-ascii?Q?1HCA2QlhA8KRPfnLb3jYxDRvIFaZezSKy9t4YJir21YPjIZQ4DG4L4KfO9Sm?= =?us-ascii?Q?9dy5rw085rrzq/62sgNVLEqWKpuEjGeLb2vFd35TlB77B4+prFNXKOuqxfwP?= =?us-ascii?Q?g085EFvJPqXyJEwf7VwqWK60M/iu9EvUGy8ao7n75/uqRpBw7nIUwiUn3N/R?= =?us-ascii?Q?yfVdPt55yDR4OgJggMgfGNwbwCLVejafb7/V8FfqLibuRxNMHku8pQVlb0io?= =?us-ascii?Q?fSD/q7ofAVNvRiw=3D?= X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:SATLEXMB04.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(376014)(82310400026)(1800799024)(7416014)(36860700013);DIR:OUT;SFP:1101; X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 25 Mar 2025 08:18:59.2035 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 5bb88b75-c323-471e-f4af-08dd6b75b1ab X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[SATLEXMB04.amd.com] X-MS-Exchange-CrossTenant-AuthSource: CH2PEPF000000A0.namprd02.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR12MB7810 X-Rspamd-Server: rspam01 X-Stat-Signature: juubpmhcncd3wi89g3oy8ddmdw3dwrtn X-Rspam-User: X-Rspamd-Queue-Id: 57FE1100007 X-HE-Tag: 1742890744-681494 X-HE-Meta: U2FsdGVkX18oYk2/WKI17vtD3+4qreflolkrdcTmnAkAJ7593L9IaJ0iOPEoFT6YQJTo0+/TWFM2P3NkiaqAsry7nuYL2uiIQWRYO7PxJSLKDQPDOpuihROLDYX1WC+IzEt6AHGruNm8oTBq+J8dYYG6OLcGj6bovxsspMjrnUIhmXmPcR3VZ+VMY3+sOL5XRl7GtNm2pn0kogQmgqolEQIYd4MbdQuTM2Zl5L+t3SxbSCDQS16c7DbDcTXzxgrHPzBWeIq/80M5OmlYDz8vOC0nhoXW215cch4GohAS2ywn0UiFq3K0JWrbB3/brLwzudCoIeg3gXJRdsmt0gAHOtYaiW6MoCHHVhtV1FnBRqBSq14zyrGzRO9LXXkpq34ffzyx8QfPjcUH07HbYBR0nD76cS920qfkmlMKEJJ58ryTHZOECzDhU75evpnl9QFHhH7hUUaVWcLQtyH7Ftz0bv1B4RSqDwcmUIbaCGpbKem6nCZwi891ZDeS87N0btN9/UDdBH96ptIAnxG6dPPkbIgaFzgqTicPsEodFMaPPfSJCU8ipvpTdOZ1br4mPHdLmp5jvSytsRRcQ2eCG/X4jMQ1UwXw/j+UoRRVRb4SexhURcGGYrJH1hHp8OU0hUtazJl71QJ75NxNMFepgGHrusIfdOCugKYUDE+41yk8tZoh8k96BQPbM3qCPEVTP1mk69MsGcOzGwuHDv8muVmjW4YRIiMCNphOwFfOtCNsT8UpVcLmbSVpzzHKTPoYLjbOpQge9R2O1EzaZPMAZ5ne6yhbR33sMsGsJMwzaHagnfnwSMpE0PhnY0q5mL/c/+ZZ18C3Xbgi0/IDBn+yvfAQ9KKxX0BZ0oS0B1vvtR38gTslirEJR/ZTR9h/cjwjLiT3a92sxQ8SIBLDfyJhllG1DatlttlIhA1BIXilABPxlAR0ZmmW1OtTRRn0zfkfhQ9QvX3Y13tkXs6XeW839T1 QYLn8f14 AjNVoGlqaGA/GbIwxvC1GgsVa1XZ5wL24ApTx0LMsSg7pjselCP3zUCtCfmoPD9/VFzBElRPJUDMijeiWCiukUjbkTwrCQJCD0Om1pI8c17r5J0JB3iFRORyV/A8u+1BaPiLIHsu4VYJsIRbbtfBB5PbEMKJwcOKZ5RnEAoKMHeOTmYF1Jl9mRoPSjQWHfZCYl66RPwBbPlu7pBz8rIPWZ9v3uzuV/atmuzkK0nfTpe7M9dCPAS1tq1PILhkSgR0+/Cib1ZaujQ0UbMpai+bEiC45+oYe8icxbjeG9i++9UF1foBMqs9tB206hH+upYaowSM7f2k9IjRQU54zfBI9fs27SNXYI1zgPRWxWa0dNiTw1G52U/CYibbZUEp6C2Zm5A46rCYQ+EddWQRteyiTbHaQweQMHtfCW+is3fgYBZc1s5P/6nxdy06Q1RuoGdTFPOImZmnPlhjff2mwpsFj3VDVcOdXPm7y6nB0c00ORT9bU6z2uXCfqfcxESHbc+6xjIepEBjdJkaFquPVvd502UthXNNQcPxCs6GSHxY3wXkbhYr/xorDgt1Wxda+jTQS5wD6A2MgSoOP2OJ13aKqCZR8EaOj0j1rB+Qgs6d00QaH5C7/si3Ia/t2lQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: > Hi, > > This is an attempt towards having a single subsystem that accumulates > hot page information from lower memory tiers and does hot page > promotion. > > At the heart of this subsystem is a kernel daemon named kpromoted that > does the following: > > 1. Exposes an API that other subsystems which detect/generate memory > access information can use to inform the daemon about memory > accesses from lower memory tiers. > 2. Maintains the list of hot pages and attempts to promote them to > toptiers. > > Currently I have added AMD IBS driver as one source that provides > page access information as an example. This driver feeds info to > krpromoted in this RFC patchset. FWIW, here are some numbers from krpomoted driven hotpage promotion with IBS as the hotness source: Test 1 ====== Memory allocated on DRAM and CXL nodes explicitly and no demotion activity is seen. Benchmark details ----------------- * Memory is allocated initially on DRAM and CXL nodes separately. * Two threads: One accessing DRAM-allocated and other CXL-allocated memory. * Divides memory area into regions and accesses pages within the region randomly and repetitively. In the test config shown below, the allocated memory is divided into regions of 1GB size and each such region is repetitively (512 times) accessed with 21474836480 random accesses in each repetition). * Benchmark score is time taken for accesses to complete, lower is better * Data accesses from CXL node are expected to trigger promotion * Test system has 2 DRAM nodes (128G each) and a CXL node (128G) kernel.numa_balancing 2 for base, 0 for kpromoted demotion true Threads run on Node 1 Memory allocated on Node 1(DRAM) and Node 2(CXL) Initial allocation ratio 75% on DRAM Allocated memory size 160G (mmap, MAP_POPULATE) Initial memory on DRAM node 120G Initial memory on CXL node 40G Hot region size 1G Acccess pattern random Access granularity 4K Load/store ratio 50% loads + 50% stores Number of accesses 21474836480 Nr access repetitions 512 Benchmark completion time ------------------------- Base, NUMAB=2 261s kpromoted-ibs, NUMAB=0 281s Stats comparision ----------------- Base,NUMAB=2 kpromoted-IBS,NUMAB=0 pgdemote_kswapd 0 0 pgdemote_direct 0 0 numa_pte_updates 10485760 0 numa_hint_faults 4427809 0 numa_pages_migrated 388229 374765 kpromoted_recorded_accesses 1651130 /* nr accesses reported to kpromoted */ kpromoted_recorded_hwhints 1651130 /* nr accesses coming from IBS */ kpromoted_record_toptier 1269697 /* nr accesses from toptier/DRAM */ kpromoted_record_added 378090 /* nr accesses considered for promotion */ kpromoted_mig_promoted 374765 /* nr pages promoted */ hwhint_nr_events 1674227 /* nr events reported by IBS */ hwhint_dram_accesses 1269626 /* nr DRAM accesses reported by IBS */ hwhint_cxl_accesses 381435 /* nr Extmem (CXL) accesses reported by IBS */ hwhint_useful_samples 1651110 /* nr actionable samples as per IBS driver */ Test 2 ====== Memory is allocated with DRAM and CXL nodes in the affinity mask with MPOL_BIND + MPOL_F_NUMA_BALANCING. Benchmark details ----------------- * Initially, memory allocated spreads over from DRAM to CXL, involves demotion * Single thread accesses the memory * Divides memory area into regions and accesses pages within the region randomly and repetitively. In the test config shown below, the allocated memory is divided into regions of 1GB size and each such region is repetitively (512 times) accessed with 21474836480 random accesses in each repetition). * Benchmark score is time taken for accesses to complete, lower is better * Data accesses from CXL node are expected to trigger promotion * Test system has 2 DRAM nodes (128G each) and a CXL node (128G) kernel.numa_balancing 2 for base, 0 for kpromoted demotion true Threads run on Node 1 Memory allocated on Node 1(DRAM) and Node 2(CXL) Allocated memory size 192G (mmap, MAP_POPULATE) Hot region size 1G Acccess pattern random Access granularity 4K Load/store ratio 50% loads + 50% stores Number of accesses 21474836480 Nr access repetitions 512 Benchmark completion time ------------------------- Base, NUMAB=2 628s kpromoted-ibs, NUMAB=0 626s Stats comparision ----------------- Base,NUMAB=2 kpromoted-IBS,NUMAB=0 pgdemote_kswapd 73187 2196028 pgdemote_direct 0 0 numa_pte_updates 27511631 0 numa_hint_faults 10010852 0 numa_pages_migrated 14 611177 /* such low number of promotions is unexecpted in Base, Need to recheck */ kpromoted_recorded_accesses 1883570 kpromoted_recorded_hwhints 1883570 kpromoted_record_toptier 1262088 kpromoted_record_added 616273 kpromoted_mig_promoted 611077 hwhint_nr_events 1904619 hwhint_dram_accesses 1261758 hwhint_cxl_accesses 621428 hwhint_useful_samples 1883543