From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 25227C28B20 for ; Wed, 2 Apr 2025 17:35:38 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 05372280003; Wed, 2 Apr 2025 13:35:36 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 0024B280001; Wed, 2 Apr 2025 13:35:35 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id DE5AB280003; Wed, 2 Apr 2025 13:35:35 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id C3921280001 for ; Wed, 2 Apr 2025 13:35:35 -0400 (EDT) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id AD7291A0542 for ; Wed, 2 Apr 2025 17:35:36 +0000 (UTC) X-FDA: 83289805872.11.CBC1223 Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2061.outbound.protection.outlook.com [40.107.92.61]) by imf09.hostedemail.com (Postfix) with ESMTP id 90AF2140012 for ; Wed, 2 Apr 2025 17:35:33 +0000 (UTC) Authentication-Results: imf09.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=QyP3mGZi; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); spf=pass (imf09.hostedemail.com: domain of KPrateek.Nayak@amd.com designates 40.107.92.61 as permitted sender) smtp.mailfrom=KPrateek.Nayak@amd.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1743615333; a=rsa-sha256; cv=pass; b=kFMm8qNXLsB8/51Otow1feq3gL87pnjYGZ7Yuy/bpMciPt55xcQEpumND1DyqP9R0+UswZ o+tR+E4x7na9rvgPxbXW/IuhZC1NX23ZptA3WnUUq4Kzmk6Bt73Zzs7RMMFivQ++iDUNZE VIrATh+P0F+Z2KkyRPPRmNy6LDAUWBs= ARC-Authentication-Results: i=2; imf09.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=QyP3mGZi; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); spf=pass (imf09.hostedemail.com: domain of KPrateek.Nayak@amd.com designates 40.107.92.61 as permitted sender) smtp.mailfrom=KPrateek.Nayak@amd.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1743615333; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=vmXY18Upu2d1wVnFSG7sxALYlzsmPYjS8PnWoV3KTjQ=; b=lFRitYwxFezONGVBNh7v9WGg4fchnWXxN5kuuhOXJWRju4qlyKk0kAgLG+9cy5vp7wBNex 24t963XbtaZX+Oti9OM4yBbcOqMTKg2xgX8Di4nx/jFlljcvBCqwKPA0jQi4brrHkFM2c/ 06pDW7FeJzO6keTTzzIi4B0+E8z/Rzw= ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=anduuUrwF4oPra0CM20YLTyK/P+y7Eosw7KKTgG+n34L41OJ/Rw5lEkHMYkKx+o0nHn6F22yjNirBWxzapULUm/RL+hWeUqRe9ShmJrg9V4bcB5Ou1FU4FrzMj/DWvC5IDn9Gb6EzKMlRJAP6wZvK16WuhSO+HLYr4VfRRsZaYcdL9OhpIz1bHt1aMmVrFpQT87CyFPII029O8I6g7R3pzYd3FFmQHJxbYC478un27vCmf2HhxMExSPHnkC9HUSkhe3gauuHKEGLXf9+s6fcOQVahaILr1xgCl/scer2gcA3tajVWdAUpo1vfBe7CcQ/ONpdqNzya3Ge5Ib4CEkmcQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=vmXY18Upu2d1wVnFSG7sxALYlzsmPYjS8PnWoV3KTjQ=; b=jKNHeYvD2rQe2F2tzLmLkT4i3PLzR14VmoDMC30fNYsD8VBUpXMjN4hjhz6+FbqyX8VTiZ9SXqDZP0maEvzSiy+L03LnkwRnk+Bb4Upp6NEwklUganQaMT5KarURzeqrAcOyToYmnM6PaeFfgABdZeE4RnfvQPgHNuRCdMiOMmx5TogWYFkrTWCTvCmof5syYOd1tYp2pa94dhbZ4m0IjmcEsdbZ+tH43ngpyYZBEC7vjtkz/g/x7ng/pVyQSsYqAwfZShBLG8Fm7LGfdN3GCfcXOWwpbpSyC47ADv1n5ruUAXnyoPYScCsetabr+0c2uJo/clkOoyYE+1GV4oQ+hg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=intel.com smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vmXY18Upu2d1wVnFSG7sxALYlzsmPYjS8PnWoV3KTjQ=; b=QyP3mGZiSEG13Z+lCaf5msL2/etYYwOmYoMkNW80FL7/PxzKotvmirHhpgcS2/KB1M7raM/9ZZ6WSe5Iji9lMjp3ab2CMyVjK0ITGmGcGi5ZZL2tbvVyOLBa1gMMGp1f1XgYZ/TnzhGNYVfFFQuSI6KDA7xWWoorp3MXR77+jdA= Received: from BN9PR03CA0472.namprd03.prod.outlook.com (2603:10b6:408:139::27) by SN7PR12MB7155.namprd12.prod.outlook.com (2603:10b6:806:2a6::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8534.44; Wed, 2 Apr 2025 17:35:30 +0000 Received: from MN1PEPF0000ECD7.namprd02.prod.outlook.com (2603:10b6:408:139:cafe::5d) by BN9PR03CA0472.outlook.office365.com (2603:10b6:408:139::27) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.8534.54 via Frontend Transport; Wed, 2 Apr 2025 17:35:29 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=SATLEXMB04.amd.com; pr=C Received: from SATLEXMB04.amd.com (165.204.84.17) by MN1PEPF0000ECD7.mail.protection.outlook.com (10.167.242.136) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.8606.22 via Frontend Transport; Wed, 2 Apr 2025 17:35:29 +0000 Received: from [172.31.188.187] (10.180.168.240) by SATLEXMB04.amd.com (10.181.40.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Wed, 2 Apr 2025 12:35:23 -0500 Message-ID: Date: Wed, 2 Apr 2025 23:05:16 +0530 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH] sched/numa: Add statistics of numa balance task migration and swap To: Chen Yu , Peter Zijlstra , "Ingo Molnar" , Juri Lelli , "Vincent Guittot" , Mel Gorman , "Johannes Weiner" , Michal Hocko , Roman Gushchin , Shakeel Butt , "Muchun Song" , Andrew Morton CC: Tim Chen , Aubrey Li , "Rik van Riel" , Raghavendra K T , "Baolin Wang" , Xunlei Pang , , , , Chen Yu References: <20250402010611.3204674-1-yu.c.chen@intel.com> Content-Language: en-US From: K Prateek Nayak In-Reply-To: <20250402010611.3204674-1-yu.c.chen@intel.com> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.180.168.240] X-ClientProxiedBy: SATLEXMB04.amd.com (10.181.40.145) To SATLEXMB04.amd.com (10.181.40.145) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: MN1PEPF0000ECD7:EE_|SN7PR12MB7155:EE_ X-MS-Office365-Filtering-Correlation-Id: 87444780-b839-43d7-bdf4-08dd720cc2e2 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|82310400026|1800799024|7416014|376014|36860700013|921020|7053199007; X-Microsoft-Antispam-Message-Info: =?utf-8?B?Q25tR25NL0haWDVVTU1GZ0crZnN6cHpQb3pvRDVTM3JzdzY0YzRBTENVNHRy?= =?utf-8?B?eU1GRlpOM1prZHptWjRYOVRiTnRnSkxKdUM3ZWd3TlF2MzBrQktEc2daLzda?= =?utf-8?B?eGcyb0IvVVUvNGF3c0ZlV1QydlZCdHpzVjhlL3lWV2o4dVpTcW93cFBsb1BN?= =?utf-8?B?WGExNUkvdUt0SWJxdDNmQWZoY2xuMVRQQktjWWZoQ2xqcUVRUjVaQUdLZm4w?= =?utf-8?B?MzZWTUovSjJZZlhUaEdMVlB3Z1pBSENseWxhakFmU0FiU3pRYXg0U0g4T2wx?= =?utf-8?B?MHd3MjRTcE9JanBZaitmcVBORVgydjd6Umd3cWVKbURDR1JkRndwUDBST1dl?= =?utf-8?B?TjAwTlQ2MGlQa09WbERSeExzNVhOSjBYNUNKYTQ0T0dpNk1mMGdNY09xZjZ1?= =?utf-8?B?VVlRdGpPc205bXl6UitFOHRvTDFIRkU2N0lURUlXS3pseDNtVW5GcXBidkxC?= =?utf-8?B?SDhQTGUvRTgxMGRhbHNmK0swUlo4OGx3N0dta0MvTmNuK2ZtR3hiQ3c2OVFo?= =?utf-8?B?Uzd3RzdLa3EyWlp5WGt3VEMvTUw5MktFZ0NqaWpucjVucm1pc2FTYUhwTEs2?= =?utf-8?B?RTg1NEdSc000Z0NHTlFkak4veXZIZDU1ekRIT2dUMmppZGVvMk44cW9QTU14?= =?utf-8?B?bm5GcDNaUVFWN0JDWG43dzJ1cDdQa21WakVJdkpyUnJYQVc5ckgxMVJ0aGpR?= =?utf-8?B?UVFOUmZZbHRtbmNVblMxbmV2bnJ0VU14VS9XbFFvYkEvd2p6bU4vSUxIbG94?= =?utf-8?B?VEtxM1U5UTNpQ0JOWWxXNkNoeFhFZk1LNVJSdXZhMWJHNVR6SytmTFNkeFFy?= =?utf-8?B?MnpsanJVdy9LeFYwTGQ0a055RENQeUtLZ3pCeEZQMG1lLzFRZWtWNTV2amFt?= =?utf-8?B?S1prVlk4STF1bmlxWEJaZmRyQjhyOXNoMzB2TVBER3V3bTRDTDZtMXJFbmM5?= =?utf-8?B?b0dONk4wWVN1ZzgzZ2xsMmE4Mk1UcVB0TlU0amVLNW9jZzZLbjdiOHJTSmFT?= =?utf-8?B?aU83c2Z5OEZkZUU0SXBDTmNJNU1Kblk4U3ErMit0dHlJTlNocG9RK0RENkxT?= =?utf-8?B?aEtWZHk3eUlNNThiUWlDL2VxNys4MmRRNmh2Z3graGd0QkJxWHZQeWw2dWtq?= =?utf-8?B?a2RQKzRoNnVCeStDaXQ5YUsvNHhiaUUrTG9DSDErd3Z5TzBCNk9kZmFibEpB?= =?utf-8?B?VW5wZmxlcjJiSElpdHptYmdUaERpdkNiZ3lLZkRtNHYxVE1NKzNKTTVTaThy?= =?utf-8?B?cnZWUTZ0U1J4VW05eHhNTlNCTVhlbk9KdU9XSGxHcmtYc0ZRZXV6ejVrMnpq?= =?utf-8?B?amNJUGtqS0hIT2VCdTFGdnErbURpUlhUY09NdjVwd21qd0ZWUGQyMzY0QUx0?= =?utf-8?B?OXpKV2ZWZFhZSEZYVnZOdlNoZGd4OGg5Z1JFUDlxckR5eHhBRy8zMEdvdUpF?= =?utf-8?B?ZXZYaUJyYmk0QkRrOXErclhoRzJPejIzbEFma3RmUStyeUUzOUxrT2dnMjhz?= =?utf-8?B?K2xwVlo5ekhjRTdObTVDUXJoaXhPc1NYWC9VeGNoY3pUTDYzbThESEs0N3F6?= =?utf-8?B?K2hSQUZpZjhXM21qenN0OWJvbXM5dTBnN0ZLTUw1bUhSb2ZnRDdXZkpRbVRy?= =?utf-8?B?b25PYnFWNmw5a2lrdUlYWUVvelFKWkJGcnFsSENBWCt3NldtYUdQU2NJaUFM?= =?utf-8?B?aFNENnBVMlBpVGVydnZhdHZDbFV5QVdxMk95bVZoNEZ0RjcxYkVmM2JBZENv?= =?utf-8?B?YzYySFlDMXhDc1JJa0Z0SDgyVlhwSVZKYzBBa1RTN1U1c080THFSNWxlNEFh?= =?utf-8?B?V0xBOGdoKy8wSnBMbnIwS1VLd2V1ZzUvbGNiVDZaU1FzR1RMLytydFdlVUdQ?= =?utf-8?B?VDZzdEE2SXl6SEpXWmxRY2trL01rRXVRaWhtWDMraXpCVHE0MHlTMVhlTXpM?= =?utf-8?B?eVBoYVVMNWtCTWFmcS9YeWdFWjFSRFZ4dnNvdEhWOGNLTW5URmtuUWRVWVFB?= =?utf-8?B?SnVDcENLd0ZGSGdkbkkwM1NVektzTDJoc3RIRDVGdWlhQmdpaXl1TDF1MVh4?= =?utf-8?Q?CRYo/s?= X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:SATLEXMB04.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(82310400026)(1800799024)(7416014)(376014)(36860700013)(921020)(7053199007);DIR:OUT;SFP:1101; X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Apr 2025 17:35:29.0823 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 87444780-b839-43d7-bdf4-08dd720cc2e2 X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[SATLEXMB04.amd.com] X-MS-Exchange-CrossTenant-AuthSource: MN1PEPF0000ECD7.namprd02.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR12MB7155 X-Rspam-User: X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: 90AF2140012 X-Stat-Signature: t9y7q48k8qmqsku7jyhse3aw6w91jijf X-HE-Tag: 1743615333-627995 X-HE-Meta: U2FsdGVkX1+EhKPbgIKcnyoZyfOlgUd39JMfALPtWEM77GwSnXOfOcYPu8bmg8WpwAc0gaeoeSiHiRwjtsEgk1vvcrae2/36LlvdJOo7zzG/Lmp0Ind8Wu/fcPqZDMLjBQlXZZTUYrC9RbbaUl7zipv3RmvZvzDLkEd3s6u94N7gzcLOumLmHZkjU8DVKyQHwD537iTmCX6+TsRwRabrMHKnqzRV/uYG/jfQgWJXctEGIYP5XQrDeoPjtKI/oRDClStOELRRrLmpt7b3XJ0zN2Qa34HH5Jir34JKgmnBpTqMEx9fhEOIVUskLZDUySF/9/H6CGc/iDUNqYDRvMeur6J6KbF9MqIZrofwEGSqD0/FtSh8/BEk0xWlHsIMpQUcn/JOTdGbVLpHhWZXWoa4TDcDsijq/WghHFgzKpkipSXpVZSV9pSC9ynuzgvyc9qUkPAN8XpR+NkNmSzbhg7Ri8sVSK+MCbjZKyeGpCHbXkJFl7IHu4BJ7W5uPcuRDlyXbmTOZadbg424H6yDH0Q7F1Vpw/ohp/xA10HWAfqKTIYuFkizYl84yQTFDAIre/6+iZ83p2wNSIvrrBDyd91Ry6AIgItqVnSU3IxQnC5x26c13JNss5WYbx8xIY39aMNYajlilZjVsTpGjI36RscXIfFs7t6RiQ0BjFQJIJUU3CCF+w1qt7CxifdkIGuA8BebipCUKTp6r4XeTwqY4iD7HzpXT1XQDIg6UyAVT7DrZAA9nMwiONVaWoegfjhxlN3tknLAbavdsWexddTp+q3Fhpi93kLVKP4kl/zKm7VTDcwqqOZDiALNnNOotqBpa40FIM1GvmwFVHHief1JXVWUf+95kKPZtusUUHyGgZQsN4bAVQUro91l5eOGm9dYPkS3voQG7Rzu77UA62Y3ThCM7DHIaT7r/q9wz6DxE4MSaHnM8wlVx8Eru/7a8IlFWcUBhqnUrkd4CJ97K8JRiVL FECgGscu 4Wv0c8WqO5L8gZG/DqL519PwliODBIDZe74X5a6Q74s5ZeMzzTdHfmRXjMfOffbD6xpwOQL/tSiKOVA+5YrEm2OL41AXgZB86GgT52aMN9QsekkprgKN10SV5Ai3A//tjA8e/08mAr7i7W8LBAmr3hXpz+byk0XAnVfb5OWh7kWe5lkhNDtCixNm8uVr0mrgsHE8SwCxG2PtJdm1mPYMs+rmGrA0diYJMz2znKnHyeMa65wuEgkkncnSqFDSkIggXEhtsJG8RFWo7Ue0b9V5NUvD19F0w12QoC1coTIYfvI5oUSUljm0ma0rPu7FxSgZtTFIpROeVlHnEFAcjYtKYZF2Y51VrJqM4fufHiifO/dxIhs1ZFlVk9ZW/r3WTar+81SOwxLiLfXPQo93EM/lqesPFyDii/n9fcTr7co0tnF6OR03faOzGfiCVedGrVYyqQuQXWZPfoHpGaRLRXBF8AmfxIgleZx2B4KksnXkIUEJi6S2EL1Iu+reSjANiQFfkgTkVOuI3tfqDlGFlzFFuOtSSXxcz+BZ6pg1sIuwBXanaw71lWDUR4s+Jl42iPN2UbovmPi/MKryw7+UYLRG6dQZxLA== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hello Chenyu, On 4/2/2025 6:36 AM, Chen Yu wrote: > On system with NUMA balancing enabled, it is found that tracking > the task activities due to NUMA balancing is helpful. NUMA balancing > has two mechanisms for task migration: one is to migrate the task to > an idle CPU in its preferred node, the other is to swap tasks on > different nodes if they are on each other's preferred node. > > The kernel already has NUMA page migration statistics in > /sys/fs/cgroup/mytest/memory.stat and /proc/{PID}/sched. > but does not have statistics for task migration/swap. > Add the task migration and swap count accordingly. > > The following two new fields: > > numa_task_migrated > numa_task_swapped > > will be displayed in both > /sys/fs/cgroup/{GROUP}/memory.stat and /proc/{PID}/sched Running sched-messaging with schedstats enabled, I could see both "numa_task_migrated" and "numa_task_swapped" being populated for the sched-messaging threads: $ for i in $(ls /proc/4030/task/); do grep "numa_task_migrated" /proc/$i/sched; done | tr -s ' ' | cut -d ' ' -f3 | sort | uniq -c 400 0 231 1 10 2 $ for i in $(ls /proc/4030/task/); do grep "numa_task_swapped" /proc/$i/sched; done | tr -s ' ' | cut -d ' ' -f3 | sort | uniq -c 389 0 193 1 47 2 11 3 1 4 > > Previous RFC version can be found here: > https://lore.kernel.org/lkml/1847c5ef828ad4835a35e3a54b88d2e13bce0eea.1740483690.git.yu.c.chen@intel.com/ > > Signed-off-by: Chen Yu Feel free to add: Tested-by: K Prateek Nayak -- Thanks and Regards, Prateek > --- > RFC->v1: Rename the nr_numa_task_migrated to > numa_task_migrated, and nr_numa_task_swapped > numa_task_swapped in /proc/{PID}/sched, > so both cgroup's memory.stat and task's > sched have the same field name. > [..snip..]