From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id A6988C47074 for ; Thu, 4 Jan 2024 10:06:12 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 33B406B03AB; Thu, 4 Jan 2024 05:06:12 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 2EBB36B03AC; Thu, 4 Jan 2024 05:06:12 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 1666F6B03AD; Thu, 4 Jan 2024 05:06:12 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 04B466B03AB for ; Thu, 4 Jan 2024 05:06:12 -0500 (EST) Received: from smtpin28.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id D13931C0917 for ; Thu, 4 Jan 2024 10:06:11 +0000 (UTC) X-FDA: 81641198142.28.70B5A18 Received: from APC01-SG2-obe.outbound.protection.outlook.com (mail-sgaapc01on2123.outbound.protection.outlook.com [40.107.215.123]) by imf23.hostedemail.com (Postfix) with ESMTP id 5AAFC140005 for ; Thu, 4 Jan 2024 10:06:07 +0000 (UTC) Authentication-Results: imf23.hostedemail.com; dkim=pass header.d=vivo.com header.s=selector2 header.b=L8n3rvM3; spf=pass (imf23.hostedemail.com: domain of cuibixuan@vivo.com designates 40.107.215.123 as permitted sender) smtp.mailfrom=cuibixuan@vivo.com; dmarc=pass (policy=quarantine) header.from=vivo.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1704362769; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=zsVe3UP4UgK9uHn33EMZpTNhMYGychcd080bxCe9C00=; b=Up6SdeElPhlC0eYwFCL9D1kV1X+4CskHwYsJKk81WefqLPj4+61II+YZLVpFYbyD6DlN3g 1BnsM5FfZbC/TO4B554KwKJEYEeWw/QFNqvoeJVpLX4AxmsIrdARzRn/XXgmeDstwTtMeU oDLgLD3pnrCVPm3wNYKSw7RNYeC/WLM= ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1704362769; a=rsa-sha256; cv=pass; b=40CAT7i0NGSu3jMPIH14AHa+LJT03DkCAFm++vKC7gb42Hbv5OAqURVcisFlIfk3fKSGOy an90TAZ/r+YTM3TVlHnRZmL5nIJdwrHdqFu4xutzc8zja+v9mGX9RoW2oYbDlLL1cFVZg0 IA5xhApkXPHKQOtuYYAfvEJY0OR2brs= ARC-Authentication-Results: i=2; imf23.hostedemail.com; dkim=pass header.d=vivo.com header.s=selector2 header.b=L8n3rvM3; spf=pass (imf23.hostedemail.com: domain of cuibixuan@vivo.com designates 40.107.215.123 as permitted sender) smtp.mailfrom=cuibixuan@vivo.com; dmarc=pass (policy=quarantine) header.from=vivo.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=hpQeRnPGgkSksogS+fBzHmsIHQb+iwZTr1bfbnVIPZ0kB2jpnEZAPkqZ01zCnVkJJoU/inH76Et95fO8k+TP6P94FZSEs0/i2KH+QAfJtK67lDMRSFNycdAX6P83kZcSBnF65UZXfKNlXiNf5GqRbjFQx5Bk9Ey/NuEMqgLFEIChRkaCT/LPdFxJ3IFJTQeg81sQU+BHRgvFHVRf1uKpcRPQfKB94UM84i8OpGeV+JEmzCY4mHf/n9mu3y5lrdGNZ/lhU2ssWHgsb6aB5UiKOrlufiocxsVam8kYShJPrHI7rgH5NSy+nZX9vytul3OXEFpMk/eUHEr6sxmBIi3XkQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=zsVe3UP4UgK9uHn33EMZpTNhMYGychcd080bxCe9C00=; b=U6ZFkiFc9q8rE3N67ndU8QrTE5Twkc6rnKhQuab71bvMPB/hj3eowKmDYnwckoIlQ8dpJRWI6jBCzhWthaG7ImE6nUlCJkCZznDnP9kerq1NpstLB9JwKNekeD9htnISuqNcQ3gZaBymqGXNM65ZgSxLY/nwngYjE6jyzJcIai1KSJLmVZDNV46ZlrdpqFUmlF4Y5OD9VrBjhkqPYxDnw5BOrxIfiJcbWnxpTXi8mXQ1OBwThZMr5tLSFcu2xXJvlSHN43eMlNGURFEbMQ9spQy0J47zXgGT83c+mRWjIybUm3D7h8jicn/qEZQ7YzdQ3Azo7IEtblhNbGst+5PW0g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=vivo.com; dmarc=pass action=none header.from=vivo.com; dkim=pass header.d=vivo.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vivo.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=zsVe3UP4UgK9uHn33EMZpTNhMYGychcd080bxCe9C00=; b=L8n3rvM3t6qm6lkWgIUZXgpdIN8q0y80uQpD2rpe25Z9jKd0P1CCxMSs5F+5R+adGFIEW5EDqQHLs/s6xX9JLRICDpeA0AnOwOsKVk1lK3Wlv6OEqTfwVHWPK0ov9d/nS7pM8TKuS1dcsYoExkvyDS/5zdkZtux2LUQQdKd2BfEqz7SnTmHjZCggvy6MqHgP1nOSCYoeQz9YOoEiycD3C4oSdeOyIkr2t1wwtx4r7R2gqePOwfiOqPzcbUXf/gmO9xeEo/BiAL7KdRxA6GWb4/YaFoBY4gvVbqHCgO/liMcO+V18ZbCfAPgNqEJzI0L0ww42uBkjWJlEhj5x04p/wg== Received: from TYZPR06MB4045.apcprd06.prod.outlook.com (2603:1096:400:21::8) by SEZPR06MB5879.apcprd06.prod.outlook.com (2603:1096:101:e4::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7135.25; Thu, 4 Jan 2024 10:06:01 +0000 Received: from TYZPR06MB4045.apcprd06.prod.outlook.com ([fe80::9925:32d7:c818:3c5]) by TYZPR06MB4045.apcprd06.prod.outlook.com ([fe80::9925:32d7:c818:3c5%7]) with mapi id 15.20.7159.013; Thu, 4 Jan 2024 10:06:01 +0000 From: Bixuan Cui To: akpm@linux-foundation.org, rostedt@goodmis.org, mhiramat@kernel.org, mathieu.desnoyers@efficios.com Cc: linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, linux-mm@kvack.org, opensource.kernel@vivo.com, cuibixuan@vivo.com Subject: [PATCH -next v5 0/2] Make memory reclamation measurable Date: Thu, 4 Jan 2024 02:05:25 -0800 Message-Id: <20240104100527.3908-1-cuibixuan@vivo.com> X-Mailer: git-send-email 2.17.1 Content-Type: text/plain X-ClientProxiedBy: TYCP286CA0316.JPNP286.PROD.OUTLOOK.COM (2603:1096:400:3b7::9) To TYZPR06MB4045.apcprd06.prod.outlook.com (2603:1096:400:21::8) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: TYZPR06MB4045:EE_|SEZPR06MB5879:EE_ X-MS-Office365-Filtering-Correlation-Id: 0c6b9e98-a59d-4866-3914-08dc0d0cc128 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: YiJMKyfSRwe0Ot1NWzMdddYXSjeuWJVdTOeSIl0IjjDTfaWF+jAQ7c8DTrLVNPyzvAw22B+78PQomaYiGvEiyQoG0aEriEZyaQRtnexMV66KnYL3T9L/wItKoTiEOKVIzpDny+LRJ8VDJkc3IMW6a5iz8DJhZ2hDYauTKQee3mNiFpj5wvc8vpHZt/TlKaoUj2jl9Dz9moGbRwyvzsdZeWmXSKR4JZl/DH2lP5fOKADTMcmeb6aGkjHhlHbeHeGeIyN+gzspGEkshRJFfNaV86siuVU9kFapgxiMfjaa2aKXAC8XTjUcl7854QQDhufvzwYmKv5v9sxdboVWhExqkhxmMrYgAPQLuWSgL6x8Q+sVhEGa7P1F8PbCGYASb1VoGC42Vzzrw88p1QkF4hPhVGjGxz3NBypk4inYGVYIfyZSlLh4J1tKEeuooAaD4tY5gM3Y5uD60KAwfUiIVkeEDR7wjkhcqm5wcMqu8RrXfEN/yKdXf/OKCquHkRNW1EoOrsg0SQf7QV821lm2PocT4YP6aZUD8iJFM0O3NXyVHwzjKtxvAejAnso/TdivxvFUzh7STekQYdgz66GYEMHCpgzO1m7xCQteYpweuQQhR+xSZJzEFVIvERmH20+8vfbk X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:TYZPR06MB4045.apcprd06.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(366004)(136003)(346002)(396003)(39860400002)(376002)(230922051799003)(1800799012)(451199024)(186009)(64100799003)(26005)(1076003)(5660300002)(107886003)(83380400001)(2616005)(2906002)(8676002)(8936002)(41300700001)(316002)(38100700002)(4326008)(6666004)(478600001)(52116002)(6486002)(6512007)(6506007)(66556008)(66946007)(86362001)(66476007)(38350700005)(36756003);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?0luzV+Icj6u23Q4lyciz4F2DeayqpJhpV7U3KByrbVAenOSbj0L3d6+hLHlk?= =?us-ascii?Q?Hu0u6/8B3LBU9tUSip6z4R8HaAGt3M3yGaPzsmXALIY1DaQbvAHq2hVVgBd7?= =?us-ascii?Q?LFv0MbzIofAlHuNHQSi08XpqTp4NjLpea9S3Vx+jCjYg4rgK1vEw3WKR4eHO?= =?us-ascii?Q?7yaYlq1v3u9Oi3i5yjXOL202iILLKKafkZGmi7nPkmf+NSc4t8K72nkRA/Xd?= =?us-ascii?Q?oezNRipd8ZakFZzsPexBWtFSSbzLnU8xXZojfxoTWnpitmX1kW8yPt04VZbt?= =?us-ascii?Q?fEKGAs++rtaqlAm9emJX5CskJo8U2uZFC1AIRVGGl2iMiIc1uOujrveDZWpY?= =?us-ascii?Q?hESUtiosOZWSV7MtxdXGbDfY3MJMaFOy5kFcxdoDdYxgFPEoi0tRhrn53XhH?= =?us-ascii?Q?G6mucvDaA6yzVBJ3jamduj7HIrthLPhZcILWr0lz2u2+hE1GR06hcw6OPKQl?= =?us-ascii?Q?dn1wi++9QuDZ5qEUANHpHVJSzwEvFBaGyT3BmoU4d0omZa2JmPAbQWRXAR0F?= =?us-ascii?Q?LAn18uZQCBTSa4SQYGObxr7SlzeBGb/igxeFHrqvlHGX9zT0lMlL9Vockp9j?= =?us-ascii?Q?rMYV/9fr6zmvcUZlk2Jy2/z1smeB+khrQ6Sq56FqIJiIdaiM54IEQivBODrA?= =?us-ascii?Q?QkFvX4E++53GiiJVT4xkS6Xiq9IBoOEICI7YYK9dJ/4Xo1XVHzqOggdvJJBa?= =?us-ascii?Q?pNRg9cZNlW+u6iCn202dBXc1UnTJrVz14JPHg9ysPbO/cCZHQyqMCvvaVihE?= =?us-ascii?Q?L8hw9fgdOVRcJzzrcVtMv8QBC6TLil1Fx2RvIoO0KVee/eLj5gicLtpfyFdV?= =?us-ascii?Q?9y5FNHsaIIT7QIHNS9EkTulJ5W0FlS1fUlzyV59kF0bEwcuCYcs/HDCXh+eX?= =?us-ascii?Q?ln1sKjIveg8ZYnaxhEzBZty70HgDi4KvQGNALP3vTWUWUGAJQXL6VnvNdNfX?= =?us-ascii?Q?Hw2Petljw7aZbTF0Q9dj4r70x1/USwQYEwW4AlwcHzO/vWO/m+92wYPOL1ai?= =?us-ascii?Q?2AX0aMw0EG7gQeuRgVu3As6qsI+Rejmhn8M3zUISuyTOrrRkracOxV2Uu8EK?= =?us-ascii?Q?JgCFsHk19fP7oya1fnfqZogEd8w6Ccscrcz7CcPcOXHjKeCm6lga+0MXCI2O?= =?us-ascii?Q?jQcY92g3mrIOPwFk0rg61DT7aW2PLDwCoEeSoQ36ISMtzHuyY/daOMTbby0z?= =?us-ascii?Q?LcUKuR/WpXgB1rKkv71kvDH1oJSYOVLSwkW2nuxfZga0oBb+Irp/RxGKE9SG?= =?us-ascii?Q?n43BE/hIM+p5EWOM7paZiUGfuM72T1cxxaJtD2ttzKcGeJ/jq3h/JZgvhmQD?= =?us-ascii?Q?gcJx0p/3B/YX/IOq1Mt02N0+WAboY98uBzCxRxrjaN8jglhLP9q/7hGBGU6F?= =?us-ascii?Q?5ztnsVqqVq3yq4iKF5Xii66Q5A/hKy77ZSmTobbOn3Oapy084dNvJJJGsoEz?= =?us-ascii?Q?sTtLt2xFNdhgUZmZrdxd8A/pBFcBkC4qOXa3ztdHV1gofaos8ISpdel2Nws5?= =?us-ascii?Q?8u+h5Q/KMKMJkHl8IJHZvGHP3Tm3yGVuaaKsqbyZy8CrxrU34u27ress6Der?= =?us-ascii?Q?rYPCGA834psS+xuLYcvl0t2w9XreuWe5kYf1IcU+?= X-OriginatorOrg: vivo.com X-MS-Exchange-CrossTenant-Network-Message-Id: 0c6b9e98-a59d-4866-3914-08dc0d0cc128 X-MS-Exchange-CrossTenant-AuthSource: TYZPR06MB4045.apcprd06.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Jan 2024 10:06:01.7166 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 923e42dc-48d5-4cbe-b582-1a797a6412ed X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: xSX6LT5gd/9LChbG7diqDdWH3/vnVgBEyH2XV07fTw6UBMS+nneppFTtvtnM8gWko9digxkIGRUsuCw/rGcusA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SEZPR06MB5879 X-Rspamd-Queue-Id: 5AAFC140005 X-Rspam-User: X-Stat-Signature: erdt98zk4ydseafg4ndasnxwte5dyhxi X-Rspamd-Server: rspam03 X-HE-Tag: 1704362767-346767 X-HE-Meta: U2FsdGVkX18rWpfNXmRSWpguc5RropBKduAE91cF3Mj04ovO6+qkWZrYectkq3m7vY3eJz9RmKgVD038z648nVpEBjFOJkxfRhMYwu6b2TbhUXBBFi+lD8vzMGUcenWGkOuVtrdlLYZJuhNAOiWMKNA+LX+N41v3ReBsg9dldVGfnIJDn6iP1HdBskeiArIC55xg/tXLM9LMhoCjjNO5IR84F9fIV3Vx4GGiagBhA6TKP1TuHWPIgQs5bB7P/Rb+kIi3UvPbjUoqwCJh7QSpxnmq8WjT9cEX78xzAlwKvA+vRQuOq2gOkBMM7uk0SSrFY7sKuxPhF9i1cjdDLjzvJX2kCwtC/jsozZyiiqXTlHw2r5Z/Qo7FVSadzlzoqxBqbGEzQH3k3jP5SKY+fa7v0RWMs6w3fw/6cCYsvC78nPaq88MRMMmoIRR7BNAZyJnZRXxftM7ZfB8cFUfiGcExCPTV5VjuQBgOAtjb6zdA/0S27k6EYdO2PAfdbte9OH+MGItjRgXPA2bZU0DIojEINcnjyk+9xFFztfcua/alEWUEYARHVx31ThlAj9yErEccE1q5mkk48tx31bmFKWXRLMY+mHxxANPobsZq8qZF6/aP8z1puTM92l0dg6uQLavFJGWUr+1e8V6wYwDvj831ec+Iv4QkDhHRROKN8p31gbGLmEuBn/3wCkcvjtNCAnBFYc9S/I9RzV7qrGuYAdR7EcEiyl2qoG6lB7mAdapDIGAsRytzGgoSl1Q3DZYK3Q2nrMcxYljfejrORuUcNhumQ5kml7LFnibTAqV1msdN0AEFnvpj6kQLcQULDO79BhYrGsKh2SzEC9Vyvl75Xnqh7D1w3QxrNsDXJVMRXo7eSA6qMwLVkgBKcBzwzlXdGksQ8E8P4WJrc8J6usu5SAJAXf3vY5acfzwPeDD5dnNzMNH98mSGUV7/Rl0Pogq85gHratsU8m0vvH3lTjXjKml xwznOZvc MKQo10T7n3iwrx8hTBOZsNHrAfbviIiyswdqccGH3AdGi0HPNUPmWcd645uNOGhYLB5OzBOlUDCT3nN2sPXbCqZxN2vnfqCnvcotFQjlMUOztkx64CWlPBb00mOv9vY8dzXAEC0wteNRpgWKZhWfqsKGF8g== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: When the system memory is low, kswapd reclaims the memory. The key steps of memory reclamation include 1.shrink_lruvec * shrink_active_list, moves folios from the active LRU to the inactive LRU * shrink_inactive_list, shrink lru from inactive LRU list 2.shrink_slab * shrinker->count_objects(), calculates the freeable memory * shrinker->scan_objects(), reclaims the slab memory The existing tracers in the vmscan are as follows: --do_try_to_free_pages --shrink_zones --trace_mm_vmscan_node_reclaim_begin (tracer) --shrink_node --shrink_node_memcgs --trace_mm_vmscan_memcg_shrink_begin (tracer) --shrink_lruvec --shrink_list --shrink_active_list --trace_mm_vmscan_lru_shrink_active (tracer) --shrink_inactive_list --trace_mm_vmscan_lru_shrink_inactive (tracer) --shrink_active_list --shrink_slab --do_shrink_slab --shrinker->count_objects() --trace_mm_shrink_slab_start (tracer) --shrinker->scan_objects() --trace_mm_shrink_slab_end (tracer) --trace_mm_vmscan_memcg_shrink_end (tracer) --trace_mm_vmscan_node_reclaim_end (tracer) If we get the duration and quantity of shrink lru and slab, then we can measure the memory recycling, as follows Measuring memory reclamation with bpf: LRU FILE: CPU COMM ShrinkActive(us) ShrinkInactive(us) Reclaim(page) 7 kswapd0 26 51 32 7 kswapd0 52 47 13 SLAB: CPU COMM OBJ_NAME Count_Dur(us) Freeable(page) Scan_Dur(us) Reclaim(page) 1 kswapd0 super_cache_scan.cfi_jt 2 341 3225 128 7 kswapd0 super_cache_scan.cfi_jt 0 2247 8524 1024 7 kswapd0 super_cache_scan.cfi_jt 2367 0 0 0 For this, add the new tracer to shrink_active_list/shrink_inactive_list and shrinker->count_objects(). Changes: v5: * Use 'DECLARE_EVENT_CLASS(mm_vmscan_lru_shrink_start_template' to replace 'RACE_EVENT(mm_vmscan_lru_shrink_inactive/active_start' * Add the explanation for adding new shrink lru events into 'mm: vmscan: add new event to trace shrink lru' v4: Add Reviewed-by and Changlog to every patch. v3: Swap the positions of 'nid' and 'freeable' to prevent the hole in the trace event. v2: Modify trace_mm_vmscan_lru_shrink_inactive() in evict_folios() at the same time to fix build error. cuibixuan (2): mm: shrinker: add new event to trace shrink count mm: vmscan: add new event to trace shrink lru include/trace/events/vmscan.h | 80 ++++++++++++++++++++++++++++++++++- mm/shrinker.c | 4 ++ mm/vmscan.c | 11 +++-- 3 files changed, 90 insertions(+), 5 deletions(-) -- 2.17.1