From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 49A99C48BF6 for ; Thu, 7 Mar 2024 07:41:10 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id B81286B0118; Thu, 7 Mar 2024 02:41:09 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id B09F96B0119; Thu, 7 Mar 2024 02:41:09 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 95CDD6B011A; Thu, 7 Mar 2024 02:41:09 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 7DD076B0118 for ; Thu, 7 Mar 2024 02:41:09 -0500 (EST) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 1B406A05E3 for ; Thu, 7 Mar 2024 07:41:09 +0000 (UTC) X-FDA: 81869447058.12.77631E2 Received: from APC01-TYZ-obe.outbound.protection.outlook.com (mail-tyzapc01on2089.outbound.protection.outlook.com [40.107.117.89]) by imf25.hostedemail.com (Postfix) with ESMTP id 98E2AA0009 for ; Thu, 7 Mar 2024 07:41:05 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=vivo.com header.s=selector2 header.b=Ty+OPoJe; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf25.hostedemail.com: domain of cuibixuan@vivo.com designates 40.107.117.89 as permitted sender) smtp.mailfrom=cuibixuan@vivo.com; dmarc=pass (policy=quarantine) header.from=vivo.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1709797266; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=+33F0XBm3gGmiz5l6LMLlgOL4HM4LAPhvTid4jKMUc8=; b=RCRPJj9ubYG2SfS8r2z8ISuIvjKc/vi2CD7lDD1hInvrBL1xaeXJp0wLp3O0h8kEr2T9U9 K8HKcmE8SpedoFI86IF55VzMk5H43/jJGa9cD1ydZ4FcHOR4SN0QW5zJ47vf6YV1i3TNit 1NSQPxMhoUPbUjLnhlIA8empBWT6q28= ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1709797266; a=rsa-sha256; cv=pass; b=i6Y6elzjd9gBZBR64totW7OTMtIyhMJ03wgxEpwIvHcJ51FW/b6UrPvYYMy0E9iqLQJnzb y351BJ8A6k2ziyYIpJx0XwteCQ3VoxuQBlV1E49umUrR01C1li7pzrJ1oJFM7g1utPB6gw GCdfoAeDmRN+uVfg+b9lGXuKG0E0df8= ARC-Authentication-Results: i=2; imf25.hostedemail.com; dkim=pass header.d=vivo.com header.s=selector2 header.b=Ty+OPoJe; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf25.hostedemail.com: domain of cuibixuan@vivo.com designates 40.107.117.89 as permitted sender) smtp.mailfrom=cuibixuan@vivo.com; dmarc=pass (policy=quarantine) header.from=vivo.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=aDIw5SqX2aMHFRIsknKsAwj3LBaP2ZU8fNWtfMV1zOq5Rvvte1BKlxgasg1MoKx+rJBh52ntIRQg8ty5FrrOhJIwzovNcWRswCFYnOjsLdOD/LfqJNjof217N8tKKUM91/V//OPjSayCDU8kF63zOi8vhv11C/ZGxIXGsQtJWK+Kz2ucmwgQiQzQQ9zmf5Hn7AwIovKGZXynvj+7kesFslVYOv0F656al8qs+MRXbv/kSFoF/HduAwYK8GQQUhY0HBWIbLcDAjPp0ECztOR3zOAApj791YooPUTyxABItUNezGXkRZiN+yXFMKhaXRwG+6IFnRfJrIfoNseGgQeCzg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=+33F0XBm3gGmiz5l6LMLlgOL4HM4LAPhvTid4jKMUc8=; b=Y9S5f3xx+SFgoZlO0kfS3OOowpUaCXqtMrCX/DEjqDfnhnJsfvYVK1q15/x3PuHGM8IZ5JdbrdtgZBE6OUfdgrylXfKKsWT9MXdHUrHryAKF5Yw85M8Pl4Z+ujp9YLtIESJN3p9shMVPa7a1STp9g5ucmeHa30KCrUoEVDrvDkx2tAaAxt8Ki9FC/wxmNshZsbFlte/1huKtXPOUDPaAiZN8WjD0BWWWJOVzMtjRJfMWBoA4+JrueudUvq04/orrrlc/7yazfA/XmlUm1D8ua6hDqawMKt1MKkzVPdTmWgB9c3YJEhDBe2a8dI9EA6y9yTxlkOkfQ1HGrtctG/86nA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=vivo.com; dmarc=pass action=none header.from=vivo.com; dkim=pass header.d=vivo.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vivo.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=+33F0XBm3gGmiz5l6LMLlgOL4HM4LAPhvTid4jKMUc8=; b=Ty+OPoJevHkH/v9vaQAEHbsU9NS125PDBfvRVSqluiEXElYoCdyBSbs83fH2MigVHI4TvwGw617g80fJ94UcgrxdGNgHtkqdzCLfP6poyAk7BK1Hsrww6fpPXc2A8HrfU5sKwLElKwGi+GYfUI5bX0g6CidUh7XFdHyUNns3HQWcfELd2QzV8ruLsEdPR+JJbjDWCZOhymCQ/PqHVHyTHA1CjyzTLqMq20MtWbNRi2BNWgLVr+VsUvZx+a+HjmVi/5wgUcq2knCVRODxb8DgbRlB5KhQRfpLB4BP8OfifGiG1QtNsbBD0qpAKISK1KQlp40Dk93wi7vs3mAmCgJL7g== Received: from TYZPR06MB4045.apcprd06.prod.outlook.com (2603:1096:400:21::8) by SEYPR06MB5962.apcprd06.prod.outlook.com (2603:1096:101:d7::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7339.37; Thu, 7 Mar 2024 07:40:58 +0000 Received: from TYZPR06MB4045.apcprd06.prod.outlook.com ([fe80::2c2e:81cd:24b0:bc35]) by TYZPR06MB4045.apcprd06.prod.outlook.com ([fe80::2c2e:81cd:24b0:bc35%7]) with mapi id 15.20.7362.024; Thu, 7 Mar 2024 07:40:57 +0000 Message-ID: Date: Thu, 7 Mar 2024 15:40:29 +0800 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH -next v6 0/2] Make memory reclamation measurable To: Michal Hocko Cc: Steven Rostedt , akpm@linux-foundation.org, mhiramat@kernel.org, mathieu.desnoyers@efficios.com, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, linux-mm@kvack.org, opensource.kernel@vivo.com References: <20240105013607.2868-1-cuibixuan@vivo.com> <20240220212202.59ddc123@gandalf.local.home> <3d4f44ee-f533-446f-a9e6-7f58afc78d65@vivo.com> From: Bixuan Cui In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-ClientProxiedBy: SI2P153CA0036.APCP153.PROD.OUTLOOK.COM (2603:1096:4:190::11) To TYZPR06MB4045.apcprd06.prod.outlook.com (2603:1096:400:21::8) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: TYZPR06MB4045:EE_|SEYPR06MB5962:EE_ X-MS-Office365-Filtering-Correlation-Id: 7d1451c9-5162-4d39-5ae0-08dc3e79ed74 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: kuZpcfyNeaM0/kAW8DweV2PnnTAJPaXRn2HTpkscx0fOtWLgREzlUMibGWV3nxSJlwIiqDBsTXS2FkCbtaUsiCCgaDgQ3pBKnxWbQXmhrZFPNKB1XC1ffaAqZjAELM5CSxB2m9DidfhYiErwVFhowPzn019TF+WCL/B7TsiJavdau+pyihLzRaGPV1nV1+iGZZYiO+VdFe69NFGuPYkeEIoaJOAf7CPW7u3aC/J30PwRj2+UQ5jHK4d9bw4rP3EIkfiJqvkOO1kJ4qq45gjopkXcg4zJxeLIhDpQKnkgR50rw936Ubyfz1Nyc9FpU9OYQVDGx94xdSmfHnFuHqv0qzjXfyhvQonN1Ap+rMBHBaMpYumj5odMgo8P7MDOI/eHmkJafdeiqKBanhRFUfXU8eQdZj1uMJ+VGITRxyEhp6f12FklQd2DDLWgcBAzf6rHYVq991htHJRBtLnOawGepH+i08f043zv40L/JsnwIpQuyn4PwgJ+/3S7Py44Fwbyk6VW4vKFnPNxcFUd0/1Fhug7hEZW/ogpj6Uzn79Q7id/jrbZbSFyA+h+Cr2vjPEtLPVpJczdEoA9BzFfLGyiluHukijhFHW9JxmWWbGAetHgiYi0x6lpjgpMwEtpVcfo4/HaFvDLrzCTytA4PoUGpCARSy0wuEm99Hiptx1rue8+s/WUE0XsAhoec3kgCLYbP97yZ96KvHCV9fYDA50tj498kdGukrETLdR3OFm6HqY= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:TYZPR06MB4045.apcprd06.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(376005)(38350700005);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?dWxYMU1taTc5VGdEOTV5dmRqTGMyMFZ0bUUwM3NIRUF1NjcwOGhRc2I1S2FM?= =?utf-8?B?NldXMXU5dnJHcTQ5ckpZUzhIUWdyeEY3L0VRL1A1Y3VnRlkyaXcvYjVCazVi?= =?utf-8?B?TzN1bzhvSVp0OVc3VnhGdXowNFhKd0xSTFZQU1ZVdUhhZS9lSmh5ZTdIbi94?= =?utf-8?B?cHMyYllZV2U4RkxmeHVOOHNaamFuOXkxclpkVDVDdm1mdVJqVVZJNWZVTWN2?= =?utf-8?B?YjNjOWFrNW9qdjhUa3ZBL0MzQ1FiYXdYMjhGNmZ6WEpSWm8zMWVyQmpKVS9B?= =?utf-8?B?NlpleEsvVVVpc3pJTDUxOVFBb050ZkhoWGdlSElYTnpEdkZlYUxNaCtkMVll?= =?utf-8?B?QVFLSStyampPK2oxNlZPSTBXS1c3eUM2OWpEdXFqZWNTN28vVzZ4QSs0WDNL?= =?utf-8?B?QS9OTDdVTTl3bk8yOW5SdTVXL2MwQzBXN3Z0V0gxQ1VSYUJOL2kxQmxZNmtG?= =?utf-8?B?dTRjdEpRLytQYnJXVVBPM3B1TXBqTENvdUxyUFNQR2xUMUhPTlhuV1NsYWlJ?= =?utf-8?B?V1krYmhKR1NURHhLRnlTUTFlU3VLamh4Qk9FYlZBNGJPYVZZV0QrbnkxaG5N?= =?utf-8?B?eUpnSDdpcVppTjF1bTljYjZLYlJXZXVFTVJxSzdLVXNHN3A0K2Z6ZzIyak0v?= =?utf-8?B?cWNmd21Tdk8wMGphSjFEajczSGkzcDNrTnNaQit3aTJLUE5TNlQvLzFtWWh4?= =?utf-8?B?ZnNQMkZQblpER0U4WW04Y2RlS1dnSFRLUHpkTVZwdTBIN0Y1TXpYdkZJc05o?= =?utf-8?B?eDI3NXEvcWFsd1prdnBGSjVoaGx5a0VmcytzbGJBbm8rejNxRnRkeVVLMWl0?= =?utf-8?B?TW5jNFZ5dlErOEk5WS9jV3J1VXgrcnpqV1Y5ZHJqYUJtanBHM3VXanFSQnVC?= =?utf-8?B?ekR0ZjhNZFpCbXcxR2wrbkRHY3hwTjA5a1hlUDJXRVRzN0hOcml5MmF6SUlJ?= =?utf-8?B?bmNMTTN1UmNZbkhnY2lES0Npb1NOZjZ3WHJFMEcvWStxNDBmVUQrVndPZEJG?= =?utf-8?B?VjFsOVJZem1TUzdOelVWUy9NWjliUDdtdklHZTFySTRwY0FMejV1dDc3UVQy?= =?utf-8?B?dXNiUG5kck8xNXlRM212c3hWYUptcVhidjgvS1ZkeUQ3eWdZM3ROKzdsWUtw?= =?utf-8?B?MlcyeUVqVk1NQStvWEo4V09LV2Zaa1FURHBXUUt0WW44SitINTFPa1NOR0hp?= =?utf-8?B?M2J5emRUcWpvRGI4WjhpemlrQ1VtNTRoL0lKdWpSK29UUXByTUdOZHdFUnBp?= =?utf-8?B?d1JvZGludnIycll6V09EMmVQQjh0MkUyZ3R2aVd0MUR2aWZpOXdMNTZTNktz?= =?utf-8?B?clFPZkxhUnI3bWdLOStEdWlNcEw5WURaNkMwdEpaeENFR0I3eXUwMlJwZnBv?= =?utf-8?B?WW5NSlN0VlYxUk1wc2p6V1VzSWJ0QU8zSXZ4dUJqUEpSNVpxWjVJMzhFRHdt?= =?utf-8?B?TEdFSmlhM2hyNVRENzhFQVJZVWY5ZEZET215UGttREN4M1Q3bEJlQkV5MlRk?= =?utf-8?B?WkhQc2VFSmEvVngvZlhmT0dzMjIzbStmR3JJbmZ5NVQvYk9hNlJRcTYzbm1W?= =?utf-8?B?SW1EVm9DaWJEUG1DSUZzcEJSYy9ZczJPcm95V0VBNVVwdE5RbFZpK3N3K0tF?= =?utf-8?B?dEJoSzNYZUdVTS9OdlJuZmRGa3B6bUZISW5YS1VpaWtibk93Q2NFOEZtOVFK?= =?utf-8?B?dGpwUmh3RkduMmNqN3VYZWR0MmVsejgyUVNrZ25zNXNmNlJYdDdnbHhQbmRF?= =?utf-8?B?Nks0WkhCZnRLbkQ5eEYyUTc3eGhEUnRqL01MMThnZFNvQ3Y4OEhuRHBTNzA0?= =?utf-8?B?M3ZOMTVRS3hRajJveHBLaTBGY256elJzdUg1ZEtlTk5RVkx6WFVMV05YTU54?= =?utf-8?B?UlpYUWpyWnd1KzBGTjhZMUsxenpHd3MvR2xmcFhTZjJQS3djdUNrcG5XUTFZ?= =?utf-8?B?WTZQcVF6VkxuZ1VkelJDUkE4RjlZYUk2R2JxcVo3eEV5bkJjbVhlS2FVOEhF?= =?utf-8?B?Z3lJczFRenVUa0pCTkhlTWZUVmN6dEpLSHVJdEQrbkZTeUI0Y3NJYzMycGdP?= =?utf-8?B?Umw3c1N6b1RQbW84eitDcENleFdhNDFvbU54NkhZQUl6SlB3UTRwZ0VCUzg0?= =?utf-8?Q?jx/fxTz5+z8mRZYNA5WvnIX7j?= X-OriginatorOrg: vivo.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7d1451c9-5162-4d39-5ae0-08dc3e79ed74 X-MS-Exchange-CrossTenant-AuthSource: TYZPR06MB4045.apcprd06.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Mar 2024 07:40:57.7240 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 923e42dc-48d5-4cbe-b582-1a797a6412ed X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: oYGC6LZ6KH4ZWTYJ3qtKZBC0wI5ex7h3fEUPqexFbGQXXRmZZyBipwunnBXkQjTwFcsTxjNnKT887LUMGmV/VQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SEYPR06MB5962 X-Stat-Signature: rwj6th7boqg9j77duu6ap36au9sxr6jm X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: 98E2AA0009 X-Rspam-User: X-HE-Tag: 1709797265-921272 X-HE-Meta: U2FsdGVkX19toUI0NP2X5A36EFLmO1MmKMgczk6ySMnOIgcBXLMKrST7NYcl0dhNvvdgyZrZ2OkHZDE2GBgV9Y671ZObqqNqRwyIb9cOdXizOmp+3DvuI775jRD55exVCrdfMHxroWc1bh6Sv7r375NCxXT0G1HpjIHP8ZalY6Y5Xg4g5iZX7dT6J8iXo+jsIRh1eHEYz8ypvn6yu6s7Cu0fhaApCTJU2Mz9IeZB8ndQJWUyqnSGOBZNk9E0k+2LV3RVhnjLKfKiqOen4DZB3O0ZL1kjDWh7Y/eQzXEli1duFuqJ/UZu0+oMbiEx158/AZ6rQXyfn/h45ho7TvHxrH74AVBh6MD5oCLzgEOSfx0kAHVw5nmEW1O7obdDtTteRq3UhTtrpjaU1FzGV+nqSlkunSlswCDmdppYXCBmV2KiAo9UFS7hqocLEbak+XPExU6Gct+d+DLBmOpG9S4TuniLglCmZcrWlO4mfbbKnCyTq6eRnGLlDyArubdKDvtATlqqkvLt4i2Xf8TAGnJVHjIL6ydHCrW0kjksmqYGqZw23z+TwABifuQXwsJemH6tgo2af3e+S/xurCNm5fVDgvTU82zRR2etp9UU1t7AU0QcGV2uYYQmzmQvZIitLF6azuocbvaU2Cf+ZE3vVOV2mxZy1dwHnE2jmnvm8IhIDOXGLcQGLpQm9Ycbe57oPfnbgfwwHQeNWQne9Olmg7gdc6zYErEH2iRkVvMsDcBAppkTAuLoQJZvdxeWXHQESZ2pOEJuxgLzmVbhaFpq27rlwnl4GnQVNvqeIOWSpeDwHzQ9G8H/GgRwA2pSXXQogTMVrHme6fd2AXXOzYRkFPKouoBc75HH2ts5UDfeDakwp63cmXZlPSK2UvALBNMfiYRbQvrzfJN5ttjFFJqprbRPEj1QgogMBXU/zpVniWKB9+J6vNkAgZDTYHeg+gG/ufUCP8q51xnyuLZL08HeMB9 Yme23ki5 qh9Gbl/rzJNO4dPJSsrqNDp1Fl/4BuTT8TxVIyWM29SW1zr4CZtLeEFQvqzlmeFP1cJybATz825cGefkaEgBsAKI+6we0HSVbdxFwcTk9sQ0lUZ/cQiZjNcGjxVos3AarXIouOkPenLU64PFeuBYD3a+ZejID1zJzK12RyIH3+yuWhVcPJVax2pJCf8DehtiC5y+4HW/cNtVUUhcQbXToDeq3AtvgZQQwqvTAl68D7rB5r4bprox+irn9+gCHPBKr4k0QdC4y/6t1/gg= X-Bogosity: Ham, tests=bogofilter, spamicity=0.002298, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: 在 2024/2/21 15:44, Michal Hocko 写道: > It would be really helpful to have more details on why we need those > trace points. It is my understanding that you would like to have a more > fine grained numbers for the time duration of different parts of the > reclaim process. I can imagine this could be useful in some cases but is > it useful enough and for a wider variety of workloads? Is that worth a > dedicated static tracepoints? Why an add-hoc dynamic tracepoints or BPF > for a very special situation is not sufficient? In other words, tell us > more about the usecases and why is this generally useful. Thank you for your reply, I'm sorry that I forgot to describe the detailed reason. Memory reclamation usually occurs when there is high memory pressure (or low memory) and is performed by Kswapd. In embedded systems, CPU resources are limited, and it is common for kswapd and critical processes (which typically require a large amount of memory and trigger memory reclamation) to compete for CPU resources. which in turn affects the execution of this key process, causing the execution time to increase and causing lags,such as dropped frames or slower startup times in mobile games. Currently, with the help of kernel trace events or tools like Perfetto, we can only see that kswapd is competing for CPU and the frequency of memory reclamation triggers, but we do not have detailed information or metrics about memory reclamation, such as the duration and amount of each reclamation, or who is releasing memory (super_cache, f2fs, ext4), etc. This makes it impossible to locate the above problems. Currently this patch helps us solve 2 actual performance problems (kswapd preempts the CPU causing game delay) 1. The increased memory allocation in the game (across different versions) has led to the degradation of kswapd. This is found by calculating the total amount of Reclaim(page) during the game startup phase. 2. The adoption of a different file system in the new system version has resulted in a slower reclamation rate. This is discovered through the OBJ_NAME change. For example, OBJ_NAME changes from super_cache_scan to ext4_es_scan. Subsequently, it is also possible to calculate the memory reclamation rate to evaluate the memory performance of different versions. The main reasons for adding static tracepoints are: 1. To subdivide the time spent in the shrinker->count_objects() and shrinker->scan_objects() functions within the do_shrink_slab function. Using BPF kprobe, we can only track the time spent in the do_shrink_slab function. 2. When tracing frequently called functions, static tracepoints (BPF tp/tracepoint) have lower performance impact compared to dynamic tracepoints (BPF kprobe). Thanks Bixuan Cui