From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 11466C02194 for ; Fri, 7 Feb 2025 10:51:13 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 9D7A7280004; Fri, 7 Feb 2025 05:51:12 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 9882E280001; Fri, 7 Feb 2025 05:51:12 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 82881280004; Fri, 7 Feb 2025 05:51:12 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 66B3F280001 for ; Fri, 7 Feb 2025 05:51:12 -0500 (EST) Received: from smtpin24.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 191B91A1B36 for ; Fri, 7 Feb 2025 10:50:45 +0000 (UTC) X-FDA: 83092830492.24.C96EE47 Received: from relay.hostedemail.com (unirelay08 [10.200.18.71]) by imf18.hostedemail.com (Postfix) with ESMTP id 0B9D71C0004 for ; Fri, 7 Feb 2025 10:50:42 +0000 (UTC) Authentication-Results: imf18.hostedemail.com; arc=pass ("hostedemail.com:s=arc-20220608:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1738925443; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=j/OQ6t9auTd84x6oTutq6GW3QqBF3bAiI+g0pegbNrs=; b=WVuQznFv+wli1tKqyGna5eCo4DGaXsJb7rwf+W6gtySk1Ot7sTxnSh5+5XWsZUzvyc4/os 8hQ2kpLe3K42ntVKmR7pn1m/6EmkXKfCH3N9SLINeDLtgqrTslLrYqg5z9TPhkRRWvV9vU uP5uwCEfpiTGTcCbHujfRPpDZsV455w= ARC-Authentication-Results: i=2; imf18.hostedemail.com; arc=pass ("hostedemail.com:s=arc-20220608:i=1") ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1738925443; a=rsa-sha256; cv=pass; b=UbHp7an7hpRlf5TyWBYqj5/Ecfdy/jr1cNRl15zFZMhZHCm3kfthiN80g995+sWwX1rChX G3OeNKLX1JbKMC0xTaZTTc4gMH/QYBEtHVxxJm83g1Uszt7HKrqTqASoJuVkucrkxDFcMc W/a9bqlamCc1umyx8PH6ZH4wcfWs+tA= Received: from relay.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id B913C141808 for ; Fri, 7 Feb 2025 10:50:11 +0000 (UTC) Received: from smtpin15.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id 838D61C96EF for ; Fri, 7 Feb 2025 10:50:11 +0000 (UTC) X-FDA: 83092829022.15.6F5DD97 Received: from invmail4.hynix.com (exvmail4.hynix.com [166.125.252.92]) by imf07.hostedemail.com (Postfix) with ESMTP id DCEC340017 for ; Fri, 7 Feb 2025 10:49:54 +0000 (UTC) ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1738925395; a=rsa-sha256; cv=none; b=VL7X7Ff6YxeNRACypzw9+UbAGE0nTBtashRdwp8Mf3Vxi6dKNnTQSNNyzPwkPfIXX1pOo5 oV4IS4rVv7uaMjDpmONXKO+2c7tHvu82ogoX9EZ8EsdJJ9mGYp7etg/HY0AfZ6CWJSUG0j ruCT8RL+P8FVT6Hjdi1+TCO4uOxjOVc= ARC-Authentication-Results: i=1; imf07.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf07.hostedemail.com: domain of byungchul@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=byungchul@sk.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1738925395; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=j/OQ6t9auTd84x6oTutq6GW3QqBF3bAiI+g0pegbNrs=; b=iGYJYxo921eq4WfC1sSHi68TduPWi1HPBl0nD2gJ1PTqtjJdSJ8sSfbbg+/By56YmUdiYP +vUbSAdsyeDsm12tsiFcwBB3Tf2icAknSS9TUBCg73T/CPUsNmaT+mSfCR60hBsmS8P332 XZbfOOpBrTHRqZVTBcVvfJiZFzaR2to= X-AuditID: a67dfc5b-3e1ff7000001d7ae-3e-67a5e5507558 Date: Fri, 7 Feb 2025 19:49:47 +0900 From: Byungchul Park To: Gregory Price Cc: Honggyu Kim , kernel_team@skhynix.com, Matthew Wilcox , Hyeonggon Yoo <42.hyeyoo@gmail.com>, lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, linux-cxl@vger.kernel.org Subject: Re: [LSF/MM/BPF TOPIC] Restricting or migrating unmovable kernel allocations from slow tier Message-ID: <20250207104947.GB35103@system.software.com> References: <20250207072024.GA48419@system.software.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFrrELMWRmVeSWpSXmKPExsXC9ZZnkW7A06XpBqufiVtM7DGw+Hn3OLvF +VmnWCzurfnParHv9V5mi98/5rA5sHnsnHWX3aO77TK7x+YVWh6bPk1i95h8Yzmjx+dNcgFs UVw2Kak5mWWpRfp2CVwZ7cvfsxSs5q24sHErawPjDq4uRk4OCQETiZNLn7B3MXKA2VN+JoOE WQRUJPbt+84IYrMJqEvcuPGTGaREREBVou2KexcjFwezwCNGiYsHljCBxIUF0iTe/vADMXkF LCS6ztmBlAgJTGWSuD1hIhvIGF4BQYmTM5+wgNjMAloSN/69BGtlFpCWWP6PAyTMKWAmsWLt T7ASUQFliQPbjjOBzJEQ2MMm0dvxjRHiYkmJgytusExgFJiFZOwsJGNnIYxdwMi8ilEoM68s NzEzx0QvozIvs0IvOT93EyMwpJfV/onewfjpQvAhRgEORiUe3oQDS9KFWBPLiitzDzFKcDAr ifBOWQMU4k1JrKxKLcqPLyrNSS0+xCjNwaIkzmv0rTxFSCA9sSQ1OzW1ILUIJsvEwSnVwDh1 85tLv99uMuhf0ztjtvuma1UNicI3p4mLJ+3v1PN8JhSrcWL1D6vmKW+vXzCIPW9zk62YlXmV Sobuv7Awea6+rM0Ol8pLag7HlS438jhzVDroTOqM827JDr2T9/7vnZP/xKHS4sDtZy/y0sLY ogy2X/U2VH87K9Hbcd8bWR5etTcpInt6zyuxFGckGmoxFxUnAgBGX633ZQIAAA== X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFjrELMWRmVeSWpSXmKPExsXC5WfdrBvwdGm6QXsDn8XEHgOLn3ePs1t8 fvaa2eLw3JOsFudnnWKxuLfmP6vFvtd7mS1+/5jD5sDhsXPWXXaP7rbL7B6bV2h5bPo0id1j 8o3ljB7fbnt4LH7xgcnj8ya5AI4oLpuU1JzMstQifbsEroz25e9ZClbzVlzYuJW1gXEHVxcj B4eEgInElJ/JXYycHCwCKhL79n1nBLHZBNQlbtz4yQxSIiKgKtF2xb2LkYuDWeARo8TFA0uY QOLCAmkSb3/4gZi8AhYSXefsQEqEBKYySdyeMJENZAyvgKDEyZlPWEBsZgEtiRv/XoK1MgtI Syz/xwES5hQwk1ix9idYiaiAssSBbceZJjDyzkLSPQtJ9yyE7gWMzKsYRTLzynITM3NM9Yqz MyrzMiv0kvNzNzECQ3ZZ7Z+JOxi/XHY/xCjAwajEw5twYEm6EGtiWXFl7iFGCQ5mJRHeKWuA QrwpiZVVqUX58UWlOanFhxilOViUxHm9wlMThATSE0tSs1NTC1KLYLJMHJxSDYwLzS66163n YDtwQST31/vjy9bdUzk2c2GnH8+pTVMtJIT2y87a3zFx3bT691uqaqrbAvJ4t7+ZGZpwbnFy 7QXX3iu2nHIJD2o89160uLB/e7+E+AOeiDsnWmdf+3U6epJfM/Omlpu5eUx6ciclbhTGvl69 48jkd5aPUnRTvR38mVVFbYM9/rYosRRnJBpqMRcVJwIAduQ4dVUCAAA= X-CFilter-Loop: Reflected X-HE-Meta: U2FsdGVkX19Ss0r4lh+ykDHLaiHQjc9jViQ7M0WFZHrrdo/ug66Hy2kIqejovTp9K2Z0fMe8DZ2f6IOO++QWbUdaYh3BK/+WS6rd5iMl0yKP7M/uBE0hUtPNZClQqbOJN6GXSGfCTeB2QTtqiPMWI4tVACFm84qRqaqvACAokFSLK17xh6PxdLcy4GGKyzYOmRwZPwmMwU9tbsoJzy5UW2pRj9HbdBfGGLDUX+zFwzvGCzz2nkyA7dIR4aMeIIjnCn3ufd7M5o7C76jKcn+uRcJPpAxvTdj0ZKIduYlUv/EeLOzbk5y6vAL5yw3nFTk1OSxUYojTK4GJzlcaazKOCgLEvvhRTNueXxjARrqsjt+tUKpwJ1XBL3UVrE6bWIGvyIi9Xj8gCHxwv5FJ7Bj3CYF+AvZXyEl00WtEIs60M80qSC7Nmj6/ESNgJ9hm7uI1GEYqzEyQ2+gz+kVv21ixuhrEZCqfbA0+Xtkan8V8w/g5TEMBJvWWVEOMw5YYutXlgiCqwxh7YUGrX6+NaomsySuu95SZ465DW68fN6CetJjwDIPhFf0y1zK4km3KQa43TQLyLCuyRTv65WBh6BhVzshKV8vkdZBF2RSpnf69NDWJWs4eNrn0KYvQTZn0c4l352YTOx6RY+zvmYG/hoBvfAMfHap+m0n7j5gW1pXdDFStcJJ+CR+PV3w+STsxIFFJj/zAVjmz8mGF7LhIB+Q6J3I5Lj0m4Sl0BHIl09PUFLbj8LY+eSmTzakQHXqo05ZpkVQlIGb9sSpf87jSO50Oa0OPAVB0CAV0FfG2YGHsZZ9vWQGVMdr85jZuv6TRajRGNQceNb6+U0dH547Sj396bLhF2crbNkK0JW6SBQfD6lNRaSJBVbu7wf/Z6/TyL4EN+cH1y2pEW0scdO4vXG17pLhf53pEFknHqWD97NmqF0dn6iDM4N4Soie+0a51L8ACW2ktQ7jrpZezBzzPWxn B+bAolrh oEJIy X-HE-Tag-Orig: 1738925394-838331 X-Rspam-User: X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: 0B9D71C0004 X-Stat-Signature: 3swhi9uhrdp13ppbwmnw6hsdsdifkys4 X-HE-Tag: 1738925442-656227 X-HE-Meta: U2FsdGVkX1+VG9DnRaCbmflThgf3Ric5O7WzWpbDO5OnB1aVO0/M8c2kalqLdqQJOPAGpjB90f0n8F4zOxxEPcYbzgOeYucO6AS+EsU9cw8b11tuS6mNYpPKIDRG6lH1dKr87aVuN+XCtRvB/hK0bxSgXc6wSQsUoeZcfiOHTJwVsyFc8uuqf88D7w3CVFcFC5E3a58H/FYOvTbPgm0n1j9iwWDGefynI9mGVB/+3NXoQSaAlNyojQaO0SOXvXOcyzBnqqCwL7XbuDGDIgMfvgYNrjMBhgyRGOVJDGKlWg078PqICu2wsCxdupODGDjU9kB6T2wKqNcLMI5zLODfJMq0UOcbqBsDLp1Lm0jm6c5MooEQBj2bgRE+7yQRAV8gcHXCAtw+uY2GFj+C/JzpxHE8Q5AjM6+NzGr7dEY7cPWS1TfTElMDPEt2eSatexnFO87xS4UwpYYEHEJk5hhYxLUtnC5jJsA6CgD9ZGh6xgccJBzSrlwlvTi25O3dWMSqV+ekpspLl3gpbki72dCmKDAGRjlyYpGUwTuCanYkVE6RLPFpd4TJRAW872G7PIkyIuyVbGz52yHH06+lHsmrMaGiddn6Pol4zNp4FiUf2ybDP3pfrb5t71rjUk9gZ8dW5LqcrTt61NFmdYD7qdbD8MsTrlt72PhBZ0nE4sgX8MmrVRlwHMwoB3v8pN75qf+NylSWiI8cJFAV1ZvWhmII6nP2x90zhC/TeFp/4qPG2Ur+K7Qr5fYc512jIVQQWkY8UFxFNv60ISXnh3p1ulzd69M1tHOIcQklXR5jBvrE3Cktc9hRTezFkzOI0Mp5O/rhCXkZPYAA5ZQCILDdCMQcP5iH+aYxdw6K42Ai+OCyk9SEDEoVu1kK6nMHtbJ380mu0PDudFQdGpUmvq9FZnrE2QdoTlNdC99Hr1AGN9e5ye4YXV5COmvd0KGlbgIEmKdbWciVn6akrxWgpSTsTh1 J5xGY0+u WoDME9cP+iRdPs59p7kAFgDUYwpjnuwjUGn1ZiP/3TzEaXh+zYWy7oNT7KpyY+LIDvhjJlDZBhEyQ6IA3H0v4o5X4wB6/BEtL976mqwVWCZJpSzoOFtMdqwt7hURXcFDCb27k X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Fri, Feb 07, 2025 at 04:54:10AM -0500, Gregory Price wrote: > On Fri, Feb 07, 2025 at 06:34:43PM +0900, Honggyu Kim wrote: > > On 2/7/2025 5:57 PM, Gregory Price wrote: > > > > > The default kernel stack size is like 16kb. You'd need like 100,000 > > > threads to eat up 1.5GB, and 2048 threads only eats like 32MB. > > > > > > It's not an interesting amount of memory if you have a 20TB system. > > > > The amount might be small, but having those data in slow tier can > > make performance degradation if it is heavily accessed. > > > > The number of accesses isn't linearly corelated to the size of the > > memory region. > > > > Right, I started by saying: > > [CXL is] "generally not fit for kernel use" > > I have the opinion that CXL memory should be defaulted to ZONE_MOVABLE, > but I understand the pressure on ZONE_NORMAL means this may not be > possible for large capacities. Just to clarify, for moderate capacities where ZONE_NORMAL in DRAM covers the whole memory, it's not a big issue since the easiest solution would be to place kernel objects in DRAM's ZONE_NORMAL and not allow ZONE_NORMAL in non-DRAM. No objection on it. For large capacities, kernel object migratability might be a must. For capacities between moderate and large, kernel object migratibility or allowing ZONE_NORMAL in non-DRAM, or something better idea, would help to reduce ZONE_NORMAL cost. I'm adding my opinion with the last two cases in mind. Byungchul > I don't think the solution is to make kernel memory migratable and allow > kernel allocations on CXL. > > There's a reason most kernel allocations are not swappable. > > > Thanks, > > Honggyu