From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id ED737C282DE for ; Mon, 10 Mar 2025 15:11:30 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 9A5EB280006; Mon, 10 Mar 2025 11:11:29 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 95455280004; Mon, 10 Mar 2025 11:11:29 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7CFB3280006; Mon, 10 Mar 2025 11:11:29 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 5D09D280004 for ; Mon, 10 Mar 2025 11:11:29 -0400 (EDT) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id D1BE7161134 for ; Mon, 10 Mar 2025 15:11:29 +0000 (UTC) X-FDA: 83205980298.11.716B258 Received: from out162-62-57-252.mail.qq.com (out162-62-57-252.mail.qq.com [162.62.57.252]) by imf24.hostedemail.com (Postfix) with ESMTP id 39735180003 for ; Mon, 10 Mar 2025 15:11:22 +0000 (UTC) Authentication-Results: imf24.hostedemail.com; dkim=pass header.d=foxmail.com header.s=s201512 header.b=tfWc913k; spf=pass (imf24.hostedemail.com: domain of yu.chen.surf@foxmail.com designates 162.62.57.252 as permitted sender) smtp.mailfrom=yu.chen.surf@foxmail.com; dmarc=pass (policy=none) header.from=foxmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1741619484; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=JVydiL4Vz0YDQP+EpA5Rcz0Mj+8qQUNDN9KpCmqJyDE=; b=QVQ+Z9WUNP9KnxVHIY3r+LP1CdzLT/NlZSW5tAScv2X1JgFLySgb3RU4nxqk1r0HV+T2YJ Ekz1vFdLO+15qsDfCPhEgVsKLMeZgjKl0nOjkGxm/NN/liz0B5xyQM1Uq1HOExXBHQHxE2 KYcsvkXP4r3GmFTD5kUFqoyTry/fqzA= ARC-Authentication-Results: i=1; imf24.hostedemail.com; dkim=pass header.d=foxmail.com header.s=s201512 header.b=tfWc913k; spf=pass (imf24.hostedemail.com: domain of yu.chen.surf@foxmail.com designates 162.62.57.252 as permitted sender) smtp.mailfrom=yu.chen.surf@foxmail.com; dmarc=pass (policy=none) header.from=foxmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1741619484; a=rsa-sha256; cv=none; b=Zq6+DwnYrqFinmVrH0S9NOSP2fnHYGm6uohorW0m2cXeuT/I0c/isqL1qiFVcDdWvfv/dh 8VNimdTS6KnZRo21S3r55arSGrTPCfq5rCZLVEB1o9NYFyeAwNRNwEo59U/kko4HZGT2Wb GgrG1UtIwhftOB7KthWC88t3mIQAuiQ= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=foxmail.com; s=s201512; t=1741619466; bh=JVydiL4Vz0YDQP+EpA5Rcz0Mj+8qQUNDN9KpCmqJyDE=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=tfWc913ku91iXJJozwhfpdl73cCxFoWsB2Z+GWM34ZEqJ1Ln+aG7fbbbNzJaNzIYR Edkk+aSL2oQunO7f11MZJyc6lP3bduw7hNhinYw8QSGfo0qNU/v0azAzUFV4GsgP+2 EIyK2lXnMmooDmjwmZsLO4OCfAx7KzTYHbEqve0Y= Received: from chenyu5-mobl2 ([125.69.38.41]) by newxmesmtplogicsvrszb16-1.qq.com (NewEsmtp) with SMTP id 2C114417; Mon, 10 Mar 2025 23:11:01 +0800 X-QQ-mid: xmsmtpt1741619461tc0wkaf75 Message-ID: X-QQ-XMAILINFO: NY3HYYTs4gYSCkstl2Z/dxjKIClzdbHnjpDbGNcHLK0GM09CJ4Z0H8DECAbmuj D/WWpq0UTlL8AWQFJWd1VcPhrB5oVMgjFFfCjnokjftQAMbzZhDoP+lDLMXmueoKVTmSlI5p7FWC U3Pi09l8Qh59ZzJ4p5WMyvY/aOm3rX83ZM+vC2uqGfxlTPUw8AST1nX6Gl9zeam+QVHT59OIwUj8 0SUszbJvwUFSIhgWwARryf2IuqtGZguVi/buYrKoR5L0VovrCz8m0fHqg4aVzhjsvcqFFKPuhAG3 gquK/gti2Kv+lv2T9sgXPmhKlQOy6YHLjwXQTzr32mu68RuDBfYfz8HvUXUlu/qKO4bkxv2M4LYa XXahRKg5Ar7pnFm6xTm2jtuIMZfWdZIT4RQkQRiCxgtcsgu3rfeKzTMk9FarSr9fXk8xKAUf9Ynm rztyvO68yQmkWO8nMUcXJ7Y/BBaSIiyjF1vWVCkBDC+hZDNsJS78BLoOx/OqKz4ZfU7ADWf9d5Am cHGl1YVGDSf/nCx1JfA2jocdFZ7D/UFME7IbChIoVidkImLkKstpovjI9Ton5MJbAOMVkGLkk1GG VxhzOwPccWezdjO4WNmykLdnWsljE1oaY1LF0bMGOtygKphARu4z8a7Cc6B6uQ+8tlkV5kK6xBRp byM1x1fz9QzlvCFraBw95EZX8ng9q30p75lR2xaVmPMXZA/DSl4qFxJ/QW/VEGvXncI2/THScPPI UwfY+Q/obj4g8QkqgsU4IAy1Jd2Zr7pDy44eqykFlALna58ALi2X7HrmVnUUUnpWuIMWJLs4f6RY OjJyUycyB5OIMBAyn6Y9Ncg3AlK9BbuYAJHDljzdL0dAqzITPji+u7H2s/5/P+MT+uab4R1xZWy+ uMf7c6nNjnWujdzHVC4TifkyKUBoxVXsO/9Vd5wEYSCq2L52EyNbrW8HCF5jUXWgr6TqnBI/7SbM vuCAegoErmwvtX6hpfsQ== X-QQ-XMRINFO: MPJ6Tf5t3I/ycC2BItcBVIA= Date: Mon, 10 Mar 2025 23:12:31 +0800 From: Chen Yu To: Kaiyang Zhao Cc: Chen Yu , Ingo Molnar , Peter Zijlstra , Juri Lelli , Vincent Guittot , Andrew Morton , Rik van Riel , Mel Gorman , Johannes Weiner , Michal Hocko , Roman Gushchin , Shakeel Butt , Muchun Song , "Liam R. Howlett" , Lorenzo Stoakes , "Huang, Ying" , Tim Chen , Aubrey Li , David Rientjes , Raghavendra K T , cgroups@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: Re: [RFC PATCH 0/3] sched/numa: Introduce per cgroup numa balance control X-OQ-MSGID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspam-User: X-Rspamd-Queue-Id: 39735180003 X-Rspamd-Server: rspam03 X-Stat-Signature: pq41t8bc6dnmwtkh1ewgn4hyxkytrj8k X-HE-Tag: 1741619482-415725 X-HE-Meta: U2FsdGVkX19n374EIki2PLR5BP1FxCEZD6Pjj1wwBkACzhlmwHIEQAh1BJ6KiM/639kn7wYNW1lxxJufsmtu+ZfeX4jG2cGDKxbLzbZnY18lqJ6GDlq+vfPbqLyxy+aKLnhGuNOFJ3gfvWLG2AmLuGvizxrFGEj6cr9hqIWdfRJafdvFHLPou5HSoLW8cgBsoejowryHuyRUEkOuusRjOw+5TPu2WLMLS18F1kxbzxn/W/G7IVPKie3wX6U+ldh5zxbneJbwHrw2dIMQRwKZDFWuDEihQw7eIsAl2sjjfMT2/3fzKQVoxKfJeX5hS9w4e3vTfblVK0NsQ97FoQEcbK66PPVnIDcw8Jz8r8GomI8ytz4CBC1S2T0pKNX96BP3mtzO3xXw4rvLaEu6Lgi2Z/tJPmMe8Z68I/sRTVobExM8JQbbKdnyG1e0S/rSJO3NMqAmeKhYkJv5Hm+3mDLr70OjgMBgINUUuashXVCgqjrlWrPxrXLWYQlUqB9N7NjFDHXkPJiEYpqpfi/RfEM/3VggfLMJodOj67yqMXyEqv5KG7C76lBHL42JxKmcaXbAGkL/DEmYbs5pxQyppfXz8WgbUprElsarQmE+Wrwz/Zxs+Rj0jqGeU/pWVD05itItUL56IUBPEm+I0rikHls6FcEACogjLxvrTcfU9Z2jjfpePrG78gbL+H+yQo/uI5rZAcH/tze+E3x0oJFejXOO5JFTHoondfc2m+CLx4yo3sI/e4Ax7yCIv2DP52fK2cOvdet50MeVES85h/t8cEfUYivTnR05FfHZgYL2HuU61/YKHDDFympO+9+xFNiKWLkFFZbhBg39f0OHI7L3EmyMuuOUnUFdqSqkEdOmxWaYPLliFPzZ1KWFJVKm1QPqEo38VHRjCS5Kmy2pKpabYO5Hn1sTx9VtVwGl3GTQamPODtJsOi4MuSPSId2h1bULFnzRtL0axWBEz7Ai339ZiF9 brkI6bFL voGvL730JwrykjJFRWIlGAGCpXbjlyMGzt6CfbuWP82W4MlBnhmvTxrDHRGmDvmHHdIUkuBzqArvyZCLP6aVTBtWM0KH/wEy8ncKBcM6Iagvbx4rRqoXKnCH1ra7rss5B062axJ20+5iHy49yhn824mWKVgDdxOR7727p8N1PwmjSfClQ+gH+srPdKKr3wQ3VM1pKXF10hu39QS62jT21Xt/AdR1wQPy5JRBGjNuL8ADapTn4Ps3ildtKZw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000078, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hi Kaiyang, On 2025-03-05 at 14:38:14 +0000, Kaiyang Zhao wrote: > On Tue, Feb 25, 2025 at 09:59:33PM +0800, Chen Yu wrote: > > This per-cgroup NUMA balancing control was once proposed in > > 2019 by Yun Wang[1]. Then, in 2024, Kaiyang Zhao mentioned > > that he was working with Meta on per-cgroup NUMA control[2] > > during a discussion with David Rientjes. > > > > I could not find further discussion regarding per-cgroup NUMA > > balancing from that point on. This set of RFC patches is a > > rough and compile-passed version, and may have unhandled cases > > (for example, THP). It has not been thoroughly tested and is > > intended to initiate or resume the discussion on the topic of > > per-cgroup NUMA load balancing. > > Hello Chen, > > It's nice to see people interested in this. I posted a set of RFC patches > later[1] that focuses on the fairness issue in memory tiering. It mostly > concerns the demotion side of things, and the promotion / NUMA balancing > side of things was left out of the patch set. > I see, thanks for the information. > I don't work for Meta now, but my understanding is that they'll attempt > to push through a solution for per-cgroup control of memory tiering that > is in the same vein as my RFC patches, and it may include controls for > per-group NUMA balancing in the context of tiered memory. > OK, it would be nice to see that patch set. We can continue the disscussion on this basic per-cgroup Numa balancing control, the tiered memory promotion could be on top of that IMO. thanks, Chenyu > Best, > Kaiyang > > [1] https://lore.kernel.org/linux-mm/20240920221202.1734227-1-kaiyang2@cs.cmu.edu/