From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4B332C52D7C for ; Mon, 12 Aug 2024 22:49:12 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D74AE6B00A1; Mon, 12 Aug 2024 18:49:11 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id CD7756B00A2; Mon, 12 Aug 2024 18:49:11 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B50BE6B00A3; Mon, 12 Aug 2024 18:49:11 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 8B1C16B00A1 for ; Mon, 12 Aug 2024 18:49:11 -0400 (EDT) Received: from smtpin27.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 1450A1A0423 for ; Mon, 12 Aug 2024 22:49:11 +0000 (UTC) X-FDA: 82445085702.27.78CFBFE Received: from mail-vs1-f46.google.com (mail-vs1-f46.google.com [209.85.217.46]) by imf07.hostedemail.com (Postfix) with ESMTP id 2E3254000D for ; Mon, 12 Aug 2024 22:49:09 +0000 (UTC) Authentication-Results: imf07.hostedemail.com; dkim=pass header.d=cs.cmu.edu header.s=google-2021 header.b=GYy02CFg; spf=pass (imf07.hostedemail.com: domain of kaiyang2@andrew.cmu.edu designates 209.85.217.46 as permitted sender) smtp.mailfrom=kaiyang2@andrew.cmu.edu; dmarc=pass (policy=none) header.from=cs.cmu.edu ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1723502879; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=4zN4Gh5r2ZtT/k8/een1KebeWquCpNOqxuEapGKzxmU=; b=QFtpTbzgfhbuIaHeBpmEPY6yJ/zJYuWS/KJJOt/gvsDOlpsFEyZ8X8wN14+qjLWowcjASH YvMbHBVEws1nfUglTLmizOpae2wqGgchZXpqLFYxxc/0I22YvLPlHaCVu0iKwh9ohmZsrY GDGzjW2cX3dJ9z8smqNM8XP6CwAv0nI= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1723502879; a=rsa-sha256; cv=none; b=AmkqPXisRjSahe3rSKvonGc6MFuazDGrGL7ZWbp+KdgbT1Q0AIiA2OitCZECBDlpneFEeL frYhjo5X6AjtU/tHsqhbBwShzmBUrVOSbIUQcb6aWVuzSKfDV6Eqw8jCz/cHM7yHJ+Ws+B fnF1uktYi9sHuhO0kLz7g0MCEkZ5XCQ= ARC-Authentication-Results: i=1; imf07.hostedemail.com; dkim=pass header.d=cs.cmu.edu header.s=google-2021 header.b=GYy02CFg; spf=pass (imf07.hostedemail.com: domain of kaiyang2@andrew.cmu.edu designates 209.85.217.46 as permitted sender) smtp.mailfrom=kaiyang2@andrew.cmu.edu; dmarc=pass (policy=none) header.from=cs.cmu.edu Received: by mail-vs1-f46.google.com with SMTP id ada2fe7eead31-494556dfa3aso1389361137.0 for ; Mon, 12 Aug 2024 15:49:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cs.cmu.edu; s=google-2021; t=1723502948; x=1724107748; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=4zN4Gh5r2ZtT/k8/een1KebeWquCpNOqxuEapGKzxmU=; b=GYy02CFgunMfEC5zZdPzHlNnhraRHiPZ4r5nm1MmWkZF8O0mmFj1rBEi33nEjypxzZ IJUc0hIYmxwnke71HIcsfZtOY/VzWrUWrnvMfQIGpQuOGEz47Lie604AbAjHXY2WCYoD 9gOakl+qxTheNA6VIqydx/QEnQxXGIIy3n2Io2l2Ak7MtMWKVf1BBB2y7ej9EfNeOzE6 n0wgjTBO2BXvZVDof1nvqPsSnixcvW+ETm28uJio7lknkjoG303j4qLw7mvT2fqW6Ha+ 69to3T8/ewtblTwBffaaANJswSc7CVCq1dsZqkFtzFDdyTTXF09plBpjA6VyzQFvVXct xivQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1723502948; x=1724107748; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=4zN4Gh5r2ZtT/k8/een1KebeWquCpNOqxuEapGKzxmU=; b=YN7XS0nT1R8ve5ZjXpyDEqbQ4XUrGWCeMKuWK0WYAGSO8JV797bQMYHPqGIzLMhvFH /EsDwRZcKrRNNB6TMaV8he+afAaO15bM30EDpEsCwS6txRrbAMKUhrzb1uT+8Z5/Bj0Z umM8nN4b50PA3OuYus3PLjp83VpkaSRA4TIKW5ZE+CAifeNx1yShdfgQKlUfnVPyzrr9 +HgJwrR9VYONda7/+g6yetvILXCOhssfNbpGLZzWHx/WHEcGyL1w5Duld+xcLtXsBeGH 1An/HTx/o0NNFc5xamOJ4WjyJyTD7dC7SOEibpzG/17D6th0SOGvyeH9tnA2OxjrBPHB 5a3w== X-Gm-Message-State: AOJu0Yy82EGQAm6uswwkrbQGetsz0S38hncwWcGFQzdeeHI9Y2Rz0GHZ v3jsCuO38geMqpl9N1thrCjOxOFlTnhgBorBPV/P1mJ2IwPwqLkgm4dkMRKslw== X-Google-Smtp-Source: AGHT+IEVjzVH8ZuXd99m66D+lu1lA0lbLhsrUGD8ITS/piDDRdkW1qC7PkAwxow7hljU61Pe5BeBOw== X-Received: by 2002:a05:6102:c0d:b0:48f:df71:17e3 with SMTP id ada2fe7eead31-49743b3d220mr2178995137.28.1723502948148; Mon, 12 Aug 2024 15:49:08 -0700 (PDT) Received: from localhost.localhost (pool-74-98-231-160.pitbpa.fios.verizon.net. [74.98.231.160]) by smtp.gmail.com with ESMTPSA id af79cd13be357-7a4c7df55f9sm284414885a.92.2024.08.12.15.49.07 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 12 Aug 2024 15:49:07 -0700 (PDT) Date: Mon, 12 Aug 2024 22:49:02 +0000 From: Kaiyang Zhao To: David Rientjes Cc: linux-mm@kvack.org, cgroups@vger.kernel.org, roman.gushchin@linux.dev, shakeel.butt@linux.dev, muchun.song@linux.dev, akpm@linux-foundation.org, mhocko@kernel.org, nehagholkar@meta.com, abhishekd@meta.com, hannes@cmpxchg.org Subject: Re: [PATCH] mm,memcg: provide per-cgroup counters for NUMA balancing operations Message-ID: References: <20240809212115.59291-1-kaiyang2@cs.cmu.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspam-User: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 2E3254000D X-Stat-Signature: 37r7fozknzp4skjcjxobmeiuzruwaosf X-HE-Tag: 1723502949-105442 X-HE-Meta: U2FsdGVkX19341T7rvwo4unL/2NhsigJtqG1xNjp7AxYSyT4TTKox+YRRcU2j0v87+XWqWLViklzD6EdVoCicmVNk6afLJ5c0t8GikINqc4dgcR7oZLcU302qMbK0OFw3e6n6x6C9bzheVqg1n2MSed14H7v/Gk968lk6fs4Nil3lYCWlPpD4zcP+VZidLeRHgc+rJq4su9SPb2D3LBHeUet6kNvo1IcMUDq27krx4X2iJc9lmvypIeEniugSIOtJ9KJFdpuYyt2J+uY+XUfclwigclG2ru+kn+J5UmQpFrOAKAKhUMb+9r01if5kCu+Ema/lSR8Pmt/XOLAYrG1bokW/VUiDCIxky0S44VGLyATvYt6KpkOXWYa9FGAW6x5VJ9iaE4lESMyy09BjKODipwWqw2XGVhekqGS5iS/4Su4ZaPZ4rU29Y6S1WcTU4AYgFlk720HicziRn4yYoMh/yNetPPoUoZeREB7KrtEEg5pHwfKO+obLofl+YYpyYlpIb/f1iK7Aq3A9sYi5hmuXs+YdKMx0u2V0xZ94uCKNkVBZadN66gvSWhcCVy27yDStgDc2nQ8TZDBxaCSnwT7rslr5l4m7jD3q1htgbRmMra3ZHH63rdApgPgPyY4/he+tgCihsTY35uH7wRHWQF9IZ+fiL/GZk0/0IcXT6EiNKKpUqcK+s5eMqolw4IRKEuFG5EFzmhee/FyJ4HYD47cVeBgk2RsvztqcL8Ruqe+78lplen2f44+dZW0Xi/j4QhM+F0G93EWO5VKz3XZtXweqx+qyHVpEbIMHPZwQQFc/7dFvsYiwq10swxZin2CiXCXU6PPM1ttqsMhrpU7eJOB6gUl8fYEq3Y7owvyTiw1IOPIHn7ZAiNy3bOz/Tvw+ARyLy8vzcm1w8WABDqgQ+dSUl2Lnx2WTLctEsXI2nla+TiGRCKcRDUHno5oeOOjDWavENzBPT3cnUfKHD21MPu LJJUu7ic 1mon/6di7lAcM0EU5tuZStAXejJPLYwOK8QmOJQT/FvyuaDkwofujYnlK+1wFsZ1Bm4/Ej8isLF4j4DGsA+n4e8F0t7fpkFNLRjbOr8KF2cnHQsUGMqGnIjYqlKbOuDahtJA3/eXu3hFfmRclmTqd8lQXPpaD4xAGpINSEgJwCdO1MDxXxr+hDP5WQhSPYFtoD0Ip952u68OAgDEA6nLgMM1cki5wH/7hB/H0Z/XmgDPcePdwisW1KEUy2yHBLYqXQUzgAmvX5z7IyJ/qsFdomtO8RwSQec4QCKuU6Rd/DArcDY1I0FqE+EUirMg5849su1tALrWzeeQAsH87xJsTYuo0bkHtGO7Zrb5JW/V/V8vgXpPQdyfiRzg2kQdZZNY+91uBB3iyOl0rZrpJtwSDIF4OAg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.220574, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Sun, Aug 11, 2024 at 01:16:53PM -0700, David Rientjes wrote: > Hi Kaiyang, have you considered per-memcg control over NUMA balancing > operations as well? > > Wondering if that's the direction that you're heading in, because it would > be very useful to be able to control NUMA balancing at memcg granularity > on multi-tenant systems. > > I mentioned this at LSF/MM/BPF this year. If people believe this is out > of scope for memcg, that would be good feedback as well. Yes that's exactly where we are heading -- per-cgroup control of NUMA balancing operations in the context of memory tiering with CXL memory, by extending the concept of memory.low and memory.high. The use case is enabling a fair share of top tier memory across containers. I'm collaborating with Meta on this, and we already have an implementation and some experiments done. The patches will go out soon. If others have thoughts on this, please chime in. Best, Kaiyang Zhao