From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1A853E7718B for ; Thu, 26 Dec 2024 01:28:40 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 5CA3E6B007B; Wed, 25 Dec 2024 20:28:40 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 5529A6B0083; Wed, 25 Dec 2024 20:28:40 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3A51C6B0085; Wed, 25 Dec 2024 20:28:40 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 18E0B6B007B for ; Wed, 25 Dec 2024 20:28:40 -0500 (EST) Received: from smtpin23.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id 9B0E11C7D06 for ; Thu, 26 Dec 2024 01:28:39 +0000 (UTC) X-FDA: 82935374256.23.98DBDD7 Received: from mail-wr1-f45.google.com (mail-wr1-f45.google.com [209.85.221.45]) by imf25.hostedemail.com (Postfix) with ESMTP id 3C135A0007 for ; Thu, 26 Dec 2024 01:28:08 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=HQVbiqeu; spf=pass (imf25.hostedemail.com: domain of kmanaouil.dev@gmail.com designates 209.85.221.45 as permitted sender) smtp.mailfrom=kmanaouil.dev@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1735176489; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=2PGQBQW+8N0Zcs8DhBKUAu1Vg2j/sC9TrVpgPiFR0ek=; b=C0+7nEYmp4AwxAD+84K2M5MLLQMZBimtaQhM+ATe6lPe7vdiazFsiPgFave9syhL0fa6W6 hjbA7Y8M3RZhLNj/8EB6qPC/YxK87RGG0/0zIFEdzNISVsfdDQcaSud6rw8V1HJc+E1Bax RN+0U25LCvMT008hu88KH+Hb/IKqN3Q= ARC-Authentication-Results: i=1; imf25.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=HQVbiqeu; spf=pass (imf25.hostedemail.com: domain of kmanaouil.dev@gmail.com designates 209.85.221.45 as permitted sender) smtp.mailfrom=kmanaouil.dev@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1735176489; a=rsa-sha256; cv=none; b=LARuCHUC4hPTEIfcZ8Bd54nNisWcH3GFUP5rY0Yfh6mVjhI222HZKQwTIsknhkn0RbMvYm DUNbFA5RnvpwYDEAhAVNkwotc8y9kvYA5g4drTD37NciMCBIE7ErP2I8ergQh4agFGsYHt 7vDZ/bSDdy701hAclof5w2BV0qAhnys= Received: by mail-wr1-f45.google.com with SMTP id ffacd0b85a97d-385e27c75f4so4472408f8f.2 for ; Wed, 25 Dec 2024 17:28:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1735176516; x=1735781316; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=2PGQBQW+8N0Zcs8DhBKUAu1Vg2j/sC9TrVpgPiFR0ek=; b=HQVbiqeuCkOnxANGGxagPbf6a4kD2xmLu8sn+27JQS9ZXlQjuOUKKfRtB+89hAXCj+ mbF2IkdmAbarc3/tEUapNe8eXuQGHvvXWu23dV2ed9YvsX06J7LukpccJS7UHGVbCeHo Xz6hzwfUIxjrbyOItoNOhh8yOz7jn8lruB+pTc1tNVL+vqNPW725TEPNHrtBoi4nIcyq 6BVDeCWN+2AeXagNFDVhoEYkGYCplHti/4qzgTg8el6dw8JHCu59uHjZTqiHM3EgY776 NqOOK8aHGsRF0G3sU6mbF7okc1fsuKrJEnK+bZxtjqspc/pj1YqIANvsvQR61aSRhJL4 M0Yw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1735176516; x=1735781316; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=2PGQBQW+8N0Zcs8DhBKUAu1Vg2j/sC9TrVpgPiFR0ek=; b=WJnkUNXz4ZbaBMSw3pSh8S8qP47jawrGtEnYVRHGwnfj99G1oYh6qatuvwb1RprsZX DNtD8hRnLZ+x7XK9ux8PjdwNzCYtFMCVzqzk9aDy0HuocVqMxwGQGYcxztqTFwmr+iWh m5E21q2J5PN4VYmeVbFfHNzOBqUBQxgsVQchqBA7ks6Sa2iP2QuwCjabtOiDdeWhVIUE kYDcANVz/Z4DzCuIcMyZzL+/5lzwZWUNJTlhki414Ngdp4HWSxkww4FLQP4uUc7wTAtz pa0foPTamYvlGUhG+5vSevycHi0wN1Prof1vHc7FLib28vW9vdha5yDygzxwle7nEZdh kvTQ== X-Forwarded-Encrypted: i=1; AJvYcCVxl57k6lgrPRd7GW68Koes/wBGiX31mrYKU4J9BkOB/SEauN0Vh+umauWLV00MJtkwYrR2IMvz5Q==@kvack.org X-Gm-Message-State: AOJu0YwmANXI+sNoxXMYm6dSBb0Scw/8vE/ZFa7MbshpvJDqGVvLy2Dl mJKeWq3YWYh5700+OT7dIfh0LV1QZmKBc6woPQ0VcoIKbqkqg4e/ X-Gm-Gg: ASbGnctLPRXqIqtKVmqelXuznddvAdNmFzsIURIIJd1Ka7i4a/GSBe6yWmzum+t6/cz 3ZgN3JggGszqrLAbtXFfIweXivOqYZxJfTki36ACAmNj+JV3HN5s2UwX7qjUOMLeQhYZnZIx/2i A4fRAY7qF0WeKppUjzs34CXhTWTFpCLMhXIPZux5On8gQ3O+LV+e810RRUozt6eyRVabrnMh3J6 MeovPQ7KFqQmZFbToPPs7RQBcZeY+uQaiLYezk3hFFLBpixgxQsQMIhvDQurAfTxPW8Qs3INgts VXs7HzaLdxkAdA== X-Google-Smtp-Source: AGHT+IEmzgsQOdnINzrwCO79OWtystz4+vn9xkhYBA7rz+gkRMn18OfzO22q6lu13zKh0SOWLQ09qw== X-Received: by 2002:a05:6000:461e:b0:388:e377:8a1b with SMTP id ffacd0b85a97d-38a221f38b4mr16810675f8f.28.1735176516060; Wed, 25 Dec 2024 17:28:36 -0800 (PST) Received: from ed.ac.uk (vpn-fn-230.net.ed.ac.uk. [192.41.114.230]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-38a1c8acb17sm17946047f8f.97.2024.12.25.17.28.34 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 25 Dec 2024 17:28:35 -0800 (PST) Date: Thu, 26 Dec 2024 01:28:33 +0000 From: Karim Manaouil To: Gregory Price Cc: David Rientjes , Aneesh Kumar , David Hildenbrand , John Hubbard , Kirill Shutemov , Matthew Wilcox , Mel Gorman , "Rao, Bharata Bhasker" , Rik van Riel , RaghavendraKT , Wei Xu , Suyeon Lee , Lei Chen , "Shukla, Santosh" , "Grimm, Jon" , sj@kernel.org, shy828301@gmail.com, Zi Yan , Liam Howlett , Gregory Price , linux-mm@kvack.org Subject: Re: Slow-tier Page Promotion discussion recap and open questions Message-ID: <20241226012833.rmmbkws4wdhzdht6@ed.ac.uk> References: <6d582bb6-3ba5-1768-92f2-6025340a3cd4@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Server: rspam05 X-Stat-Signature: zpi7yyphekicqfsoeniu6e1sg1npgk49 X-Rspamd-Queue-Id: 3C135A0007 X-Rspam-User: X-HE-Tag: 1735176488-411653 X-HE-Meta: U2FsdGVkX18EmwqyFt+a3bcMD1X3HtNsfkQZYZbqZhmYHR2iAX1/88E5sW1gCWtQmVqrBTQyGK6c9wuIaZ25al6HcL3qt8Ev+KT5eHx3pYvWS+k/nJJyuX+yLHA2jerG6fy0tbaukVU2FgRQniEPuhitvKWOx/it+jrfD50+T8f74eVYi/zR6IuzvDKWG72eyyUS6bys1H8ipPH/T+UyrG+tqN9xj6uTX4ZjgBs0pxMUgEIlKLKbRha6tDue0uv+lVvM+KSkC0N+ztEQwHnEwhLGpxgLev4gKk6K7VAQRNIqbsT3zZ+/cW8wh9gsdPhUrpqGN3QQ4nak10iPWGGKPEMoSjjnGGoAANqki7wE47mBVDd3dLcZwsE1z76F3GNTwuo6LLpMQCj/8OjPpFuxJDbX4xg07Xm5HjbxGhCh18VlyUf+NDDm2y+VKa0OIUehwg2j82TRResb6brFsAjqXtcMFdREOrnYiY6v9YY5LAPW5Ciyc/wVNhkpviAq20jddwmRr/w22MCqV1digNvA0CTg6rd82lzXdPgSb016QiM9YE1BRIuMY85KkxDVKRXXi6TN12/FShMh59cthic43rC0zhmLHsjTg0eO8UM4sWVyhmm8+ZdnpgBV/6VkakM/fMfaByJnIHTBLYElhZOi61FKPTxqyNKyqH+rOGitBZyLO5vHGVRG8u8E7QXRB8H3euOHBJ/33BhoOOQizFI46ZLBAEtfZ3JWXrkn/Pu6DuOmSuBncw90FCY3Eh6hTinQ7s6tVg+Hb/QjZ/z741YqhWpY98xdd211+E0T1zzF7tNYpTjUNR6z9VmC60MD0HenVIOh4KRWnmDEa69PtXrS75VwmiS1SbRoV+HU367+IzsfqtYs6kYc/XxUi4Dl7qLhTUqsEhl1V+s/DcnKz+1uvBrcz/UCv3irhZosKYVfOZzrhQ0e6wLw72Pk/Fn0ab7R85yDL9KO26MuWkWg+2r /BIJ84rL FI4bwHl0ul5vNY+elBIk2u6Vx5rO2YI19N/bBChzhF0zERDfJEH/0ukZ0Gzg9F/URhPn/re7nhXbxtWn6g6YY78A3e4cs28jsX8haKVJenPHNJK9Uhp6Oyp+0MkFDgOWyk1fFmDOVRIIzIUYeRoivQ+H96Q/V8zbPHxpq95SuR6i9rabb2fMnq9ohGfp8sc56+yzH4SOkF+Zz/0KZGKaX2OqXtrXTACJB08GuarNF2R8lPRcgARPjzcx4MOJ6QUBaBpy0HXra7w32QbciUZ+9QG5DHOipmqvryAJFd9uECCZ4QSCczWc0tVjosBK/3mYrsOtqRYOsjDO7xqAiN+H74tEH/xONADHD/xciQCqoGoVVDEGqqZ5E96mMWXJnDHwCCz7FsNa2TVTOUOgpPtM4jGYIGGp8w2sNOyluKUNmPf+Sa4AQiVhOxAq5queLaj5rsxfC0IQykrwQf4Z7HEKL1p+Tow== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000110, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Wed, Dec 18, 2024 at 07:56:19PM -0500, Gregory Price wrote: > On Tue, Dec 17, 2024 at 08:19:56PM -0800, David Rientjes wrote: > > ----->o----- > > Raghu noted the current promotion destination is node 0 by default. Wei > > noted we could get some page owner information to determine things like > > mempolicies or compute the distance between nodes and, if multiple nodes > > have the same distance, choose one of them just as we do for demotions. > > > > Gregory Price noted some downsides to using mempolicies for this based on > > per-task, per-vma, and cross socket policies, so using the kernel's > > memory tiering policies is probably the best way to go about it. > > > > Slightly elaborating here: > - In an async context, associating a page with a specific task is not > presently possible (that I know of). The most we know is the last > accessing CPU - maybe - in the page/folio struct. Right now this > is disabled in favor of a timestamp when tiering is enabled. > > a process with 2 tasks which have access to the page may not run > on the same socket, so we run the risk of migrating to a bad target. > Best effort here would suggest either socket is fine - since they're > both "fast nodes" - but this requires that we record the last > accessing CPU for a page at identification time. > This can be sovled with a two steps migration: first, you promote the page from CXL to a NUMA node, then you rely on NUMA balancing to further place the page into the right NUMA node. NUMA hint faults can still be enabled for pages allocated from NUMA nodes, but not for CXL. Best Karim Edinburgh University