From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B518FC54E71 for ; Thu, 22 May 2025 03:08:23 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D522A6B0082; Wed, 21 May 2025 23:08:22 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id D03CB6B0083; Wed, 21 May 2025 23:08:22 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C19246B0085; Wed, 21 May 2025 23:08:22 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id A12536B0082 for ; Wed, 21 May 2025 23:08:22 -0400 (EDT) Received: from smtpin20.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id C01B0E8006 for ; Thu, 22 May 2025 03:08:21 +0000 (UTC) X-FDA: 83469060402.20.A592C2F Received: from mail-qv1-f47.google.com (mail-qv1-f47.google.com [209.85.219.47]) by imf14.hostedemail.com (Postfix) with ESMTP id C292F10000F for ; Thu, 22 May 2025 03:08:19 +0000 (UTC) Authentication-Results: imf14.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b=LDg0fH5j; spf=pass (imf14.hostedemail.com: domain of gourry@gourry.net designates 209.85.219.47 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1747883299; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=AGVNczz6qr4dQlYUXeVEe2dNVe5Hjh6BmJ07Zb+P3ZI=; b=THy5ZtGOtdjkGd7I7wIpmECIED5PvxhRqgxc8gXYTJl2z6cEEXYFUAE0vMjwXDBgF2cDgT pUX/qQs+i1amkLcMv5ydVTqPPd9RaPwmjlUNfSSED97kVsL3mAXaioFAjd8Jz1KnZeUCLe xAjiP6qvsnH/6/zSByYsHF9tRi1jbug= ARC-Authentication-Results: i=1; imf14.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b=LDg0fH5j; spf=pass (imf14.hostedemail.com: domain of gourry@gourry.net designates 209.85.219.47 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1747883299; a=rsa-sha256; cv=none; b=ztMOAQA2mLliwXVB7xL4Z3FFa07uTJKLlgn3DBbTY9FpYd8q1659ROAe+kL7BMqOFdXnZx bIQ8xL4nm9dcu+4lV8V8NiPkUPoz4AdGer+FecJsWE4i+9n9iehIh2eLb3jZHn0k/zH2Td o4cAGO3nTlKqH3zdUQpUUnNdXx5LwyU= Received: by mail-qv1-f47.google.com with SMTP id 6a1803df08f44-6f8b27c2d7bso77905856d6.1 for ; Wed, 21 May 2025 20:08:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gourry.net; s=google; t=1747883299; x=1748488099; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=AGVNczz6qr4dQlYUXeVEe2dNVe5Hjh6BmJ07Zb+P3ZI=; b=LDg0fH5jNtIfrdUhWQcZumOK/11+d63/PPtDDMGisJhZk5/TrVQNLQjKVAGWKKm0Uo rBouhi1IUayMzoY34AfawcYO086HuvAZijpFjxrc97tQbIttriPHqLgF2/JGpKC+G5G4 0PjTWypsNnBW1nxO1wZpLQbaZpAsJp9U7eZytJTvBBg2NaB003vrJ3yt6Amf1T1EtEz9 PwSvSwGNsUyP7BdfwzAPIiOOfxGvMOGs+1bUY9ZK6M9Zo5AJ5iEwLmOyXQn6Pg7St1AQ 2hj9GqrvtvbjzpYM6LfjMa+78ev3zQR+XNxpcq6v//5ncrv0cpibWmxJoLXtkdhjkBvA /AdQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1747883299; x=1748488099; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=AGVNczz6qr4dQlYUXeVEe2dNVe5Hjh6BmJ07Zb+P3ZI=; b=We4ItabGhgupNfY6S2iqwYAAkQNa02Xl+CzhdA2ncXD+tWW9GtE/q+e55GPPnLHhnz 0/Mnw0AWQv7WwTUKHsiV8HvUfPAHjIZ2Ug5UCW4h1AC7l1atqGCnT6RXNykQkdPx9lsj oJtZpXr6Tse01/a9wFLvCviu/YLOz8PwSIGpKeyf/zCi5cHATSywtBt4qMc43/gjmR5B p7XwNkmt04Eo3h4ECueDbu/gLIiULgYor/E0xEFwQPDVwNjy3owUnlgV0Khx4P/ZQ/Ci 2Fj4Hfwdo6jiOCw2+3MmiHlYfzZszvRx1DbhRsXDEvDEwlUx96/Vr2UUCPsFegAghTNx x5rw== X-Forwarded-Encrypted: i=1; AJvYcCU4YZ627Lh+6JLJSsJkuQY5aEEVZstDC9wXUsj9pcI40cxCdVnCmmW/h19WYaUFkL02G2cbMYRTKw==@kvack.org X-Gm-Message-State: AOJu0YzQlPu/4KT2SXnFJmhDbwTXrmYb30kT09rnCy0XQwKCnNFCtpyB R85SHnU8RtPYCROhe0/SoNeva00Wo3rtyJOYvGPCZINFk/XI0p2gGAE/MKZQ/32NTG4= X-Gm-Gg: ASbGncuyTUmQWcKK9TexKIZ73PM2BsBa9MFQA0bEFCidP4AVh+eOegcWaiHZ3ZpY5o5 59MTgh6s+mCO8De6fFospUZKdFy6bYW2oafhlqS0KaCa6Dvy2J+rQbiEtsod35j69UkSvtznyIX +ZneDoibkZggVewU+5kPbIBHzrQ9U/joxOczx5pQAD1UFhZ6Erk3Wub6YGi2UfhcX8FztoZwgi/ tyM3pmKB2Lj6VvrJ56bqvumwhB+Ef75lcR9nYP7tqq7OqeHmwZbgSS9eQhanjz/+JsnoFbJ1j6B 5nX0P1B7Z/WTSFBHM8CmLdL7cMP6zQ5iIeOCsCmoB0KX4kEgJg6PFqSN7+ORqAz9MTwg3letYbz 4VkKJX7mH+15d7hGOTDf+STVUyA6xrX8= X-Google-Smtp-Source: AGHT+IFSrnLEH05GG4SlQC5J9N13ka7pCoc3hDoinN3MroPbkQgIIeIPHyBXTSm1kxX304ReSIUJhg== X-Received: by 2002:a05:6214:da2:b0:6e8:89bd:2b50 with SMTP id 6a1803df08f44-6f8b2cb9a48mr380561136d6.7.1747883298782; Wed, 21 May 2025 20:08:18 -0700 (PDT) Received: from gourry-fedora-PF4VCD3F (pool-96-255-20-42.washdc.ftas.verizon.net. [96.255.20.42]) by smtp.gmail.com with ESMTPSA id 6a1803df08f44-6f8b584bb4bsm86728866d6.68.2025.05.21.20.08.17 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 21 May 2025 20:08:18 -0700 (PDT) Date: Wed, 21 May 2025 23:08:16 -0400 From: Gregory Price To: SeongJae Park Cc: Bharata B Rao , linux-kernel@vger.kernel.org, linux-mm@kvack.org, Jonathan.Cameron@huawei.com, dave.hansen@intel.com, hannes@cmpxchg.org, mgorman@techsingularity.net, mingo@redhat.com, peterz@infradead.org, raghavendra.kt@amd.com, riel@surriel.com, rientjes@google.com, weixugc@google.com, willy@infradead.org, ying.huang@linux.alibaba.com, ziy@nvidia.com, dave@stgolabs.net, nifan.cxl@gmail.com, joshua.hahnjy@gmail.com, xuezhengchu@huawei.com, yiannis@zptcorp.com, akpm@linux-foundation.org, david@redhat.com Subject: Re: [RFC PATCH v0 0/2] Batch migration for NUMA balancing Message-ID: References: <20250521080238.209678-1-bharata@amd.com> <20250521184552.46414-1-sj@kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20250521184552.46414-1-sj@kernel.org> X-Rspamd-Server: rspam01 X-Rspamd-Queue-Id: C292F10000F X-Stat-Signature: p4uy5nmkqiupt7fe5qumbyq4f71869u3 X-Rspam-User: X-HE-Tag: 1747883299-702193 X-HE-Meta: U2FsdGVkX19pOdoR+8SVj6HppLh8X3SE7lmWnnKhkejp9pNcvDivMK/OWWZSCfciEn+St7hZ4m049PzcUnok1c8MVIPJbMFosimNTEkuR7zrytD4GLBVw1bglEWRJJ1E3WWT+B6RRbKFr8zrl6CTeVHvaiK5YJqWIfLS0kGEY48lNNe/ogXXrkuxBhXFsvsgdemAdth/ZIQuFbnmJotHM+SM5xOfaY4iaM3yvu1k1JC3rzr5FW2ScX+Hl3o2ZDpuHKffF+GUZamuHY9vIlRi+MT+Sm+Ghx2mKFLlUOFLJfVeCR3+LJO1C6Iva4I/gjxkG1n+RlbpzzEz9y/urJRMs/JndsA0ynBxmMAVsVhAluIKu7wz6Yy8Hva5DyfQ4DLuGvgOSGxfI2xOE8eqAstqrLD9T34NSNpiwh9kqbYb2ql7bQ6GMNkf9OaBL8sk+jv/lCr3h67qPoS7uZH+4aXKeVuAwa3WJT3ieOtcNmQlAtwix+VNAzBLkTSy12MTTw5bKUgY9lsLkaWn6nuQRFEbw3lwG8H5Jo+Ya/38Sp+e6sjJTLkJC33NTDZ2fj9bt0X4TST85azFJotRWl7KhrG5dwpqKWY9/wWqX7kmxx+gdh4HqxVZw0cVeIfaF9pLgxh9zibDlGijP1wkzMqfJXECC/+hW0015zo91kCdr2gTiDeEUGN6HBZRXA8ChRi5JueHRodYbsy0Ai+aDlenITEMl7ErkZsuniljiydHxvjiF6qpM5dh5FwZ5Y2ERkuw/RPvH7gJBQ782o3BFTlZwg9YZyyxXe5OAFNTWkJiUZpt2XqP7+tyGa19roAAqd1PyAUY4KGjrJ3KZVBHnEVoKrWn+QO8AyESuxXgKzSWp+QNu3g9XQSt0cYVRdo8z1Er3O8LegB21Gi/f3bR99jBdpOJzfpHmB39tyhfTwDtrDjhJU7zynH7pCdeeCvqubDvxHwM7VnNSY0Onpu+IS3f40C HbmEN7KY SP/3gLmnvdz/es7YbMNbPLs0SEqPhralRmEWHQMCHE4dGVv6tzD11JAA5rsPySZrqP0ms+ap4xezWpUcbegG8QGVTK5yJxjjjFyUXMbPCgj7Xn0drBgcV59cAYV9XrbDeeeZfDAOy3R6Xl/8gkRWJ6FXZKawP1XvzSMvmg6tja9PCgOoDWUEEvp90FmnDvAyfpR2OlACEOIzfIXHe1Z8U59IXm9PjoGyafmx2iDhe2vUKhULclPsH1pGs3CT37x6w4q8m6f9DvM9qz5nAxBO90ayfdhSYSmfRa9tGj9q+fIS9Iclvvj8VnRurcy4w8baBA2+Fx4VE8Www11bWINqiWazM5yWHtdrFcJzm7IKI0lyNtTn8OkLutiUQv5aRJmSIOANWHpG6nOghS5ZkLp0QNMbZWcjkp6dlNo4hgbfR+EMKjSk= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Wed, May 21, 2025 at 11:45:52AM -0700, SeongJae Park wrote: > Hi Bharata, > > On Wed, 21 May 2025 13:32:36 +0530 Bharata B Rao wrote: > > > Hi, > > > > This is an attempt to convert the NUMA balancing to do batched > > migration instead of migrating one folio at a time. The basic > > idea is to collect (from hint fault handler) the folios to be > > migrated in a list and batch-migrate them from task_work context. > > More details about the specifics are present in patch 2/2. > > > > During LSFMM[1] and subsequent discussions in MM alignment calls[2], > > it was suggested that separate migration threads to handle migration > > or promotion request may be desirable. Existing NUMA balancing, hot > > page promotion and other future promotion techniques could off-load > > migration part to these threads. Or if we manage to have a single > > source of hotness truth like kpromoted[3], then that too can hand > > over migration requests to the migration threads. I am envisaging > > that different hotness sources like kmmscand[4], MGLRU[5], IBS[6] > > and CXL HMU would push hot page info to kpromoted, which would > > then isolate and push the folios to be promoted to the migrator > > thread. > > I think (or, hope) it would also be not very worthless or rude to mention other > existing and ongoing works that have potentials to serve for similar purpose or > collaborate in future, here. > > DAMON is designed for a sort of multi-source access information handling. In > LSFMM, I proposed[1] damon_report_access() interface for making it easier to be > extended for more types of access information. Currenlty damon_report_access() > is under early development. I think this has a potential to serve something > similar to your single source goal. > It seems to me that DAMON might make use of the batch migration interface, so if you need any changes or extensions, it might be good for you (SJ) to take a look at that for us. ~Gregory