From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C1DF2C433F5 for ; Fri, 22 Apr 2022 17:32:11 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 3EEB66B0073; Fri, 22 Apr 2022 13:32:11 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 378A66B0074; Fri, 22 Apr 2022 13:32:11 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 217296B0075; Fri, 22 Apr 2022 13:32:11 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (relay.hostedemail.com [64.99.140.26]) by kanga.kvack.org (Postfix) with ESMTP id 13ECE6B0073 for ; Fri, 22 Apr 2022 13:32:11 -0400 (EDT) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay11.hostedemail.com (Postfix) with ESMTP id ABE2380A1F for ; Fri, 22 Apr 2022 17:32:10 +0000 (UTC) X-FDA: 79385208420.30.E5B5BDF Received: from mail-pf1-f182.google.com (mail-pf1-f182.google.com [209.85.210.182]) by imf23.hostedemail.com (Postfix) with ESMTP id 4CE8714002A for ; Fri, 22 Apr 2022 17:32:07 +0000 (UTC) Received: by mail-pf1-f182.google.com with SMTP id z16so8626259pfh.3 for ; Fri, 22 Apr 2022 10:32:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=bTx9j6um++bDvPzngdWfztBTWMSm5Y4kGTKyaYCvWJA=; b=GawO1yJAJrxBdODI2xKPb6ONjN181mj1BvSw15s51XVSw+bHIkn6QEWm4FY7vQ8BSf KUGpARxzDIm6O0PIGm9sk0jFAEFcC9gCkD0w3XoD3bEvtljZ0NHT9DHP1a6Z9nCKwK2s eNSpY7SBmV3WGCAyKJmYxT02DDLgNtWDUB8CHeBMbQqnCpc8HUWwYDSQBsRs4eXIiPE3 V/J7IR3NDraoYA2LVarFTf2Tf0EwFnTDxSGJ357fl8YZsyuEOOo1p3XNqvHQCK6tcTO0 BEPCriGAGadBvtg0+uRoRckN8aAk85fCdz0Yvcahz0qaZGgRXYBXbni3tt7TwLeie+yZ pVeA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=bTx9j6um++bDvPzngdWfztBTWMSm5Y4kGTKyaYCvWJA=; b=kPS+A0ZxtuNti8t0MBN3tlXYgyxie+AzPl48i/oBVkEoC4lCwj28SJ+KwKZLUH5YX8 /wKaEkXwEMlArgurp0YczIDlONRTrtQD5eKkb8d+gQKEREcfRFS67RBhbPwzzH/ywYDl c/iFfbZVk9Jc85ibIiSV+NmHQn/ufnRifibA6TJKsz72zqZdylj6gUPKLwBPykDmFv6K s0tMvB2w79XyoOIRiFh0IiIxtL40GvP6saYI4f/pBG2T5wQmX5QdaGwoNa3905KysGYl YXxezuIwO2R8pHW/O3r40e03TeK4em+i7lpzzp6t5ejj0/8A6YoP+LJ+1dl4S0vpMM+Q 7luw== X-Gm-Message-State: AOAM530FEW2ik6BmthfV/YTHBRA2yZbKBr/itJ2H5qGU8z2tkMTOpWKw qVBkGeG91poMRf0zDDFvEoGX0e49+ey3ZtHHWq60r0PaorE= X-Google-Smtp-Source: ABdhPJwt2+2ZOpnouIOeQ4yI8QwOAwZ0wMwJHawmc2MnYo2JfXzrJf207yutiEaSFTqpBg4LFWhL2K55GE2rsvJxEXw= X-Received: by 2002:a05:6a00:bd1:b0:505:79c7:75f6 with SMTP id x17-20020a056a000bd100b0050579c775f6mr5889282pfu.23.1650648728728; Fri, 22 Apr 2022 10:32:08 -0700 (PDT) MIME-Version: 1.0 References: <20220416053902.68517-1-dave@stgolabs.net> <20220416053902.68517-6-dave@stgolabs.net> In-Reply-To: <20220416053902.68517-6-dave@stgolabs.net> From: Yang Shi Date: Fri, 22 Apr 2022 10:31:56 -0700 Message-ID: Subject: Re: [PATCH 5/6] mm/migration: export demotion_path of a node via sysfs To: Davidlohr Bueso Cc: linux-mm@kvack.org, mhocko@kernel.org, akpm@linux-foundation.org, rientjes@google.com, yosryahmed@google.com, hannes@cmpxchg.org, shakeelb@google.com, dave.hansen@linux.intel.com, tim.c.chen@linux.intel.com, roman.gushchin@linux.dev, gthelen@google.com, a.manzanares@samsung.com, heekwon.p@samsung.com, gim.jongmin@samsung.com, linux-kernel@vger.kernel.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: 4CE8714002A Authentication-Results: imf23.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=GawO1yJA; spf=pass (imf23.hostedemail.com: domain of shy828301@gmail.com designates 209.85.210.182 as permitted sender) smtp.mailfrom=shy828301@gmail.com; dmarc=pass (policy=none) header.from=gmail.com X-Rspam-User: X-Stat-Signature: q6xm9kbz9a7g7h6h5cog5bah6r4no5ew X-HE-Tag: 1650648727-103486 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, Apr 15, 2022 at 10:39 PM Davidlohr Bueso wrote: > > Add a /sys/devices/system/node/nodeX/demotion_path file > to export the possible target(s) in node_demotion[node]. I'm not sure if you noticed that Jagdish Gediya is working on the similar patch, please see https://lore.kernel.org/linux-mm/20220413092206.73974-1-jvgediya@linux.ibm.com/ It would be better to combine the two to avoid duplicate effort. > > Signed-off-by: Davidlohr Bueso > --- > Documentation/ABI/stable/sysfs-devices-node | 6 ++++ > drivers/base/node.c | 39 +++++++++++++++++++++ > include/linux/migrate.h | 15 ++++++++ > mm/migrate.c | 15 +------- > 4 files changed, 61 insertions(+), 14 deletions(-) > > diff --git a/Documentation/ABI/stable/sysfs-devices-node b/Documentation/ABI/stable/sysfs-devices-node > index 3c935e1334f7..f620c6ae013c 100644 > --- a/Documentation/ABI/stable/sysfs-devices-node > +++ b/Documentation/ABI/stable/sysfs-devices-node > @@ -192,3 +192,9 @@ Description: > When it completes successfully, the specified amount or more memory > will have been reclaimed, and -EAGAIN if less bytes are reclaimed > than the specified amount. > + > +What: /sys/devices/system/node/nodeX/demotion_path > +Date: April 2022 > +Contact: Davidlohr Bueso > +Description: > + Shows nodes within the next tier of slower memory below this node. > diff --git a/drivers/base/node.c b/drivers/base/node.c > index d80c478e2a6e..ab4bae777535 100644 > --- a/drivers/base/node.c > +++ b/drivers/base/node.c > @@ -17,6 +17,7 @@ > #include > #include > #include > +#include > #include > #include > #include > @@ -560,11 +561,49 @@ static ssize_t node_read_distance(struct device *dev, > } > static DEVICE_ATTR(distance, 0444, node_read_distance, NULL); > > +static ssize_t node_read_demotion_path(struct device *dev, > + struct device_attribute *attr, char *buf) > +{ > + int nid = dev->id; > + int len = 0; > + int i; > + struct demotion_nodes *nd; > + > + /* > + * buf is currently PAGE_SIZE in length and each node needs 4 chars > + * at the most (target + space or newline). > + */ > + BUILD_BUG_ON(MAX_NUMNODES * 4 > PAGE_SIZE); > + > + if (!node_demotion) { > + len += sysfs_emit_at(buf, len, "%d", NUMA_NO_NODE); > + goto done; > + } > + > + nd = &node_demotion[nid]; > + > + rcu_read_lock(); > + if (nd->nr == 0) > + len += sysfs_emit_at(buf, len, "%d", NUMA_NO_NODE); > + else { > + for (i = 0; i < nd->nr; i++) { > + len += sysfs_emit_at(buf, len, "%s%d", > + i ? " " : "", nd->nodes[i]); > + } > + } > + rcu_read_unlock(); > +done: > + len += sysfs_emit_at(buf, len, "\n"); > + return len; > +} > +static DEVICE_ATTR(demotion_path, 0444, node_read_demotion_path, NULL); > + > static struct attribute *node_dev_attrs[] = { > &dev_attr_meminfo.attr, > &dev_attr_numastat.attr, > &dev_attr_distance.attr, > &dev_attr_vmstat.attr, > + &dev_attr_demotion_path.attr, > NULL > }; > > diff --git a/include/linux/migrate.h b/include/linux/migrate.h > index 90e75d5a54d6..b0ac6a717e44 100644 > --- a/include/linux/migrate.h > +++ b/include/linux/migrate.h > @@ -111,6 +111,21 @@ static inline int migrate_misplaced_page(struct page *page, > } > #endif /* CONFIG_NUMA_BALANCING */ > > +#define DEFAULT_DEMOTION_TARGET_NODES 15 > + > +#if MAX_NUMNODES < DEFAULT_DEMOTION_TARGET_NODES > +#define DEMOTION_TARGET_NODES (MAX_NUMNODES - 1) > +#else > +#define DEMOTION_TARGET_NODES DEFAULT_DEMOTION_TARGET_NODES > +#endif > + > +struct demotion_nodes { > + unsigned short nr; > + short nodes[DEMOTION_TARGET_NODES]; > +}; > + > +extern struct demotion_nodes *node_demotion __read_mostly; > + > #ifdef CONFIG_MIGRATION > > /* > diff --git a/mm/migrate.c b/mm/migrate.c > index 6c31ee1e1c9b..e47ea25fcfe8 100644 > --- a/mm/migrate.c > +++ b/mm/migrate.c > @@ -2172,20 +2172,7 @@ int migrate_misplaced_page(struct page *page, struct vm_area_struct *vma, > * must be held over all reads to ensure that no cycles are > * observed. > */ > -#define DEFAULT_DEMOTION_TARGET_NODES 15 > - > -#if MAX_NUMNODES < DEFAULT_DEMOTION_TARGET_NODES > -#define DEMOTION_TARGET_NODES (MAX_NUMNODES - 1) > -#else > -#define DEMOTION_TARGET_NODES DEFAULT_DEMOTION_TARGET_NODES > -#endif > - > -struct demotion_nodes { > - unsigned short nr; > - short nodes[DEMOTION_TARGET_NODES]; > -}; > - > -static struct demotion_nodes *node_demotion __read_mostly; > +struct demotion_nodes *node_demotion __read_mostly; > > /** > * next_demotion_node() - Get the next node in the demotion path > -- > 2.26.2 > >