From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-12.7 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E9D3EC4743C for ; Mon, 21 Jun 2021 19:58:45 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 5FB9B61151 for ; Mon, 21 Jun 2021 19:58:45 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5FB9B61151 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id E52CC6B0082; Mon, 21 Jun 2021 15:58:44 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E02426B0083; Mon, 21 Jun 2021 15:58:44 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C54A06B0085; Mon, 21 Jun 2021 15:58:44 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0254.hostedemail.com [216.40.44.254]) by kanga.kvack.org (Postfix) with ESMTP id 926E56B0082 for ; Mon, 21 Jun 2021 15:58:44 -0400 (EDT) Received: from smtpin32.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 358C6230F8 for ; Mon, 21 Jun 2021 19:58:44 +0000 (UTC) X-FDA: 78278793768.32.A921E84 Received: from mail-ed1-f41.google.com (mail-ed1-f41.google.com [209.85.208.41]) by imf08.hostedemail.com (Postfix) with ESMTP id E34D78019379 for ; Mon, 21 Jun 2021 19:58:43 +0000 (UTC) Received: by mail-ed1-f41.google.com with SMTP id h2so7102908edt.3 for ; Mon, 21 Jun 2021 12:58:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=5nJUpHP+AKihPa1AMQgTqjUmqOCaeDAFIm1TGWnbwME=; b=f2AfD7kVvkp/LYrP9U6dcQrH5JC0xZ0UeBZ4N3IHgdBydSm4s7fU8F5c8D+ra3kB72 JpUOZ1pV3Um2om0Egl3SFMr7g4mCO6+vKbom/4KFblyiXwBVlVwE8fCyTr/b3wkSIPlV hqi1PUBNinrL8W7L9eXfdrzo8KT8fuoOSFm/IQWZAA/ojnayzB2nc9T2OGvOOhawRKkX eOrQluipaqH+TiT8/F1T9Yj2RT2LVRXelPTCH7FaUIo36Mhqb0810R0dZjBGAIJ5SNTm qsJPUeZ1LKHiQZM4TFcC5Sq9Uj8ulziU+IAxguA3yvPmLBFqOem9LBuHWOmwGXKeCpf0 1jgA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=5nJUpHP+AKihPa1AMQgTqjUmqOCaeDAFIm1TGWnbwME=; b=dm7utWfy5ZLySgBV/+VLUbU3SlOTvShEdcoW7YEq4fZubdbvjU4bgcH1lEFtROGu/x Lly2YhtBe+fMIqR5ga+OsJqxpU0VSJ0Q+nnA6AU8gZetq5flL0A766SUSsm5/CMnB8Eu EJI4I8VQA/83Fmdazd4E9xNmdcdx62VrMs4dv8B8ijtDIYa8jmjHIbFVRqLSuX5qbSZF LdmBylt1Y2J5t1+L9DPqFE5JCd0MJPz9ao1F+/l1SP2Md7Yp3IWn+p3eITu58+fXZuiO pCnUowqlFFcb9wtwT+6lc6k87aTRWCqY6mRYI/UUBNo0MZSBopY826kFO9VUjxBu89Yf Taxg== X-Gm-Message-State: AOAM531ag8ROsiawDE2nbzMXpWxUsNrSVdwM9nwHxWfJ2+ZPgH4MKFHF MOxPLEiKJQAh9MoVPK56SipHZprvxMo/RX9pGUM= X-Google-Smtp-Source: ABdhPJyaXn1GqbXRnk1Zz2C9ltvZcEDBV6SE7Tc2YfENQCzZKQ6stR79fUH5YB9RgypEkpqHa/SrhplG+VD2RCTH5fo= X-Received: by 2002:a05:6402:42d2:: with SMTP id i18mr117206edc.168.1624305522539; Mon, 21 Jun 2021 12:58:42 -0700 (PDT) MIME-Version: 1.0 References: <20210618061537.434999-1-ying.huang@intel.com> <20210618061537.434999-6-ying.huang@intel.com> <88CFDFA7-70E1-4C26-B9CF-7A0CEFEB035A@nvidia.com> <874kdupab0.fsf@yhuang6-desk2.ccr.corp.intel.com> In-Reply-To: <874kdupab0.fsf@yhuang6-desk2.ccr.corp.intel.com> From: Yang Shi Date: Mon, 21 Jun 2021 12:58:30 -0700 Message-ID: Subject: Re: [PATCH -V8 05/10] mm/migrate: demote pages during reclaim To: "Huang, Ying" Cc: Zi Yan , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Dave Hansen , Michal Hocko , Wei Xu , Yang Shi , David Rientjes , Dan Williams , osalvador , Minchan Kim Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Authentication-Results: imf08.hostedemail.com; dkim=pass header.d=gmail.com header.s=20161025 header.b=f2AfD7kV; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf08.hostedemail.com: domain of shy828301@gmail.com designates 209.85.208.41 as permitted sender) smtp.mailfrom=shy828301@gmail.com X-Rspamd-Server: rspam02 X-Stat-Signature: 8kwz39riyodhsurrbinqxsxyzcdnbert X-Rspamd-Queue-Id: E34D78019379 X-HE-Tag: 1624305523-540635 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Sat, Jun 19, 2021 at 12:45 AM Huang, Ying wrote: > > Zi Yan writes: > > > On 18 Jun 2021, at 2:15, Huang Ying wrote: > > > >> From: Dave Hansen > >> > >> This is mostly derived from a patch from Yang Shi: > >> > >> https://lore.kernel.org/linux-mm/1560468577-101178-10-git-send-em= ail-yang.shi@linux.alibaba.com/ > >> > >> Add code to the reclaim path (shrink_page_list()) to "demote" data > >> to another NUMA node instead of discarding the data. This always > >> avoids the cost of I/O needed to read the page back in and sometimes > >> avoids the writeout cost when the pagee is dirty. > >> > >> A second pass through shrink_page_list() will be made if any demotions > >> fail. This essentally falls back to normal reclaim behavior in the > >> case that demotions fail. Previous versions of this patch may have > >> simply failed to reclaim pages which were eligible for demotion but > >> were unable to be demoted in practice. > >> > >> Note: This just adds the start of infratructure for migration. It is > >> actually disabled next to the FIXME in migrate_demote_page_ok(). > >> > >> Signed-off-by: Dave Hansen > >> Signed-off-by: "Huang, Ying" > >> Cc: Michal Hocko > >> Cc: Wei Xu > >> Cc: Yang Shi > >> Cc: David Rientjes > >> Cc: Dan Williams > >> Cc: osalvador > >> > >> -- > >> changes from 20210122: > >> * move from GFP_HIGHUSER -> GFP_HIGHUSER_MOVABLE (Ying) > >> > >> changes from 202010: > >> * add MR_NUMA_MISPLACED to trace MIGRATE_REASON define > >> * make migrate_demote_page_ok() static, remove 'sc' arg until > >> later patch > >> * remove unnecessary alloc_demote_page() hugetlb warning > >> * Simplify alloc_demote_page() gfp mask. Depend on > >> __GFP_NORETRY to make it lightweight instead of fancier > >> stuff like leaving out __GFP_IO/FS. > >> * Allocate migration page with alloc_migration_target() > >> instead of allocating directly. > >> changes from 20200730: > >> * Add another pass through shrink_page_list() when demotion > >> fails. > >> changes from 20210302: > >> * Use __GFP_THISNODE and revise the comment explaining the > >> GFP mask constructionn > >> --- > >> include/linux/migrate.h | 9 ++++ > >> include/trace/events/migrate.h | 3 +- > >> mm/vmscan.c | 83 +++++++++++++++++++++++++++++++++= + > >> 3 files changed, 94 insertions(+), 1 deletion(-) > >> > >> diff --git a/include/linux/migrate.h b/include/linux/migrate.h > >> index 4a49bb358787..42952cbe452b 100644 > >> --- a/include/linux/migrate.h > >> +++ b/include/linux/migrate.h > >> @@ -28,6 +28,7 @@ enum migrate_reason { > >> MR_NUMA_MISPLACED, > >> MR_CONTIG_RANGE, > >> MR_LONGTERM_PIN, > >> + MR_DEMOTION, > >> MR_TYPES > >> }; > >> > >> @@ -191,6 +192,14 @@ struct migrate_vma { > >> int migrate_vma_setup(struct migrate_vma *args); > >> void migrate_vma_pages(struct migrate_vma *migrate); > >> void migrate_vma_finalize(struct migrate_vma *migrate); > >> +int next_demotion_node(int node); > >> + > >> +#else /* CONFIG_MIGRATION disabled: */ > >> + > >> +static inline int next_demotion_node(int node) > >> +{ > >> + return NUMA_NO_NODE; > >> +} > >> > >> #endif /* CONFIG_MIGRATION */ > >> > >> diff --git a/include/trace/events/migrate.h b/include/trace/events/mig= rate.h > >> index 9fb2a3bbcdfb..779f3fad9ecd 100644 > >> --- a/include/trace/events/migrate.h > >> +++ b/include/trace/events/migrate.h > >> @@ -21,7 +21,8 @@ > >> EM( MR_MEMPOLICY_MBIND, "mempolicy_mbind") \ > >> EM( MR_NUMA_MISPLACED, "numa_misplaced") \ > >> EM( MR_CONTIG_RANGE, "contig_range") \ > >> - EMe(MR_LONGTERM_PIN, "longterm_pin") > >> + EM( MR_LONGTERM_PIN, "longterm_pin") \ > >> + EMe(MR_DEMOTION, "demotion") > >> > >> /* > >> * First define the enums in the above macros to be exported to users= pace > >> diff --git a/mm/vmscan.c b/mm/vmscan.c > >> index 5199b9696bab..ddda32031f0c 100644 > >> --- a/mm/vmscan.c > >> +++ b/mm/vmscan.c > >> @@ -41,6 +41,7 @@ > >> #include > >> #include > >> #include > >> +#include > >> #include > >> #include > >> #include > >> @@ -1231,6 +1232,23 @@ static enum page_references page_check_referenc= es(struct page *page, > >> return PAGEREF_RECLAIM; > >> } > >> > >> +static bool migrate_demote_page_ok(struct page *page) > >> +{ > >> + int next_nid =3D next_demotion_node(page_to_nid(page)); > >> + > >> + VM_BUG_ON_PAGE(!PageLocked(page), page); > >> + VM_BUG_ON_PAGE(PageHuge(page), page); > >> + VM_BUG_ON_PAGE(PageLRU(page), page); > >> + > >> + if (next_nid =3D=3D NUMA_NO_NODE) > >> + return false; > >> + if (PageTransHuge(page) && !thp_migration_supported()) > >> + return false; > >> + > >> + // FIXME: actually enable this later in the series > >> + return false; > >> +} > >> + > >> /* Check if a page is dirty or under writeback */ > >> static void page_check_dirty_writeback(struct page *page, > >> bool *dirty, bool *writeback) > >> @@ -1261,6 +1279,47 @@ static void page_check_dirty_writeback(struct p= age *page, > >> mapping->a_ops->is_dirty_writeback(page, dirty, writeback= ); > >> } > >> > >> +static struct page *alloc_demote_page(struct page *page, unsigned lon= g node) > >> +{ > >> + struct migration_target_control mtc =3D { > >> + /* > >> + * Allocate from 'node', or fail the quickly and quietly. > >> + * When this happens, 'page; will likely just be discarde= d > >> + * instead of migrated. > >> + */ > >> + .gfp_mask =3D (GFP_HIGHUSER_MOVABLE & ~__GFP_RECLAIM) | > >> + __GFP_THISNODE | __GFP_NOWARN | > >> + __GFP_NOMEMALLOC | GFP_NOWAIT, > >> + .nid =3D node > >> + }; > >> + > >> + return alloc_migration_target(page, (unsigned long)&mtc); > >> +} > >> + > >> +/* > >> + * Take pages on @demote_list and attempt to demote them to > >> + * another node. Pages which are not demoted are left on > >> + * @demote_pages. > >> + */ > >> +static unsigned int demote_page_list(struct list_head *demote_pages, > >> + struct pglist_data *pgdat, > >> + struct scan_control *sc) > >> +{ > >> + int target_nid =3D next_demotion_node(pgdat->node_id); > >> + unsigned int nr_succeeded =3D 0; > >> + int err; > >> + > >> + if (list_empty(demote_pages)) > >> + return 0; > >> + > >> + /* Demotion ignores all cpuset and mempolicy settings */ > >> + err =3D migrate_pages(demote_pages, alloc_demote_page, NULL, > >> + target_nid, MIGRATE_ASYNC, MR_DEMOTION, > >> + &nr_succeeded); > >> + > >> + return nr_succeeded; > >> +} > >> + > >> /* > >> * shrink_page_list() returns the number of reclaimed pages > >> */ > >> @@ -1272,12 +1331,15 @@ static unsigned int shrink_page_list(struct li= st_head *page_list, > >> { > >> LIST_HEAD(ret_pages); > >> LIST_HEAD(free_pages); > >> + LIST_HEAD(demote_pages); > >> unsigned int nr_reclaimed =3D 0; > >> unsigned int pgactivate =3D 0; > >> + bool do_demote_pass =3D true; > >> > >> memset(stat, 0, sizeof(*stat)); > >> cond_resched(); > >> > >> +retry: > >> while (!list_empty(page_list)) { > >> struct address_space *mapping; > >> struct page *page; > >> @@ -1426,6 +1488,16 @@ static unsigned int shrink_page_list(struct lis= t_head *page_list, > >> ; /* try to reclaim the page below */ > >> } > >> > >> + /* > >> + * Before reclaiming the page, try to relocate > >> + * its contents to another node. > >> + */ > >> + if (do_demote_pass && migrate_demote_page_ok(page)) { > >> + list_add(&page->lru, &demote_pages); > >> + unlock_page(page); > >> + continue; > >> + } > >> + > >> /* > >> * Anonymous process memory has backing store? > >> * Try to allocate it some swap space here. > >> @@ -1676,6 +1748,17 @@ static unsigned int shrink_page_list(struct lis= t_head *page_list, > >> list_add(&page->lru, &ret_pages); > >> VM_BUG_ON_PAGE(PageLRU(page) || PageUnevictable(page), pa= ge); > >> } > >> + /* 'page_list' is always empty here */ > >> + > >> + /* Migrate pages selected for demotion */ > >> + nr_reclaimed +=3D demote_page_list(&demote_pages, pgdat, sc); > >> + /* Pages that could not be demoted are still in @demote_pages */ > >> + if (!list_empty(&demote_pages)) { > >> + /* Pages which failed to demoted go back on @page_list fo= r retry: */ > >> + list_splice_init(&demote_pages, page_list); > >> + do_demote_pass =3D false; > >> + goto retry; > >> + } > >> > >> pgactivate =3D stat->nr_activate[0] + stat->nr_activate[1]; > >> > >> -- > >> 2.30.2 > > > > shrink_page_list() is also used by reclaim_pages(), which is called by > > madvise(MADV_PAGEOUT). This patch changes the semantics of madvise(MADV= _PAGEOUT) > > from =E2=80=9Creclaim a given range of pages=E2=80=9D to migrate the gi= ven pages to lower > > tier memory or reclaim them if the migration fails. You might want to c= heck > > the caller of shrink_page_list() to avoid changing madvise(MADV_PAGEOUT= ) > > semantics. > > Thanks for pointing this out! > > Literally, PAGEOUT means writing the page to the disk instead of > migrating pages to the lower tier. So it seems reasonable to make it > keep the original behavior instead of demoting even if in the tiered > memory system. > > If nobody objects, I will change this in the next version. I don't have a strong opinion on this. But I just thought why not let PAGEOUT do demotion if tier'ed memory is available and the "migration in lieu of discard" behavior is opt'ed in by a knob and we keep the consistency between passive reclaim and proactive reclaim. > > Best Regards, > Huang, Ying >