From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.7 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4528CC48BC2 for ; Tue, 22 Jun 2021 02:09:58 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id D608E611C1 for ; Tue, 22 Jun 2021 02:09:57 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org D608E611C1 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=intel.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 3D5BB6B0036; Mon, 21 Jun 2021 22:09:57 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 386186B0062; Mon, 21 Jun 2021 22:09:57 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 227406B006C; Mon, 21 Jun 2021 22:09:57 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0142.hostedemail.com [216.40.44.142]) by kanga.kvack.org (Postfix) with ESMTP id E6E5D6B0036 for ; Mon, 21 Jun 2021 22:09:56 -0400 (EDT) Received: from smtpin17.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 805F8BF0B for ; Tue, 22 Jun 2021 02:09:56 +0000 (UTC) X-FDA: 78279729192.17.D557CE9 Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by imf22.hostedemail.com (Postfix) with ESMTP id 8ED34C00CBEF for ; Tue, 22 Jun 2021 02:09:53 +0000 (UTC) IronPort-SDR: 3hEm2L31OALjWH9Hwv/KykgQU2CV9ouLWfa/mPjUvPGHTGxXiUFckUlinu/EcHVGgf2BJ7pU5f +q+TStoioeYw== X-IronPort-AV: E=McAfee;i="6200,9189,10022"; a="206911890" X-IronPort-AV: E=Sophos;i="5.83,290,1616482800"; d="scan'208";a="206911890" Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by orsmga102.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 Jun 2021 19:09:50 -0700 IronPort-SDR: meKI+jnWwT2TMJQnw+gLzbq7z5IJ9kUJrLFHeN9HjBam1WvkDIp4X1E+V5LSY6Z7z731hAGVwW dD7bDpyN4h+A== X-IronPort-AV: E=Sophos;i="5.83,290,1616482800"; d="scan'208";a="556453672" Received: from yhuang6-desk2.sh.intel.com (HELO yhuang6-desk2.ccr.corp.intel.com) ([10.239.159.119]) by fmsmga001-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 21 Jun 2021 19:09:44 -0700 From: "Huang, Ying" To: Yang Shi Cc: Zi Yan , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Dave Hansen , Michal Hocko , Wei Xu , Yang Shi , David Rientjes , Dan Williams , osalvador , Minchan Kim Subject: Re: [PATCH -V8 05/10] mm/migrate: demote pages during reclaim References: <20210618061537.434999-1-ying.huang@intel.com> <20210618061537.434999-6-ying.huang@intel.com> <88CFDFA7-70E1-4C26-B9CF-7A0CEFEB035A@nvidia.com> <874kdupab0.fsf@yhuang6-desk2.ccr.corp.intel.com> Date: Tue, 22 Jun 2021 10:09:39 +0800 In-Reply-To: (Yang Shi's message of "Mon, 21 Jun 2021 12:58:30 -0700") Message-ID: <87o8bymyzg.fsf@yhuang6-desk2.ccr.corp.intel.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Authentication-Results: imf22.hostedemail.com; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=intel.com (policy=none); spf=none (imf22.hostedemail.com: domain of ying.huang@intel.com has no SPF policy when checking 134.134.136.24) smtp.mailfrom=ying.huang@intel.com X-Stat-Signature: tnkm47pq868ferieh83puey3hwjar1nq X-Rspamd-Queue-Id: 8ED34C00CBEF X-Rspamd-Server: rspam06 X-HE-Tag: 1624327793-984352 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Yang Shi writes: > On Sat, Jun 19, 2021 at 12:45 AM Huang, Ying wrote: >> >> Zi Yan writes: >> >> > On 18 Jun 2021, at 2:15, Huang Ying wrote: >> > >> >> From: Dave Hansen >> >> >> >> This is mostly derived from a patch from Yang Shi: >> >> >> >> https://lore.kernel.org/linux-mm/1560468577-101178-10-git-send-e= mail-yang.shi@linux.alibaba.com/ >> >> >> >> Add code to the reclaim path (shrink_page_list()) to "demote" data >> >> to another NUMA node instead of discarding the data. This always >> >> avoids the cost of I/O needed to read the page back in and sometimes >> >> avoids the writeout cost when the pagee is dirty. >> >> >> >> A second pass through shrink_page_list() will be made if any demotions >> >> fail. This essentally falls back to normal reclaim behavior in the >> >> case that demotions fail. Previous versions of this patch may have >> >> simply failed to reclaim pages which were eligible for demotion but >> >> were unable to be demoted in practice. >> >> >> >> Note: This just adds the start of infratructure for migration. It is >> >> actually disabled next to the FIXME in migrate_demote_page_ok(). >> >> >> >> Signed-off-by: Dave Hansen >> >> Signed-off-by: "Huang, Ying" >> >> Cc: Michal Hocko >> >> Cc: Wei Xu >> >> Cc: Yang Shi >> >> Cc: David Rientjes >> >> Cc: Dan Williams >> >> Cc: osalvador >> >> >> >> -- >> >> changes from 20210122: >> >> * move from GFP_HIGHUSER -> GFP_HIGHUSER_MOVABLE (Ying) >> >> >> >> changes from 202010: >> >> * add MR_NUMA_MISPLACED to trace MIGRATE_REASON define >> >> * make migrate_demote_page_ok() static, remove 'sc' arg until >> >> later patch >> >> * remove unnecessary alloc_demote_page() hugetlb warning >> >> * Simplify alloc_demote_page() gfp mask. Depend on >> >> __GFP_NORETRY to make it lightweight instead of fancier >> >> stuff like leaving out __GFP_IO/FS. >> >> * Allocate migration page with alloc_migration_target() >> >> instead of allocating directly. >> >> changes from 20200730: >> >> * Add another pass through shrink_page_list() when demotion >> >> fails. >> >> changes from 20210302: >> >> * Use __GFP_THISNODE and revise the comment explaining the >> >> GFP mask constructionn >> >> --- >> >> include/linux/migrate.h | 9 ++++ >> >> include/trace/events/migrate.h | 3 +- >> >> mm/vmscan.c | 83 ++++++++++++++++++++++++++++++++= ++ >> >> 3 files changed, 94 insertions(+), 1 deletion(-) >> >> >> >> diff --git a/include/linux/migrate.h b/include/linux/migrate.h >> >> index 4a49bb358787..42952cbe452b 100644 >> >> --- a/include/linux/migrate.h >> >> +++ b/include/linux/migrate.h >> >> @@ -28,6 +28,7 @@ enum migrate_reason { >> >> MR_NUMA_MISPLACED, >> >> MR_CONTIG_RANGE, >> >> MR_LONGTERM_PIN, >> >> + MR_DEMOTION, >> >> MR_TYPES >> >> }; >> >> >> >> @@ -191,6 +192,14 @@ struct migrate_vma { >> >> int migrate_vma_setup(struct migrate_vma *args); >> >> void migrate_vma_pages(struct migrate_vma *migrate); >> >> void migrate_vma_finalize(struct migrate_vma *migrate); >> >> +int next_demotion_node(int node); >> >> + >> >> +#else /* CONFIG_MIGRATION disabled: */ >> >> + >> >> +static inline int next_demotion_node(int node) >> >> +{ >> >> + return NUMA_NO_NODE; >> >> +} >> >> >> >> #endif /* CONFIG_MIGRATION */ >> >> >> >> diff --git a/include/trace/events/migrate.h b/include/trace/events/mi= grate.h >> >> index 9fb2a3bbcdfb..779f3fad9ecd 100644 >> >> --- a/include/trace/events/migrate.h >> >> +++ b/include/trace/events/migrate.h >> >> @@ -21,7 +21,8 @@ >> >> EM( MR_MEMPOLICY_MBIND, "mempolicy_mbind") \ >> >> EM( MR_NUMA_MISPLACED, "numa_misplaced") \ >> >> EM( MR_CONTIG_RANGE, "contig_range") \ >> >> - EMe(MR_LONGTERM_PIN, "longterm_pin") >> >> + EM( MR_LONGTERM_PIN, "longterm_pin") \ >> >> + EMe(MR_DEMOTION, "demotion") >> >> >> >> /* >> >> * First define the enums in the above macros to be exported to user= space >> >> diff --git a/mm/vmscan.c b/mm/vmscan.c >> >> index 5199b9696bab..ddda32031f0c 100644 >> >> --- a/mm/vmscan.c >> >> +++ b/mm/vmscan.c >> >> @@ -41,6 +41,7 @@ >> >> #include >> >> #include >> >> #include >> >> +#include >> >> #include >> >> #include >> >> #include >> >> @@ -1231,6 +1232,23 @@ static enum page_references page_check_referen= ces(struct page *page, >> >> return PAGEREF_RECLAIM; >> >> } >> >> >> >> +static bool migrate_demote_page_ok(struct page *page) >> >> +{ >> >> + int next_nid =3D next_demotion_node(page_to_nid(page)); >> >> + >> >> + VM_BUG_ON_PAGE(!PageLocked(page), page); >> >> + VM_BUG_ON_PAGE(PageHuge(page), page); >> >> + VM_BUG_ON_PAGE(PageLRU(page), page); >> >> + >> >> + if (next_nid =3D=3D NUMA_NO_NODE) >> >> + return false; >> >> + if (PageTransHuge(page) && !thp_migration_supported()) >> >> + return false; >> >> + >> >> + // FIXME: actually enable this later in the series >> >> + return false; >> >> +} >> >> + >> >> /* Check if a page is dirty or under writeback */ >> >> static void page_check_dirty_writeback(struct page *page, >> >> bool *dirty, bool *writeback) >> >> @@ -1261,6 +1279,47 @@ static void page_check_dirty_writeback(struct = page *page, >> >> mapping->a_ops->is_dirty_writeback(page, dirty, writebac= k); >> >> } >> >> >> >> +static struct page *alloc_demote_page(struct page *page, unsigned lo= ng node) >> >> +{ >> >> + struct migration_target_control mtc =3D { >> >> + /* >> >> + * Allocate from 'node', or fail the quickly and quietly. >> >> + * When this happens, 'page; will likely just be discard= ed >> >> + * instead of migrated. >> >> + */ >> >> + .gfp_mask =3D (GFP_HIGHUSER_MOVABLE & ~__GFP_RECLAIM) | >> >> + __GFP_THISNODE | __GFP_NOWARN | >> >> + __GFP_NOMEMALLOC | GFP_NOWAIT, >> >> + .nid =3D node >> >> + }; >> >> + >> >> + return alloc_migration_target(page, (unsigned long)&mtc); >> >> +} >> >> + >> >> +/* >> >> + * Take pages on @demote_list and attempt to demote them to >> >> + * another node. Pages which are not demoted are left on >> >> + * @demote_pages. >> >> + */ >> >> +static unsigned int demote_page_list(struct list_head *demote_pages, >> >> + struct pglist_data *pgdat, >> >> + struct scan_control *sc) >> >> +{ >> >> + int target_nid =3D next_demotion_node(pgdat->node_id); >> >> + unsigned int nr_succeeded =3D 0; >> >> + int err; >> >> + >> >> + if (list_empty(demote_pages)) >> >> + return 0; >> >> + >> >> + /* Demotion ignores all cpuset and mempolicy settings */ >> >> + err =3D migrate_pages(demote_pages, alloc_demote_page, NULL, >> >> + target_nid, MIGRATE_ASYNC, MR_DEMOTION, >> >> + &nr_succeeded); >> >> + >> >> + return nr_succeeded; >> >> +} >> >> + >> >> /* >> >> * shrink_page_list() returns the number of reclaimed pages >> >> */ >> >> @@ -1272,12 +1331,15 @@ static unsigned int shrink_page_list(struct l= ist_head *page_list, >> >> { >> >> LIST_HEAD(ret_pages); >> >> LIST_HEAD(free_pages); >> >> + LIST_HEAD(demote_pages); >> >> unsigned int nr_reclaimed =3D 0; >> >> unsigned int pgactivate =3D 0; >> >> + bool do_demote_pass =3D true; >> >> >> >> memset(stat, 0, sizeof(*stat)); >> >> cond_resched(); >> >> >> >> +retry: >> >> while (!list_empty(page_list)) { >> >> struct address_space *mapping; >> >> struct page *page; >> >> @@ -1426,6 +1488,16 @@ static unsigned int shrink_page_list(struct li= st_head *page_list, >> >> ; /* try to reclaim the page below */ >> >> } >> >> >> >> + /* >> >> + * Before reclaiming the page, try to relocate >> >> + * its contents to another node. >> >> + */ >> >> + if (do_demote_pass && migrate_demote_page_ok(page)) { >> >> + list_add(&page->lru, &demote_pages); >> >> + unlock_page(page); >> >> + continue; >> >> + } >> >> + >> >> /* >> >> * Anonymous process memory has backing store? >> >> * Try to allocate it some swap space here. >> >> @@ -1676,6 +1748,17 @@ static unsigned int shrink_page_list(struct li= st_head *page_list, >> >> list_add(&page->lru, &ret_pages); >> >> VM_BUG_ON_PAGE(PageLRU(page) || PageUnevictable(page), p= age); >> >> } >> >> + /* 'page_list' is always empty here */ >> >> + >> >> + /* Migrate pages selected for demotion */ >> >> + nr_reclaimed +=3D demote_page_list(&demote_pages, pgdat, sc); >> >> + /* Pages that could not be demoted are still in @demote_pages */ >> >> + if (!list_empty(&demote_pages)) { >> >> + /* Pages which failed to demoted go back on @page_list f= or retry: */ >> >> + list_splice_init(&demote_pages, page_list); >> >> + do_demote_pass =3D false; >> >> + goto retry; >> >> + } >> >> >> >> pgactivate =3D stat->nr_activate[0] + stat->nr_activate[1]; >> >> >> >> -- >> >> 2.30.2 >> > >> > shrink_page_list() is also used by reclaim_pages(), which is called by >> > madvise(MADV_PAGEOUT). This patch changes the semantics of madvise(MAD= V_PAGEOUT) >> > from =E2=80=9Creclaim a given range of pages=E2=80=9D to migrate the g= iven pages to lower >> > tier memory or reclaim them if the migration fails. You might want to = check >> > the caller of shrink_page_list() to avoid changing madvise(MADV_PAGEOU= T) >> > semantics. >> >> Thanks for pointing this out! >> >> Literally, PAGEOUT means writing the page to the disk instead of >> migrating pages to the lower tier. So it seems reasonable to make it >> keep the original behavior instead of demoting even if in the tiered >> memory system. >> >> If nobody objects, I will change this in the next version. > > I don't have a strong opinion on this. But I just thought why not let > PAGEOUT do demotion if tier'ed memory is available and the "migration > in lieu of discard" behavior is opt'ed in by a knob and we keep the > consistency between passive reclaim and proactive reclaim. I thought about that too. Considering the kernel API naming, is it better to define MADV_PAGEOUT as writing to disk, and MADV_COLD as demoting to the lower tier if enabled. Best Regards, Huang, Ying