From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-9.6 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id B4FF6C2BA1A for ; Fri, 3 Apr 2020 05:41:32 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 6D3A120757 for ; Fri, 3 Apr 2020 05:41:32 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="JR09QoXS" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 6D3A120757 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 1BD8E8E000F; Fri, 3 Apr 2020 01:41:32 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 16E628E0007; Fri, 3 Apr 2020 01:41:32 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 0AA218E000F; Fri, 3 Apr 2020 01:41:32 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0233.hostedemail.com [216.40.44.233]) by kanga.kvack.org (Postfix) with ESMTP id E88568E0007 for ; Fri, 3 Apr 2020 01:41:31 -0400 (EDT) Received: from smtpin12.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with ESMTP id B59A3180AD81A for ; Fri, 3 Apr 2020 05:41:31 +0000 (UTC) X-FDA: 76665446382.12.sink42_478438b266e49 X-HE-Tag: sink42_478438b266e49 X-Filterd-Recvd-Size: 7908 Received: from mail-pg1-f195.google.com (mail-pg1-f195.google.com [209.85.215.195]) by imf24.hostedemail.com (Postfix) with ESMTP for ; Fri, 3 Apr 2020 05:41:31 +0000 (UTC) Received: by mail-pg1-f195.google.com with SMTP id g32so2997894pgb.6 for ; Thu, 02 Apr 2020 22:41:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=PGmzb8UxKP2obZ2hRRmNukkpDvHaqG21Hk67bEIKtgs=; b=JR09QoXSNbBg28nXbmYJlqlma5NOT/BgLD7wvGBTcGFvGFAgYtLCu9nwNnjHYHQbOr ckoEOrXwaHenjnuBQpp76655Fa9RoUQBOIh2xtKt0s51R+krtPiiB4JXvkDqIRttqHac D07zPODRsve+ZnUojsGvjnBE5Ae4ZjtpAzb20e5/FBsedcY+05C00GR14mJWEi7rMKmW nk1QQoUuK6iuxsqdWhUaGiG4EjCCUSpVLrbfLtdP9EoA8KrfdyXTPRQiwq8FniJKd1MY 9xF1BUt7WX4khFtCnUjj1WHB1jQMlg3R6M9eYNprhtBGUAyw9eoda8F04p394gFIg5lE yazw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=PGmzb8UxKP2obZ2hRRmNukkpDvHaqG21Hk67bEIKtgs=; b=I5e0PEPZNSilg7pGP3apODAXJqEbtnJ5+T8Y8JPyKEbhtr1+flZ/y5m/aGtyoymD9i doUc1uvywzHLySINpfwqo+W46w534cbrMIK8eWjY2MjSpME/fzqt+4cg9cGVMKr+UYQJ EIOCXUt+Zlb77C3z8S+9WtrQFwLSfsqJz8iDvIIp4vb3wAnMbYjbBks2dLPUgrR7zgaC fYOsoQC2d7sVM1sVlUZcWa1hXS7fWruLP/Xo0yahApsfqsL4gt2wLs+kC5Z5C0/hfyn4 c4TJEeMXazf4onVHTQfVuKHQUhAMER8+mBsoVzQggwj7Ohu2QyGsUUwObw586Q/y/czI He+Q== X-Gm-Message-State: AGi0PuazOxSJxx52kvLdC5/dAkf64FvCkfBBlFYockWLQdM3OPuwE05Q lLUigR0MeAJ7yTpcZ6bn8d0= X-Google-Smtp-Source: APiQypJVYeiNLUHoSnC+GoIJQaU/PRi7OFSvzEsO+JLkwBbacDZJjhcy/+34LUl0RfMG2wUiSaD02Q== X-Received: by 2002:aa7:8f29:: with SMTP id y9mr5726738pfr.19.1585892490028; Thu, 02 Apr 2020 22:41:30 -0700 (PDT) Received: from localhost.localdomain ([114.206.198.176]) by smtp.gmail.com with ESMTPSA id e6sm4568295pgu.44.2020.04.02.22.41.26 (version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Thu, 02 Apr 2020 22:41:29 -0700 (PDT) From: js1304@gmail.com X-Google-Original-From: iamjoonsoo.kim@lge.com To: Andrew Morton Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, Johannes Weiner , Michal Hocko , Hugh Dickins , Minchan Kim , Vlastimil Babka , Mel Gorman , kernel-team@lge.com, Joonsoo Kim Subject: [PATCH v5 07/10] mm/workingset: support to remember the previous owner of the page Date: Fri, 3 Apr 2020 14:40:45 +0900 Message-Id: <1585892447-32059-8-git-send-email-iamjoonsoo.kim@lge.com> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1585892447-32059-1-git-send-email-iamjoonsoo.kim@lge.com> References: <1585892447-32059-1-git-send-email-iamjoonsoo.kim@lge.com> X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Joonsoo Kim This patch supports to remember the previous owner of the page. Since there is not enough spare bits in shadow entry for this information, only a few bits of the memcg id of the page is stored. Although this information is insufficient, it would provide enough level of the ability to check the previous owner. This patch is for the preparation of the following patch, "mm/swap: do not readahead if the previous owner of the swap entry isn't me". Signed-off-by: Joonsoo Kim --- mm/workingset.c | 41 +++++++++++++++++++++++++++++++---------- 1 file changed, 31 insertions(+), 10 deletions(-) diff --git a/mm/workingset.c b/mm/workingset.c index 59415e0..871b867 100644 --- a/mm/workingset.c +++ b/mm/workingset.c @@ -168,8 +168,20 @@ * refault distance will immediately activate the refaulting page. */ +/* + * memcg_tag will be used to check the previous owner of the page. + * Since we don't have enough spare bits in shadow entry, just a few + * bits are used to approximate the previous owner. + */ +#if BITS_PER_LONG == 32 +#define PAGE_MEMCG_TAG_SHIFT 4 +#else +#define PAGE_MEMCG_TAG_SHIFT 8 +#endif + #define EVICTION_SHIFT ((BITS_PER_LONG - BITS_PER_XA_VALUE) + \ - 1 + NODES_SHIFT + MEM_CGROUP_ID_SHIFT) + 1 + NODES_SHIFT + MEM_CGROUP_ID_SHIFT + \ + PAGE_MEMCG_TAG_SHIFT) #define EVICTION_MASK (~0UL >> EVICTION_SHIFT) /* @@ -182,11 +194,12 @@ */ static unsigned int bucket_order __read_mostly; -static void *pack_shadow(int memcgid, pg_data_t *pgdat, unsigned long eviction, - bool workingset) +static void *pack_shadow(int memcgid, int page_memcg_tag, pg_data_t *pgdat, + unsigned long eviction, bool workingset) { eviction >>= bucket_order; eviction &= EVICTION_MASK; + eviction = (eviction << PAGE_MEMCG_TAG_SHIFT) | page_memcg_tag; eviction = (eviction << MEM_CGROUP_ID_SHIFT) | memcgid; eviction = (eviction << NODES_SHIFT) | pgdat->node_id; eviction = (eviction << 1) | workingset; @@ -194,11 +207,12 @@ static void *pack_shadow(int memcgid, pg_data_t *pgdat, unsigned long eviction, return xa_mk_value(eviction); } -static void unpack_shadow(void *shadow, int *memcgidp, pg_data_t **pgdat, - unsigned long *evictionp, bool *workingsetp) +static void unpack_shadow(void *shadow, int *memcgidp, int *page_memcg_tagp, + pg_data_t **pgdat, unsigned long *evictionp, + bool *workingsetp) { unsigned long entry = xa_to_value(shadow); - int memcgid, nid; + int memcgid, page_memcg_tag, nid; bool workingset; workingset = entry & 1; @@ -207,8 +221,11 @@ static void unpack_shadow(void *shadow, int *memcgidp, pg_data_t **pgdat, entry >>= NODES_SHIFT; memcgid = entry & ((1UL << MEM_CGROUP_ID_SHIFT) - 1); entry >>= MEM_CGROUP_ID_SHIFT; + page_memcg_tag = entry & ((1UL << PAGE_MEMCG_TAG_SHIFT) - 1); + entry >>= PAGE_MEMCG_TAG_SHIFT; *memcgidp = memcgid; + *page_memcg_tagp = page_memcg_tag; *pgdat = NODE_DATA(nid); *evictionp = entry << bucket_order; *workingsetp = workingset; @@ -248,9 +265,9 @@ void *workingset_eviction(struct page *page, struct mem_cgroup *target_memcg) { struct pglist_data *pgdat = page_pgdat(page); bool file = page_is_file_cache(page); + int memcgid, page_memcg_tag; unsigned long eviction; struct lruvec *lruvec; - int memcgid; /* Page is fully exclusive and pins page->mem_cgroup */ VM_BUG_ON_PAGE(PageLRU(page), page); @@ -262,8 +279,11 @@ void *workingset_eviction(struct page *page, struct mem_cgroup *target_memcg) lruvec = mem_cgroup_lruvec(target_memcg, pgdat); /* XXX: target_memcg can be NULL, go through lruvec */ memcgid = mem_cgroup_id(lruvec_memcg(lruvec)); + page_memcg_tag = mem_cgroup_id(page_memcg(page)); + page_memcg_tag &= (1UL << PAGE_MEMCG_TAG_SHIFT) - 1; eviction = atomic_long_read(&lruvec->inactive_age[file]); - return pack_shadow(memcgid, pgdat, eviction, PageWorkingset(page)); + return pack_shadow(memcgid, page_memcg_tag, pgdat, eviction, + PageWorkingset(page)); } /** @@ -281,6 +301,7 @@ void workingset_refault(struct page *page, void *shadow) struct mem_cgroup *eviction_memcg; struct lruvec *eviction_lruvec; unsigned long refault_distance; + int memcgid, page_memcg_tag; struct pglist_data *pgdat; struct mem_cgroup *memcg; unsigned long eviction; @@ -288,9 +309,9 @@ void workingset_refault(struct page *page, void *shadow) unsigned long refault; unsigned long active; bool workingset; - int memcgid; - unpack_shadow(shadow, &memcgid, &pgdat, &eviction, &workingset); + unpack_shadow(shadow, &memcgid, &page_memcg_tag, + &pgdat, &eviction, &workingset); rcu_read_lock(); /* -- 2.7.4