From: David Hildenbrand <david@redhat.com>
To: Yang Yang <yang.yang29@zte.com.cn>, akpm@linux-foundation.org
Cc: imbrenda@linux.ibm.com, jiang.xuexin@zte.com.cn,
linux-kernel@vger.kernel.org, linux-mm@kvack.org,
ran.xiaokai@zte.com.cn, xu.xin.sc@gmail.com, xu.xin16@zte.com.cn
Subject: Re: [PATCH v9 2/5] ksm: count all zero pages placed by KSM
Date: Wed, 24 May 2023 09:23:12 +0200 [thread overview]
Message-ID: <52bfd744-3086-a22a-e2e7-8b64d5fccfcc@redhat.com> (raw)
In-Reply-To: <20230524055752.20449-1-yang.yang29@zte.com.cn>
On 24.05.23 07:57, Yang Yang wrote:
> From: xu xin <xu.xin16@zte.com.cn>
>
> As pages_sharing and pages_shared don't include the number of zero pages
> merged by KSM, we cannot know how many pages are zero pages placed by KSM
> when enabling use_zero_pages, which leads to KSM not being transparent with
> all actual merged pages by KSM. In the early days of use_zero_pages,
> zero-pages was unable to get unshared by the ways like MADV_UNMERGEABLE so
> it's hard to count how many times one of those zeropages was then unmerged.
>
> But now, unsharing KSM-placed zero page accurately has been achieved, so we
> can easily count both how many times a page full of zeroes was merged with
> zero-page and how many times one of those pages was then unmerged. and so,
> it helps to estimate memory demands when each and every shared page could
> get unshared.
>
> So we add ksm_zero_pages under /sys/kernel/mm/ksm/ to show the number
> of all zero pages placed by KSM. Meanwhile, we update the Documentation.
>
> Signed-off-by: xu xin <xu.xin16@zte.com.cn>
> Suggested-by: David Hildenbrand <david@redhat.com>
> Cc: Claudio Imbrenda <imbrenda@linux.ibm.com>
> Cc: Xuexin Jiang <jiang.xuexin@zte.com.cn>
> Reviewed-by: Xiaokai Ran <ran.xiaokai@zte.com.cn>
> Reviewed-by: Yang Yang <yang.yang29@zte.com.cn>
> ---
> Documentation/admin-guide/mm/ksm.rst | 7 +++++++
> include/linux/ksm.h | 12 ++++++++++++
> mm/khugepaged.c | 2 ++
> mm/ksm.c | 12 ++++++++++++
> mm/memory.c | 5 ++++-
> 5 files changed, 37 insertions(+), 1 deletion(-)
>
> diff --git a/Documentation/admin-guide/mm/ksm.rst b/Documentation/admin-guide/mm/ksm.rst
> index 7626392fe82c..6cc919dbfd55 100644
> --- a/Documentation/admin-guide/mm/ksm.rst
> +++ b/Documentation/admin-guide/mm/ksm.rst
> @@ -173,6 +173,13 @@ stable_node_chains
> the number of KSM pages that hit the ``max_page_sharing`` limit
> stable_node_dups
> number of duplicated KSM pages
> +ksm_zero_pages
> + how many zero pages that are still mapped into processes were mapped by
> + KSM when deduplicating.
> +
> +When ``use_zero_pages`` is/was enabled, the sum of ``pages_sharing`` +
> +``ksm_zero_pages`` represents the actual number of pages saved by KSM.
> +if ``use_zero_pages`` has never been enabled, ``ksm_zero_pages`` is 0.
>
> A high ratio of ``pages_sharing`` to ``pages_shared`` indicates good
> sharing, but a high ratio of ``pages_unshared`` to ``pages_sharing``
> diff --git a/include/linux/ksm.h b/include/linux/ksm.h
> index 4fd5f4a50bac..f2d98c53cfec 100644
> --- a/include/linux/ksm.h
> +++ b/include/linux/ksm.h
> @@ -33,6 +33,14 @@ void __ksm_exit(struct mm_struct *mm);
> */
> #define is_ksm_zero_pte(pte) (is_zero_pfn(pte_pfn(pte)) && pte_dirty(pte))
>
> +extern unsigned long ksm_zero_pages;
> +
> +static inline void ksm_notify_unmap_zero_page(pte_t pte)
> +{
> + if (is_ksm_zero_pte(pte))
> + ksm_zero_pages--;
> +}
> +
> static inline int ksm_fork(struct mm_struct *mm, struct mm_struct *oldmm)
> {
> int ret;
> @@ -103,6 +111,10 @@ static inline void ksm_exit(struct mm_struct *mm)
>
> #define is_ksm_zero_pte(pte) 0
>
> +static inline void ksm_notify_unmap_zero_page(pte_t pte)
> +{
> +}
> +
Having proposed that name ... I realize that we call this function
whenever there might be a zeropage mapped (when we have !page after
vm_normal_page()) -- but it could also not be the zeropage.
Not really able to come up with a better name :)
ksm_notify_maybe_unmap_zero_page ?
ksm_maybe_unmap_zero_page ?
Maybe someone else reading along has a better idea. In any case, the
logic itself LGTM
Reviewed-by: David Hildenbrand <david@redhat.com>
--
Thanks,
David / dhildenb
next prev parent reply other threads:[~2023-05-24 7:23 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-05-24 5:51 [PATCH v9 0/5] ksm: support tracking KSM-placed zero-pages yang.yang29
[not found] ` <20230524055711.20387-1-yang.yang29@zte.com.cn>
2023-05-24 7:10 ` [PATCH v9 1/5] ksm: support unsharing KSM-placed zero pages David Hildenbrand
[not found] ` <20230524055752.20449-1-yang.yang29@zte.com.cn>
2023-05-24 7:23 ` David Hildenbrand [this message]
2023-05-24 7:55 ` [PATCH v9 2/5] ksm: count all zero pages placed by KSM xu xin
2023-05-24 8:27 ` David Hildenbrand
[not found] ` <20230524055851.20565-1-yang.yang29@zte.com.cn>
2023-05-24 7:25 ` [PATCH v9 4/5] ksm: consider KSM-placed zeropages when calculating KSM profit David Hildenbrand
[not found] ` <20230524055906.20614-1-yang.yang29@zte.com.cn>
2023-05-24 9:11 ` [PATCH v9 5/5] selftest: add a testcase of ksm zero pages David Hildenbrand
2023-05-24 9:38 ` xu xin
2023-05-24 9:12 ` [PATCH v9 0/5] ksm: support tracking KSM-placed zero-pages David Hildenbrand
[not found] ` <20230524055800.20498-1-yang.yang29@zte.com.cn>
2023-05-24 7:24 ` [PATCH v9 3/5] ksm: add ksm zero pages for each process David Hildenbrand
2023-05-25 3:36 ` kernel test robot
2023-05-25 6:56 ` kernel test robot
2023-05-29 1:48 ` xu xin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=52bfd744-3086-a22a-e2e7-8b64d5fccfcc@redhat.com \
--to=david@redhat.com \
--cc=akpm@linux-foundation.org \
--cc=imbrenda@linux.ibm.com \
--cc=jiang.xuexin@zte.com.cn \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=ran.xiaokai@zte.com.cn \
--cc=xu.xin.sc@gmail.com \
--cc=xu.xin16@zte.com.cn \
--cc=yang.yang29@zte.com.cn \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox