linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Muchun Song <muchun.song@linux.dev>
To: Mike Kravetz <mike.kravetz@oracle.com>,
	Linux-MM <linux-mm@kvack.org>,
	LKML <linux-kernel@vger.kernel.org>
Cc: Muchun Song <songmuchun@bytedance.com>,
	Joao Martins <joao.m.martins@oracle.com>,
	Oscar Salvador <osalvador@suse.de>,
	David Hildenbrand <david@redhat.com>,
	Miaohe Lin <linmiaohe@huawei.com>,
	David Rientjes <rientjes@google.com>,
	Anshuman Khandual <anshuman.khandual@arm.com>,
	Naoya Horiguchi <naoya.horiguchi@linux.dev>,
	Barry Song <song.bao.hua@hisilicon.com>,
	Michal Hocko <mhocko@suse.com>,
	Matthew Wilcox <willy@infradead.org>,
	Xiongchun Duan <duanxiongchun@bytedance.com>,
	Andrew Morton <akpm@linux-foundation.org>
Subject: Re: [PATCH v2 07/11] hugetlb: perform vmemmap restoration on a list of pages
Date: Wed, 6 Sep 2023 16:07:20 +0800	[thread overview]
Message-ID: <38E2F051-E00B-4104-A616-0EEB2729386F@linux.dev> (raw)
In-Reply-To: <5e091211-9a32-8480-55fb-faff6a0fadef@linux.dev>



> On Sep 6, 2023, at 15:33, Muchun Song <muchun.song@linux.dev> wrote:
> 
> 
> 
> On 2023/9/6 05:44, Mike Kravetz wrote:
>> When removing hugetlb pages from the pool, we first create a list
>> of removed pages and then free those pages back to low level allocators.
>> Part of the 'freeing process' is to restore vmemmap for all base pages
>> if necessary.  Pass this list of pages to a new routine
>> hugetlb_vmemmap_restore_folios() so that vmemmap restoration can be
>> performed in bulk.
>> 
>> Signed-off-by: Mike Kravetz <mike.kravetz@oracle.com>
>> ---
>>  mm/hugetlb.c         |  3 +++
>>  mm/hugetlb_vmemmap.c | 13 +++++++++++++
>>  mm/hugetlb_vmemmap.h |  5 +++++
>>  3 files changed, 21 insertions(+)
>> 
>> diff --git a/mm/hugetlb.c b/mm/hugetlb.c
>> index 554be94b07bd..dd2dbc256172 100644
>> --- a/mm/hugetlb.c
>> +++ b/mm/hugetlb.c
>> @@ -1838,6 +1838,9 @@ static void update_and_free_pages_bulk(struct hstate *h, struct list_head *list)
>>  {
>>   struct folio *folio, *t_folio;
>>  + /* First restore vmemmap for all pages on list. */
>> + hugetlb_vmemmap_restore_folios(h, list);
>> +
>>   list_for_each_entry_safe(folio, t_folio, list, lru) {
>>   update_and_free_hugetlb_folio(h, folio, false);
>>   cond_resched();
>> diff --git a/mm/hugetlb_vmemmap.c b/mm/hugetlb_vmemmap.c
>> index ac5577d372fe..79de984919ef 100644
>> --- a/mm/hugetlb_vmemmap.c
>> +++ b/mm/hugetlb_vmemmap.c
>> @@ -481,6 +481,19 @@ int hugetlb_vmemmap_restore(const struct hstate *h, struct page *head)
>>   return ret;
>>  }
>>  +/*
>> + * This function will attempt to resore vmemmap for a list of folios.  There
>> + * is no guarantee that restoration will be successful for all or any folios.
>> + * This is used in bulk operations, and no feedback is given to the caller.
>> + */
>> +void hugetlb_vmemmap_restore_folios(const struct hstate *h, struct list_head *folio_list)
>> +{
>> + struct folio *folio;
>> +
>> + list_for_each_entry(folio, folio_list, lru)
>> + (void)hugetlb_vmemmap_restore(h, &folio->page);
> 
> I am curious about the purpose of "void" here, seems it it not necessnary,
> ritgh? We cound see so many palces where we do not add the void if the caller
> does not care about the return value of the callee.

Another question: should we stop restoring vmemmap pages when
hugetlb_vmemmap_restore() fails? In which case, I suspect there
is no memory probably, there is no need to continue, right?

> 
> Thanks.
>> +}
>> +
>>  /* Return true iff a HugeTLB whose vmemmap should and can be optimized. */
>>  static bool vmemmap_should_optimize(const struct hstate *h, const struct page *head)
>>  {
>> diff --git a/mm/hugetlb_vmemmap.h b/mm/hugetlb_vmemmap.h
>> index 036494e040ca..b4ee945dc1d4 100644
>> --- a/mm/hugetlb_vmemmap.h
>> +++ b/mm/hugetlb_vmemmap.h
>> @@ -12,6 +12,7 @@
>>    #ifdef CONFIG_HUGETLB_PAGE_OPTIMIZE_VMEMMAP
>>  int hugetlb_vmemmap_restore(const struct hstate *h, struct page *head);
>> +void hugetlb_vmemmap_restore_folios(const struct hstate *h, struct list_head *folio_list);
>>  void hugetlb_vmemmap_optimize(const struct hstate *h, struct page *head);
>>  void hugetlb_vmemmap_optimize_folios(struct hstate *h, struct list_head *folio_list);
>>  @@ -44,6 +45,10 @@ static inline int hugetlb_vmemmap_restore(const struct hstate *h, struct page *h
>>   return 0;
>>  }
>>  +static inline void hugetlb_vmemmap_restore_folios(const struct hstate *h, struct list_head *folio_list)
>> +{
>> +}
>> +
>>  static inline void hugetlb_vmemmap_optimize(const struct hstate *h, struct page *head)
>>  {
>>  }
> 



  reply	other threads:[~2023-09-06  8:08 UTC|newest]

Thread overview: 44+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-09-05 21:43 [PATCH v2 00/11] Batch hugetlb vmemmap modification operations Mike Kravetz
2023-09-05 21:44 ` [PATCH v2 01/11] hugetlb: set hugetlb page flag before optimizing vmemmap Mike Kravetz
2023-09-06  0:48   ` Matthew Wilcox
2023-09-06  1:05     ` Mike Kravetz
2023-10-13 12:58   ` Naoya Horiguchi
2023-10-13 21:43     ` Mike Kravetz
2023-10-16 22:55       ` Andrew Morton
2023-10-17  3:21     ` Mike Kravetz
2023-10-18  1:58       ` Naoya Horiguchi
2023-10-18  3:43         ` Mike Kravetz
2023-09-05 21:44 ` [PATCH v2 02/11] hugetlb: Use a folio in free_hpage_workfn() Mike Kravetz
2023-09-05 21:44 ` [PATCH v2 03/11] hugetlb: Remove a few calls to page_folio() Mike Kravetz
2023-09-05 21:44 ` [PATCH v2 04/11] hugetlb: Convert remove_pool_huge_page() to remove_pool_hugetlb_folio() Mike Kravetz
2023-09-05 21:44 ` [PATCH v2 05/11] hugetlb: restructure pool allocations Mike Kravetz
2023-09-05 21:44 ` [PATCH v2 06/11] hugetlb: perform vmemmap optimization on a list of pages Mike Kravetz
2023-09-06  7:30   ` Muchun Song
2023-09-05 21:44 ` [PATCH v2 07/11] hugetlb: perform vmemmap restoration " Mike Kravetz
2023-09-06  7:33   ` Muchun Song
2023-09-06  8:07     ` Muchun Song [this message]
2023-09-06 21:12       ` Mike Kravetz
2023-09-07  3:33         ` Muchun Song
2023-09-07 18:54           ` Mike Kravetz
2023-09-08 20:53             ` Mike Kravetz
2023-09-11  3:10               ` Muchun Song
2023-09-06 20:53     ` Mike Kravetz
2023-09-05 21:44 ` [PATCH v2 08/11] hugetlb: batch freeing of vmemmap pages Mike Kravetz
2023-09-06  7:38   ` Muchun Song
2023-09-06 21:38     ` Mike Kravetz
2023-09-07  6:19       ` Muchun Song
2023-09-07 18:47         ` Mike Kravetz
2023-09-05 21:44 ` [PATCH v2 09/11] hugetlb: batch PMD split for bulk vmemmap dedup Mike Kravetz
2023-09-06  8:24   ` Muchun Song
2023-09-06  9:11     ` [External] " Muchun Song
2023-09-06  9:26       ` Joao Martins
2023-09-06  9:32         ` [External] " Muchun Song
2023-09-06  9:44           ` Joao Martins
2023-09-06 11:34             ` Muchun Song
2023-09-06  9:13     ` Joao Martins
2023-09-05 21:44 ` [PATCH v2 10/11] hugetlb: batch TLB flushes when freeing vmemmap Mike Kravetz
2023-09-07  6:55   ` Muchun Song
2023-09-07 18:57     ` Mike Kravetz
2023-09-05 21:44 ` [PATCH v2 11/11] hugetlb: batch TLB flushes when restoring vmemmap Mike Kravetz
2023-09-07  6:58   ` Muchun Song
2023-09-07 18:58     ` Mike Kravetz

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=38E2F051-E00B-4104-A616-0EEB2729386F@linux.dev \
    --to=muchun.song@linux.dev \
    --cc=akpm@linux-foundation.org \
    --cc=anshuman.khandual@arm.com \
    --cc=david@redhat.com \
    --cc=duanxiongchun@bytedance.com \
    --cc=joao.m.martins@oracle.com \
    --cc=linmiaohe@huawei.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mhocko@suse.com \
    --cc=mike.kravetz@oracle.com \
    --cc=naoya.horiguchi@linux.dev \
    --cc=osalvador@suse.de \
    --cc=rientjes@google.com \
    --cc=song.bao.hua@hisilicon.com \
    --cc=songmuchun@bytedance.com \
    --cc=willy@infradead.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox