linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Muchun Song <muchun.song@linux.dev>
To: Mike Rapoport <rppt@kernel.org>
Cc: Muchun Song <songmuchun@bytedance.com>,
	Andrew Morton <akpm@linux-foundation.org>,
	David Hildenbrand <david@kernel.org>,
	Oscar Salvador <osalvador@suse.de>,
	Michael Ellerman <mpe@ellerman.id.au>,
	Madhavan Srinivasan <maddy@linux.ibm.com>,
	Lorenzo Stoakes <ljs@kernel.org>,
	Liam R Howlett <Liam.Howlett@oracle.com>,
	Vlastimil Babka <vbabka@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	Michal Hocko <mhocko@suse.com>,
	Nicholas Piggin <npiggin@gmail.com>,
	Christophe Leroy <chleroy@kernel.org>,
	aneesh.kumar@linux.ibm.com, joao.m.martins@oracle.com,
	linux-mm@kvack.org, linuxppc-dev@lists.ozlabs.org,
	linux-kernel@vger.kernel.org
Subject: Re: [PATCH 06/49] mm/mm_init: fix uninitialized pageblock migratetype for ZONE_DEVICE compound pages
Date: Mon, 13 Apr 2026 21:57:00 +0800	[thread overview]
Message-ID: <ADC5EFE8-454D-4B9D-8BB0-39FF671290F0@linux.dev> (raw)
In-Reply-To: <adzvdRPrK55TutT6@kernel.org>



> On Apr 13, 2026, at 21:28, Mike Rapoport <rppt@kernel.org> wrote:
> 
> On Mon, Apr 13, 2026 at 06:07:44PM +0800, Muchun Song wrote:
>> 
>> 
>>>> On Apr 13, 2026, at 17:32, Mike Rapoport <rppt@kernel.org> wrote:
>>> 
>>> On Sun, Apr 05, 2026 at 08:51:57PM +0800, Muchun Song wrote:
>>>> Previously, memmap_init_zone_device() only initialized the migratetype
>>>> of the first pageblock of a compound page. If the compound page size
>>>> exceeds pageblock_nr_pages (e.g., 1GB hugepages with 2MB pageblocks),
>>>> subsequent pageblocks in the compound page would remain uninitialized.
>>>> 
>>>> This patch moves the migratetype initialization out of
>>>> __init_zone_device_page() and into a separate function
>>>> pageblock_migratetype_init_range(). This function iterates over the
>>>> entire PFN range of the memory, ensuring that all pageblocks are correctly
>>>> initialized.
>>>> 
>>>> Fixes: c4386bd8ee3a ("mm/memremap: add ZONE_DEVICE support for compound pages")
>>>> Signed-off-by: Muchun Song <songmuchun@bytedance.com>
>>>> ---
>>>> mm/mm_init.c | 41 ++++++++++++++++++++++++++---------------
>>>> 1 file changed, 26 insertions(+), 15 deletions(-)
>>>> 
>>>> diff --git a/mm/mm_init.c b/mm/mm_init.c
>>>> index 9a44e8458fed..4936ca78966c 100644
>>>> --- a/mm/mm_init.c
>>>> +++ b/mm/mm_init.c
>>>> @@ -674,6 +674,18 @@ static inline void fixup_hashdist(void)
>>>> static inline void fixup_hashdist(void) {}
>>>> #endif /* CONFIG_NUMA */
>>>> 
>>>> +static __meminit void pageblock_migratetype_init_range(unsigned long pfn,
>>>> +        unsigned long nr_pages,
>>>> +        int migratetype)
>>>> +{
>>>> + unsigned long end = pfn + nr_pages;
>>>> +
>>>> + for (pfn = pageblock_align(pfn); pfn < end; pfn += pageblock_nr_pages) {
>>>> + init_pageblock_migratetype(pfn_to_page(pfn), migratetype, false);
>>>> + cond_resched();
>>> 
>>> Do we need to call cond_resched() every iteration here?
>> 
>> Of course not.
>> 
>>> 
>>>> + }
>>>> +}
>>>> +
>>>> /*
>>>> * Initialize a reserved page unconditionally, finding its zone first.
>>>> */
>>>> @@ -1011,21 +1023,6 @@ static void __ref __init_zone_device_page(struct page *page, unsigned long pfn,
>>>> page_folio(page)->pgmap = pgmap;
>>>> page->zone_device_data = NULL;
>>>> 
>>>> - /*
>>>> -  * Mark the block movable so that blocks are reserved for
>>>> -  * movable at startup. This will force kernel allocations
>>>> -  * to reserve their blocks rather than leaking throughout
>>>> -  * the address space during boot when many long-lived
>>>> -  * kernel allocations are made.
>>>> -  *
>>>> -  * Please note that MEMINIT_HOTPLUG path doesn't clear memmap
>>>> -  * because this is done early in section_activate()
>>>> -  */
>>>> - if (pageblock_aligned(pfn)) {
>>>> - init_pageblock_migratetype(page, MIGRATE_MOVABLE, false);
>>>> - cond_resched();
>>>> - }
>>>> -
>>>> /*
>>>> * ZONE_DEVICE pages other than MEMORY_TYPE_GENERIC are released
>>>> * directly to the driver page allocator which will set the page count
>>>> @@ -1122,6 +1119,8 @@ void __ref memmap_init_zone_device(struct zone *zone,
>>>> 
>>>> __init_zone_device_page(page, pfn, zone_idx, nid, pgmap);
>>>> 
>>>> + cond_resched();
>>> 
>>> Originally we called cond_resched() once per pageblock, now it's called
>>> once per page plus for every pageblock in the tight loop that sets the
>>> migrate type. Isn't it too much?
>> 
>> There are indeed many more cond_resched() than before, but I don’t have a
>> concise way to write it, so I took the easy way out.
>> 
>> How about:
>> 
>> diff --git a/mm/mm_init.c b/mm/mm_init.c
>> index 2d680636b67a..d13a2577c4c3 100644
>> --- a/mm/mm_init.c
>> +++ b/mm/mm_init.c
>> @@ -683,7 +683,8 @@ static __meminit void pageblock_migratetype_init_range(unsigned long pfn,
>> 
>>        for (pfn = pageblock_align(pfn); pfn < end; pfn += pageblock_nr_pages) {
>>                init_pageblock_migratetype(pfn_to_page(pfn), migratetype, isolate);
>> -               cond_resched();
>> +               if ((pfn & (pageblock_nr_pages * 512 - 1)) == 0)
>> +                       cond_resched();
> 
> TBH, I don't know if 512 is the right number :)

I picked this number out of thin air. I’m not sure as well.

> 
> pageblock boundary was a convenient point to have cond_resched() along with
> setting the migrate type.
> 
> Here we might be able to squeeze more iterations between subsequent
> cond_resched() calls.

Choosing an appropriate number is indeed difficult. We need to consider
both unnecessary cond_resched() calls and scheduling latency, and the
specific value also depends on the current CPU performance. At the very least,
I find it hard to choose a correct value. Since we all agree it should be larger
than 512, why not just pick 1024? I can't think of a good evaluation criterion
or selection method either.

Thanks.

> 
> --
> Sincerely yours,
> Mike.


  reply	other threads:[~2026-04-13 13:57 UTC|newest]

Thread overview: 66+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-05 12:51 [PATCH 00/49] mm: Generalize vmemmap optimization for DAX and HugeTLB Muchun Song
2026-04-05 12:51 ` [PATCH 01/49] mm/sparse: fix vmemmap accounting imbalance on memory hotplug error Muchun Song
2026-04-13  9:19   ` Mike Rapoport
2026-04-13  9:35     ` Mike Rapoport
2026-04-13  9:49       ` Muchun Song
2026-04-13 12:04         ` Mike Rapoport
2026-04-13 12:47           ` Muchun Song
2026-04-13 13:35             ` Mike Rapoport
2026-04-13 14:05               ` Muchun Song
2026-04-13 14:16                 ` Muchun Song
2026-04-05 12:51 ` [PATCH 02/49] mm/sparse: add a @pgmap argument to memory deactivation paths Muchun Song
2026-04-05 12:51 ` [PATCH 03/49] mm/sparse: fix vmemmap page accounting for HVOed DAX Muchun Song
2026-04-05 12:51 ` [PATCH 04/49] mm/sparse: add a @pgmap parameter to arch vmemmap_populate() Muchun Song
2026-04-05 12:51 ` [PATCH 05/49] mm/sparse: fix missing architecture-specific page table sync for HVO DAX Muchun Song
2026-04-05 12:51 ` [PATCH 06/49] mm/mm_init: fix uninitialized pageblock migratetype for ZONE_DEVICE compound pages Muchun Song
2026-04-13  9:32   ` Mike Rapoport
2026-04-13 10:07     ` Muchun Song
2026-04-13 13:28       ` Mike Rapoport
2026-04-13 13:57         ` Muchun Song [this message]
2026-04-05 12:51 ` [PATCH 07/49] mm/mm_init: use pageblock_migratetype_init_range() in deferred_free_pages() Muchun Song
2026-04-13  9:40   ` Mike Rapoport
2026-04-05 12:51 ` [PATCH 08/49] mm: Convert vmemmap_p?d_populate() to static functions Muchun Song
2026-04-05 12:52 ` [PATCH 09/49] mm: panic on memory allocation failure in sparse_init_nid() Muchun Song
2026-04-05 12:52 ` [PATCH 10/49] mm: move subsection_map_init() into sparse_init() Muchun Song
2026-04-05 12:52 ` [PATCH 11/49] mm: defer sparse_init() until after zone initialization Muchun Song
2026-04-05 12:52 ` [PATCH 12/49] mm: make set_pageblock_order() static Muchun Song
2026-04-05 12:52 ` [PATCH 13/49] mm: integrate sparse_vmemmap_init_nid_late() into sparse_init_nid() Muchun Song
2026-04-05 12:52 ` [PATCH 14/49] mm/cma: validate hugetlb CMA range by zone at reserve time Muchun Song
2026-04-05 12:52 ` [PATCH 15/49] mm/hugetlb: free cross-zone bootmem gigantic pages after allocation Muchun Song
2026-04-05 12:52 ` [PATCH 16/49] mm/hugetlb: initialize vmemmap optimization in early stage Muchun Song
2026-04-05 12:52 ` [PATCH 17/49] mm: remove sparse_vmemmap_init_nid_late() Muchun Song
2026-04-05 12:52 ` [PATCH 18/49] mm/mm_init: make __init_page_from_nid() static Muchun Song
2026-04-05 12:52 ` [PATCH 19/49] mm/sparse-vmemmap: remove the VMEMMAP_POPULATE_PAGEREF flag Muchun Song
2026-04-05 12:52 ` [PATCH 20/49] mm: rename vmemmap optimization macros to generic names Muchun Song
2026-04-05 12:52 ` [PATCH 21/49] mm/sparse: drop power-of-2 size requirement for struct mem_section Muchun Song
2026-04-05 12:52 ` [PATCH 22/49] mm/sparse: introduce compound page order to mem_section Muchun Song
2026-04-05 12:52 ` [PATCH 23/49] mm/mm_init: skip initializing shared tail pages for compound pages Muchun Song
2026-04-05 12:52 ` [PATCH 24/49] mm/sparse-vmemmap: initialize shared tail vmemmap page upon allocation Muchun Song
2026-04-05 12:52 ` [PATCH 25/49] mm/sparse-vmemmap: support vmemmap-optimizable compound page population Muchun Song
2026-04-05 12:52 ` [PATCH 26/49] mm/hugetlb: use generic vmemmap optimization macros Muchun Song
2026-04-05 12:52 ` [PATCH 27/49] mm: call memblocks_present() before HugeTLB initialization Muchun Song
2026-04-05 12:52 ` [PATCH 28/49] mm/hugetlb: switch HugeTLB to use generic vmemmap optimization Muchun Song
2026-04-05 12:52 ` [PATCH 29/49] mm: extract pfn_to_zone() helper Muchun Song
2026-04-05 12:52 ` [PATCH 30/49] mm/sparse-vmemmap: remove unused SPARSEMEM_VMEMMAP_PREINIT feature Muchun Song
2026-04-05 12:52 ` [PATCH 31/49] mm/hugetlb: remove HUGE_BOOTMEM_HVO flag and simplify pre-HVO logic Muchun Song
2026-04-05 12:52 ` [PATCH 32/49] mm/sparse-vmemmap: consolidate shared tail page allocation Muchun Song
2026-04-05 12:52 ` [PATCH 33/49] mm: introduce CONFIG_SPARSEMEM_VMEMMAP_OPTIMIZATION Muchun Song
2026-04-05 12:52 ` [PATCH 34/49] mm/sparse-vmemmap: switch DAX to use generic vmemmap optimization Muchun Song
2026-04-05 12:52 ` [PATCH 35/49] mm/sparse-vmemmap: introduce section zone to struct mem_section Muchun Song
2026-04-05 12:52 ` [PATCH 36/49] powerpc/mm: use generic vmemmap_shared_tail_page() in compound vmemmap Muchun Song
2026-04-05 12:52 ` [PATCH 37/49] mm/sparse-vmemmap: unify DAX and HugeTLB vmemmap optimization Muchun Song
2026-04-05 12:52 ` [PATCH 38/49] mm/sparse-vmemmap: remap the shared tail pages as read-only Muchun Song
2026-04-05 12:52 ` [PATCH 39/49] mm/sparse-vmemmap: remove unused ptpfn argument Muchun Song
2026-04-05 12:52 ` [PATCH 40/49] mm/hugetlb_vmemmap: remove vmemmap_wrprotect_hvo() and related code Muchun Song
2026-04-05 12:52 ` [PATCH 41/49] mm/sparse: simplify section_vmemmap_pages() Muchun Song
2026-04-05 12:52 ` [PATCH 42/49] mm/sparse-vmemmap: introduce section_vmemmap_page_structs() Muchun Song
2026-04-05 12:52 ` [PATCH 43/49] powerpc/mm: rely on generic vmemmap_can_optimize() to simplify code Muchun Song
2026-04-05 12:52 ` [PATCH 44/49] mm/sparse-vmemmap: drop ARCH_WANT_OPTIMIZE_DAX_VMEMMAP and simplify checks Muchun Song
2026-04-05 12:52 ` [PATCH 45/49] mm/sparse-vmemmap: drop @pgmap parameter from vmemmap populate APIs Muchun Song
2026-04-05 12:52 ` [PATCH 46/49] mm/sparse: replace pgmap with order and zone in sparse_add_section() Muchun Song
2026-04-05 12:52 ` [PATCH 47/49] mm: redefine HVO as Hugepage Vmemmap Optimization Muchun Song
2026-04-05 12:52 ` [PATCH 48/49] Documentation/mm: restructure vmemmap_dedup.rst to reflect generalized HVO Muchun Song
2026-04-05 12:52 ` [PATCH 49/49] mm: consolidate struct page power-of-2 size checks for HVO Muchun Song
2026-04-05 13:34 ` [PATCH 00/49] mm: Generalize vmemmap optimization for DAX and HugeTLB Mike Rapoport
2026-04-06 19:59 ` David Hildenbrand (arm)
2026-04-08 15:29 ` Frank van der Linden

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ADC5EFE8-454D-4B9D-8BB0-39FF671290F0@linux.dev \
    --to=muchun.song@linux.dev \
    --cc=Liam.Howlett@oracle.com \
    --cc=akpm@linux-foundation.org \
    --cc=aneesh.kumar@linux.ibm.com \
    --cc=chleroy@kernel.org \
    --cc=david@kernel.org \
    --cc=joao.m.martins@oracle.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linuxppc-dev@lists.ozlabs.org \
    --cc=ljs@kernel.org \
    --cc=maddy@linux.ibm.com \
    --cc=mhocko@suse.com \
    --cc=mpe@ellerman.id.au \
    --cc=npiggin@gmail.com \
    --cc=osalvador@suse.de \
    --cc=rppt@kernel.org \
    --cc=songmuchun@bytedance.com \
    --cc=surenb@google.com \
    --cc=vbabka@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox