From: "David Hildenbrand (Red Hat)" <david@kernel.org>
To: Usama Arif <usamaarif642@gmail.com>, Kiryl Shutsemau <kas@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
Muchun Song <muchun.song@linux.dev>,
Matthew Wilcox <willy@infradead.org>,
Oscar Salvador <osalvador@suse.de>,
Mike Rapoport <rppt@kernel.org>, Vlastimil Babka <vbabka@suse.cz>,
Lorenzo Stoakes <lorenzo.stoakes@oracle.com>,
Zi Yan <ziy@nvidia.com>, Baoquan He <bhe@redhat.com>,
Michal Hocko <mhocko@suse.com>,
Johannes Weiner <hannes@cmpxchg.org>,
Jonathan Corbet <corbet@lwn.net>,
kernel-team@meta.com, linux-mm@kvack.org,
linux-kernel@vger.kernel.org, linux-doc@vger.kernel.org
Subject: Re: [PATCH 00/11] mm/hugetlb: Eliminate fake head pages from vmemmap optimization
Date: Mon, 8 Dec 2025 10:53:26 +0100 [thread overview]
Message-ID: <66b6e4fa-9541-4cc8-8578-dbffd5f19ecc@kernel.org> (raw)
In-Reply-To: <8e59b242-6311-48a7-b9f5-e698c4eccd2e@gmail.com>
On 12/6/25 18:47, Usama Arif wrote:
>
>
> On 05/12/2025 21:41, Kiryl Shutsemau wrote:
>> On Fri, Dec 05, 2025 at 10:34:48PM +0100, David Hildenbrand (Red Hat) wrote:
>>> On 12/5/25 21:54, Kiryl Shutsemau wrote:
>>>> On Fri, Dec 05, 2025 at 09:44:30PM +0100, David Hildenbrand (Red Hat) wrote:
>>>>> On 12/5/25 21:33, Kiryl Shutsemau wrote:
>>>>>> On Fri, Dec 05, 2025 at 09:16:08PM +0100, David Hildenbrand (Red Hat) wrote:
>>>>>>> On 12/5/25 20:43, Kiryl Shutsemau wrote:
>>>>>>>> This series removes "fake head pages" from the HugeTLB vmemmap
>>>>>>>> optimization (HVO) by changing how tail pages encode their relationship
>>>>>>>> to the head page.
>>>>>>>>
>>>>>>>> It simplifies compound_head() and page_ref_add_unless(). Both are in the
>>>>>>>> hot path.
>>>>>>>>
>>>>>>>> Background
>>>>>>>> ==========
>>>>>>>>
>>>>>>>> HVO reduces memory overhead by freeing vmemmap pages for HugeTLB pages
>>>>>>>> and remapping the freed virtual addresses to a single physical page.
>>>>>>>> Previously, all tail page vmemmap entries were remapped to the first
>>>>>>>> vmemmap page (containing the head struct page), creating "fake heads" -
>>>>>>>> tail pages that appear to have PG_head set when accessed through the
>>>>>>>> deduplicated vmemmap.
>>>>>>>>
>>>>>>>> This required special handling in compound_head() to detect and work
>>>>>>>> around fake heads, adding complexity and overhead to a very hot path.
>>>>>>>>
>>>>>>>> New Approach
>>>>>>>> ============
>>>>>>>>
>>>>>>>> For architectures/configs where sizeof(struct page) is a power of 2 (the
>>>>>>>> common case), this series changes how position of the head page is encoded
>>>>>>>> in the tail pages.
>>>>>>>>
>>>>>>>> Instead of storing a pointer to the head page, the ->compound_info
>>>>>>>> (renamed from ->compound_head) now stores a mask.
>>>>>>>
>>>>>>> (we're in the merge window)
>>>>>>>
>>>>>>> That doesn't seem to be suitable for the memdesc plans, where we want all
>>>>>>> tail pages do directly point at the allocated memdesc (e.g., struct folio),
>>>>>>> no?
>>>>>>
>>>>>> Sure. My understanding is that it is going to eliminate a need in
>>>>>> compound_head() completely. I don't see the conflict so far.
>>>>>
>>>>> Right. All compound_head pointers will point at the allocated memdesc.
>>>>>
>>>>> Would we still have to detect fake head pages though (at least for some
>>>>> transition period)?
>>>>
>>>> If we need to detect if the memdesc is tail it should be as trivial as
>>>> comparing the given memdesc to the memdesc - 1. If they match, you are
>>>> looking at the tail.
>>>
>>> How could you assume memdesc - 1 exists without performing other checks?
>>
>> Map zero page in front of every discontinuous vmemmap region :P
>>
>
> I made an initial pass at reviewing the series. I think the best thing about this is that
> someone looking at compound_head won't need to understand HVO to know how compound_head works,
> so its a very nice clean up :)
Yeah, I am also not a particular fan of fake-head detection code, and
how this hugetlb monstrosity affects our implementation of compound
pages. :)
Moving from compound_head -> compound_info sounds like a suboptimal
temporary step, though, as we want compound_head to to point at "struct
folio" etc soon (either allocated separately or an overlay of "struct
page", based on a config option). So operating on vmemmap addresses is
not what the new world will look like.
Of course, we could lookup the head page first and then use the memdesc
pointer in there to get our "struct folio", but it will be one
unnecessary roundtrip through the head page.
I'm sure Willy has an opinion on this. but likely has other priorities
given we are in the merge window and LPC is coming up.
--
Cheers
David
next prev parent reply other threads:[~2025-12-08 9:53 UTC|newest]
Thread overview: 33+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-12-05 19:43 Kiryl Shutsemau
2025-12-05 19:43 ` [PATCH 01/11] mm: Change the interface of prep_compound_tail() Kiryl Shutsemau
2025-12-05 21:49 ` Usama Arif
2025-12-05 22:10 ` Kiryl Shutsemau
2025-12-05 22:15 ` Usama Arif
2025-12-05 19:43 ` [PATCH 02/11] mm: Rename the 'compound_head' field in the 'struct page' to 'compound_info' Kiryl Shutsemau
2025-12-05 19:43 ` [PATCH 03/11] mm: Move set/clear_compound_head() to compound_head() Kiryl Shutsemau
2025-12-05 19:43 ` [PATCH 04/11] mm: Rework compound_head() for power-of-2 sizeof(struct page) Kiryl Shutsemau
2025-12-06 0:25 ` Usama Arif
2025-12-06 16:29 ` Kiryl Shutsemau
2025-12-06 17:36 ` Usama Arif
2025-12-05 19:43 ` [PATCH 05/11] mm/hugetlb: Refactor code around vmemmap_walk Kiryl Shutsemau
2025-12-06 16:42 ` Usama Arif
2025-12-08 10:30 ` Kiryl Shutsemau
2025-12-05 19:43 ` [PATCH 06/11] mm/hugetlb: Remove fake head pages Kiryl Shutsemau
2025-12-06 17:03 ` Usama Arif
2025-12-08 10:40 ` Kiryl Shutsemau
2025-12-05 19:43 ` [PATCH 07/11] mm: Drop fake head checks and fix a race condition Kiryl Shutsemau
2025-12-06 17:27 ` Usama Arif
2025-12-08 10:48 ` Kiryl Shutsemau
2025-12-05 19:43 ` [PATCH 08/11] hugetlb: Remove VMEMMAP_SYNCHRONIZE_RCU Kiryl Shutsemau
2025-12-05 19:43 ` [PATCH 09/11] mm/hugetlb: Remove hugetlb_optimize_vmemmap_key static key Kiryl Shutsemau
2025-12-05 19:43 ` [PATCH 10/11] mm: Remove the branch from compound_head() Kiryl Shutsemau
2025-12-05 19:43 ` [PATCH 11/11] hugetlb: Update vmemmap_dedup.rst Kiryl Shutsemau
2025-12-05 20:16 ` [PATCH 00/11] mm/hugetlb: Eliminate fake head pages from vmemmap optimization David Hildenbrand (Red Hat)
2025-12-05 20:33 ` Kiryl Shutsemau
2025-12-05 20:44 ` David Hildenbrand (Red Hat)
2025-12-05 20:54 ` Kiryl Shutsemau
2025-12-05 21:34 ` David Hildenbrand (Red Hat)
2025-12-05 21:41 ` Kiryl Shutsemau
2025-12-06 17:47 ` Usama Arif
2025-12-08 9:53 ` David Hildenbrand (Red Hat) [this message]
2025-12-08 8:51 ` David Hildenbrand (Red Hat)
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=66b6e4fa-9541-4cc8-8578-dbffd5f19ecc@kernel.org \
--to=david@kernel.org \
--cc=akpm@linux-foundation.org \
--cc=bhe@redhat.com \
--cc=corbet@lwn.net \
--cc=hannes@cmpxchg.org \
--cc=kas@kernel.org \
--cc=kernel-team@meta.com \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=lorenzo.stoakes@oracle.com \
--cc=mhocko@suse.com \
--cc=muchun.song@linux.dev \
--cc=osalvador@suse.de \
--cc=rppt@kernel.org \
--cc=usamaarif642@gmail.com \
--cc=vbabka@suse.cz \
--cc=willy@infradead.org \
--cc=ziy@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox