From: Harry Yoo <harry.yoo@oracle.com>
To: Vlastimil Babka <vbabka@suse.cz>
Cc: akpm@linux-foundation.org, andreyknvl@gmail.com, cl@gentwo.org,
dvyukov@google.com, glider@google.com, hannes@cmpxchg.org,
linux-mm@kvack.org, mhocko@kernel.org, muchun.song@linux.dev,
rientjes@google.com, roman.gushchin@linux.dev,
ryabinin.a.a@gmail.com, shakeel.butt@linux.dev,
surenb@google.com, vincenzo.frascino@arm.com,
yeoreum.yun@arm.com, tytso@mit.edu, adilger.kernel@dilger.ca,
linux-ext4@vger.kernel.org, linux-kernel@vger.kernel.org,
cgroups@vger.kernel.org, hao.li@linux.dev
Subject: Re: [PATCH V6 9/9] mm/slab: place slabobj_ext metadata in unused space within s->size
Date: Tue, 13 Jan 2026 22:32:10 +0900 [thread overview]
Message-ID: <aWZJWkbosy9A_XBD@hyeyoo> (raw)
In-Reply-To: <aWZCHIYsFSaGzRYu@hyeyoo>
On Tue, Jan 13, 2026 at 10:01:16PM +0900, Harry Yoo wrote:
> On Tue, Jan 13, 2026 at 01:50:31PM +0100, Vlastimil Babka wrote:
> > On 1/13/26 7:18 AM, Harry Yoo wrote:
> > > When a cache has high s->align value and s->object_size is not aligned
> > > to it, each object ends up with some unused space because of alignment.
> > > If this wasted space is big enough, we can use it to store the
> > > slabobj_ext metadata instead of wasting it.
> > >
> > > On my system, this happens with caches like kmem_cache, mm_struct, pid,
> > > task_struct, sighand_cache, xfs_inode, and others.
> > >
> > > To place the slabobj_ext metadata within each object, the existing
> > > slab_obj_ext() logic can still be used by setting:
> > >
> > > - slab->obj_exts = slab_address(slab) + (slabobj_ext offset)
> > > - stride = s->size
> > >
> > > slab_obj_ext() doesn't need know where the metadata is stored,
> > > so this method works without adding extra overhead to slab_obj_ext().
> > >
> > > A good example benefiting from this optimization is xfs_inode
> > > (object_size: 992, align: 64). To measure memory savings, 2 millions of
> > > files were created on XFS.
> > >
> > > [ MEMCG=y, MEM_ALLOC_PROFILING=n ]
> > >
> > > Before patch (creating ~2.64M directories on xfs):
> > > Slab: 5175976 kB
> > > SReclaimable: 3837524 kB
> > > SUnreclaim: 1338452 kB
> > >
> > > After patch (creating ~2.64M directories on xfs):
> > > Slab: 5152912 kB
> > > SReclaimable: 3838568 kB
> > > SUnreclaim: 1314344 kB (-23.54 MiB)
> > >
> > > Enjoy the memory savings!
> > >
> > > Suggested-by: Vlastimil Babka <vbabka@suse.cz>
> > > Signed-off-by: Harry Yoo <harry.yoo@oracle.com>
> >
> > Does this look OK to you or was there a reason you didn't do it? :)
> >
> > diff --git a/mm/slub.c b/mm/slub.c
> > index ba15df4ca417..deb69bd9646a 100644
> > --- a/mm/slub.c
> > +++ b/mm/slub.c
> > @@ -981,8 +981,7 @@ static inline bool obj_exts_in_slab(struct kmem_cache *s, struct slab *slab)
> > #if defined(CONFIG_SLAB_OBJ_EXT) && defined(CONFIG_64BIT)
> > static bool obj_exts_in_object(struct kmem_cache *s, struct slab *slab)
> > {
> > - return obj_exts_in_slab(s, slab) &&
> > - (slab_get_stride(slab) == s->size);
> > + return obj_exts_in_slab(s, slab) && (s->flags & SLAB_OBJ_EXT_IN_OBJ);
>
> There was a reason why I didn't do it :)
>
> In alloc_slab_obj_exts_early(), when both
> obj_exts_fit_within_slab_leftover() and (s->flags & SLAB_OBJ_EXT_IN_OBJ)
> returns true, it allocates the metadata from the slab's leftover space.
>
> I noticed it as I saw a slab error in slab_pad_check() complaining that
> the padding area was overwritten, but turned out the problem was
> because obj_exts_in_object() returning true when it shouldn't.
Perhaps a comment like this?
diff --git a/mm/slub.c b/mm/slub.c
index ba15df4ca417..c40c3559039e 100644
--- a/mm/slub.c
+++ b/mm/slub.c
@@ -981,6 +981,15 @@ static inline bool obj_exts_in_slab(struct kmem_cache *s, struct slab *slab)
#if defined(CONFIG_SLAB_OBJ_EXT) && defined(CONFIG_64BIT)
static bool obj_exts_in_object(struct kmem_cache *s, struct slab *slab)
{
+ /*
+ * When SLAB_OBJ_EXT_IN_OBJ is set, slabobj_ext metadata can be stored
+ * in one of two ways:
+ * 1. As an array in the slab's leftover space (after the last object)
+ * 2. Inline with each object (within s->size)
+ *
+ * The actual placement is determined by the stride size rather than
+ * the SLAB_OBJ_EXT_IN_OBJ flag itself.
+ */
return obj_exts_in_slab(s, slab) &&
(slab_get_stride(slab) == s->size);
}
next prev parent reply other threads:[~2026-01-13 13:32 UTC|newest]
Thread overview: 18+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-13 6:18 [PATCH V6 0/9] mm/slab: reduce slab accounting memory overhead by allocating slabobj_ext metadata within unsed slab space Harry Yoo
2026-01-13 6:18 ` [PATCH V6 1/9] mm/slab: use unsigned long for orig_size to ensure proper metadata align Harry Yoo
2026-01-13 6:18 ` [PATCH V6 2/9] mm/slab: allow specifying free pointer offset when using constructor Harry Yoo
2026-01-13 6:18 ` [PATCH V6 3/9] ext4: specify the free pointer offset for ext4_inode_cache Harry Yoo
2026-01-13 6:18 ` [PATCH V6 4/9] mm/slab: abstract slabobj_ext access via new slab_obj_ext() helper Harry Yoo
2026-01-13 6:18 ` [PATCH V6 5/9] mm/slab: use stride to access slabobj_ext Harry Yoo
2026-01-13 6:18 ` [PATCH V6 6/9] mm/memcontrol,alloc_tag: handle slabobj_ext access under KASAN poison Harry Yoo
2026-01-13 6:18 ` [PATCH V6 7/9] mm/slab: save memory by allocating slabobj_ext array from leftover Harry Yoo
2026-01-13 6:18 ` [PATCH V6 8/9] mm/slab: move [__]ksize and slab_ksize() to mm/slub.c Harry Yoo
2026-01-13 12:44 ` Vlastimil Babka
2026-01-13 13:05 ` Harry Yoo
2026-01-13 13:45 ` Vlastimil Babka
2026-01-13 6:18 ` [PATCH V6 9/9] mm/slab: place slabobj_ext metadata in unused space within s->size Harry Yoo
2026-01-13 12:50 ` Vlastimil Babka
2026-01-13 13:01 ` Harry Yoo
2026-01-13 13:32 ` Harry Yoo [this message]
2026-01-13 13:42 ` Vlastimil Babka
2026-01-13 14:13 ` [PATCH V6 0/9] mm/slab: reduce slab accounting memory overhead by allocating slabobj_ext metadata within unsed slab space Vlastimil Babka
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=aWZJWkbosy9A_XBD@hyeyoo \
--to=harry.yoo@oracle.com \
--cc=adilger.kernel@dilger.ca \
--cc=akpm@linux-foundation.org \
--cc=andreyknvl@gmail.com \
--cc=cgroups@vger.kernel.org \
--cc=cl@gentwo.org \
--cc=dvyukov@google.com \
--cc=glider@google.com \
--cc=hannes@cmpxchg.org \
--cc=hao.li@linux.dev \
--cc=linux-ext4@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mhocko@kernel.org \
--cc=muchun.song@linux.dev \
--cc=rientjes@google.com \
--cc=roman.gushchin@linux.dev \
--cc=ryabinin.a.a@gmail.com \
--cc=shakeel.butt@linux.dev \
--cc=surenb@google.com \
--cc=tytso@mit.edu \
--cc=vbabka@suse.cz \
--cc=vincenzo.frascino@arm.com \
--cc=yeoreum.yun@arm.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox