From: Andrew Morton <akpm@linux-foundation.org>
To: Qi Zheng <zhengqi.arch@bytedance.com>
Cc: tkhai@ya.ru, hannes@cmpxchg.org, shakeelb@google.com,
mhocko@kernel.org, roman.gushchin@linux.dev,
muchun.song@linux.dev, david@redhat.com, shy828301@gmail.com,
rppt@kernel.org, sultan@kerneltoast.com, dave@stgolabs.net,
penguin-kernel@I-love.SAKURA.ne.jp, paulmck@kernel.org,
linux-mm@kvack.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH v4 0/8] make slab shrink lockless
Date: Tue, 7 Mar 2023 14:20:26 -0800 [thread overview]
Message-ID: <20230307142026.31c964475fd3c9554a4f62cb@linux-foundation.org> (raw)
In-Reply-To: <20230307065605.58209-1-zhengqi.arch@bytedance.com>
On Tue, 7 Mar 2023 14:55:57 +0800 Qi Zheng <zhengqi.arch@bytedance.com> wrote:
> Hi all,
>
> This patch series aims to make slab shrink lockless.
The v3 discussion did contain requests for some sort of measurements of
real-world workloads. And Kirill did suggest a workload which could be
used for this measurement.
It's quite important that we have this info, please. I mean, speeding
up real-world workloads is the entire point of the patchset and without
measurements, we don't know if the patchset achieves its primary
objective!
> 3. Reproduction and testing
> ===========================
>
> We can reproduce the down_read_trylock() hotspot through the following script:
>
> ```
> #!/bin/bash
>
> DIR="/root/shrinker/memcg/mnt"
>
> do_create()
> {
> mkdir -p /sys/fs/cgroup/memory/test
> mkdir -p /sys/fs/cgroup/perf_event/test
> echo 4G > /sys/fs/cgroup/memory/test/memory.limit_in_bytes
> for i in `seq 0 $1`;
> do
> mkdir -p /sys/fs/cgroup/memory/test/$i;
> echo $$ > /sys/fs/cgroup/memory/test/$i/cgroup.procs;
> echo $$ > /sys/fs/cgroup/perf_event/test/cgroup.procs;
> mkdir -p $DIR/$i;
> done
> }
>
> do_mount()
> {
> for i in `seq $1 $2`;
> do
> mount -t tmpfs $i $DIR/$i;
> done
> }
>
> do_touch()
> {
> for i in `seq $1 $2`;
> do
> echo $$ > /sys/fs/cgroup/memory/test/$i/cgroup.procs;
> echo $$ > /sys/fs/cgroup/perf_event/test/cgroup.procs;
> dd if=/dev/zero of=$DIR/$i/file$i bs=1M count=1 &
> done
> }
>
> case "$1" in
> touch)
> do_touch $2 $3
> ;;
> test)
> do_create 4000
> do_mount 0 4000
> do_touch 0 3000
> ;;
> *)
> exit 1
> ;;
> esac
> ```
>
> Save the above script, then run test and touch commands. Then we can use the
> following perf command to view hotspots:
Well. Simply runnimg
time that-script
before and after and including the info in the changelog would be a start?
next prev parent reply other threads:[~2023-03-07 22:20 UTC|newest]
Thread overview: 35+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-03-07 6:55 Qi Zheng
2023-03-07 6:55 ` [PATCH v4 1/8] mm: vmscan: add a map_nr_max field to shrinker_info Qi Zheng
2023-03-08 14:40 ` Vlastimil Babka
2023-03-08 22:13 ` Kirill Tkhai
2023-03-09 6:33 ` Qi Zheng
2023-03-07 6:55 ` [PATCH v4 2/8] mm: vmscan: make global slab shrink lockless Qi Zheng
2023-03-08 15:02 ` Vlastimil Babka
2023-03-08 22:18 ` Kirill Tkhai
2023-03-07 6:56 ` [PATCH v4 3/8] mm: vmscan: make memcg " Qi Zheng
2023-03-08 22:23 ` Kirill Tkhai
2023-03-08 22:46 ` Vlastimil Babka
2023-03-09 6:47 ` Qi Zheng
2023-03-07 6:56 ` [PATCH v4 4/8] mm: vmscan: add shrinker_srcu_generation Qi Zheng
2023-03-09 9:23 ` Vlastimil Babka
2023-03-09 10:12 ` Qi Zheng
2023-03-07 6:56 ` [PATCH v4 5/8] mm: shrinkers: make count and scan in shrinker debugfs lockless Qi Zheng
2023-03-09 9:36 ` Vlastimil Babka
2023-03-09 9:39 ` Vlastimil Babka
2023-03-09 10:14 ` Qi Zheng
2023-03-09 19:30 ` Kirill Tkhai
2023-03-07 6:56 ` [PATCH v4 6/8] mm: vmscan: hold write lock to reparent shrinker nr_deferred Qi Zheng
2023-03-09 9:36 ` Vlastimil Babka
2023-03-07 6:56 ` [PATCH v4 7/8] mm: vmscan: remove shrinker_rwsem from synchronize_shrinkers() Qi Zheng
2023-03-08 22:39 ` Kirill Tkhai
2023-03-09 7:06 ` Qi Zheng
2023-03-09 8:11 ` Christian König
2023-03-09 8:32 ` Qi Zheng
2023-03-09 19:34 ` Kirill Tkhai
2023-03-09 9:40 ` Vlastimil Babka
2023-03-09 19:34 ` Kirill Tkhai
2023-03-07 6:56 ` [PATCH v4 8/8] mm: shrinkers: convert shrinker_rwsem to mutex Qi Zheng
2023-03-09 9:42 ` Vlastimil Babka
2023-03-09 19:49 ` Kirill Tkhai
2023-03-07 22:20 ` Andrew Morton [this message]
2023-03-08 11:59 ` [PATCH v4 0/8] make slab shrink lockless Qi Zheng
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20230307142026.31c964475fd3c9554a4f62cb@linux-foundation.org \
--to=akpm@linux-foundation.org \
--cc=dave@stgolabs.net \
--cc=david@redhat.com \
--cc=hannes@cmpxchg.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mhocko@kernel.org \
--cc=muchun.song@linux.dev \
--cc=paulmck@kernel.org \
--cc=penguin-kernel@I-love.SAKURA.ne.jp \
--cc=roman.gushchin@linux.dev \
--cc=rppt@kernel.org \
--cc=shakeelb@google.com \
--cc=shy828301@gmail.com \
--cc=sultan@kerneltoast.com \
--cc=tkhai@ya.ru \
--cc=zhengqi.arch@bytedance.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox