From: Suren Baghdasaryan <surenb@google.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: mhocko@suse.com, Johannes Weiner <hannes@cmpxchg.org>,
hillf.zj@alibaba-inc.com, minchan@kernel.org,
mgorman@techsingularity.net, ying.huang@intel.com,
linux-mm@kvack.org, linux-kernel@vger.kernel.org,
Tim Murray <timmurray@google.com>, Todd Kjos <tkjos@google.com>
Subject: Re: [PATCH] mm: terminate shrink_slab loop if signal is pending
Date: Wed, 6 Dec 2017 17:27:19 -0800 [thread overview]
Message-ID: <CAJuCfpHKMamMfw2SW0QnJv_bu4CYLgbHuL0nJ2kwPc8D+44K3w@mail.gmail.com> (raw)
In-Reply-To: <20171206152621.2c263569ea623dd1e0119848@linux-foundation.org>
>
> Some quantification of "quite time consuming" and "delay" would be
> interesting, please.
>
Unfortunately that depends on the implementation of the shrinkers
registered in the system including the ones from drivers. I've
captured traces showing delays of up to 100ms where the process with
pending SIGKILL is in direct memory reclaim and signal handling is
delayed because of that. I realize that it's not the fault of
shrink_slab_lmk() that some shrinkers take long time to shrink their
slabs (sometimes because of justifiable reasons and sometimes because
of a bug which has to be fixed) but this can be a safeguard against
such cases.
Couple shrinker examples that I found most time consuming are (most of
that 100ms delay is the result of the first two ones):
https://patchwork.kernel.org/patch/10096641/
The patch fixes dm-bufio shrinker which in certain conditions reclaims
only one buffer per scan making the shrinking process very
inefficient.
https://android.googlesource.com/kernel/msm/+/android-7.1.0_r0.2/drivers/gpu/msm/kgsl_pool.c#420
This example is from a driver where shrinker returns 0 instead of
SHRINK_STOP when it's unable to reclaim anymore. As a result when
total_scan in do_shrink_slab() is large this will cause multiple
scan_objects() calls with no memory being reclaimed. Patch for this
one is under review by the owners.
Shrinker that seems to be justifiably heavy is super_cache_scan()
inside fs/super.c. I have traces where it takes up to 4ms to complete.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2017-12-07 1:27 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-12-06 19:20 Suren Baghdasaryan
2017-12-06 23:26 ` Andrew Morton
2017-12-07 1:27 ` Suren Baghdasaryan [this message]
2017-12-07 8:34 ` Michal Hocko
2017-12-07 14:34 ` Tetsuo Handa
2017-12-08 0:44 ` Suren Baghdasaryan
2017-12-08 4:37 ` Suren Baghdasaryan
2017-12-08 4:40 ` Suren Baghdasaryan
2017-12-07 9:52 ` Sergey Senozhatsky
2017-12-07 9:58 ` Michal Hocko
2017-12-07 15:46 ` Suren Baghdasaryan
2017-12-07 16:25 ` Michal Hocko
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAJuCfpHKMamMfw2SW0QnJv_bu4CYLgbHuL0nJ2kwPc8D+44K3w@mail.gmail.com \
--to=surenb@google.com \
--cc=akpm@linux-foundation.org \
--cc=hannes@cmpxchg.org \
--cc=hillf.zj@alibaba-inc.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mgorman@techsingularity.net \
--cc=mhocko@suse.com \
--cc=minchan@kernel.org \
--cc=timmurray@google.com \
--cc=tkjos@google.com \
--cc=ying.huang@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox