From: David Rientjes <rientjes@google.com>
To: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>
Cc: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
Andrew Morton <akpm@linux-foundation.org>,
Daisuke Nishimura <nishimura@mxp.nes.nec.co.jp>,
linux-mm@kvack.org, linux-kernel@vger.kernel.org,
Christoph Lameter <cl@linux-foundation.org>
Subject: Re: [BUGFIX][PATCH] oom-kill: fix NUMA consraint check with nodemask v4.2
Date: Thu, 17 Dec 2009 14:21:49 -0800 (PST) [thread overview]
Message-ID: <alpine.DEB.2.00.0912171412280.4089@chino.kir.corp.google.com> (raw)
In-Reply-To: <20091215135902.CDD6.A69D9226@jp.fujitsu.com>
On Tue, 15 Dec 2009, KOSAKI Motohiro wrote:
> > A few requirements that I have:
>
> Um, good analysis! really.
>
> >
> > - we must be able to define when a task is a memory hogger; this is
> > currently done by /proc/pid/oom_adj relying on the overall total_vm
> > size of the task as a baseline. Most users should have a good sense
> > of when their task is using more memory than expected and killing a
> > memory leaker should always be the optimal oom killer result. A better
> > set of units other than a shift on total_vm would be helpful, though.
>
> nit: What's mean "Most users"? desktop user(one of most majority users)
> don't have any expection of memory usage.
>
> but, if admin have memory expection, they should be able to tune
> optimal oom result.
>
> I think you pointed right thing.
>
This is mostly referring to production server users where memory
consumption by particular applications can be estimated, which allows the
kernel to determine when a task is using a wildly unexpected amount that
happens to become egregious enough to force the oom killer into killing a
task.
That is contrast to using rss as a baseline where we prefer on killing the
application with the most resident RAM. It is not always ideal to kill a
task with 8GB of rss when we fail to allocate a single page for a low
priority task.
> > - we must prefer tasks that run on a cpuset or mempolicy's nodes if the
> > oom condition is constrained by that cpuset or mempolicy and its not a
> > system-wide issue.
>
> agreed. (who disagree it?)
>
It's possible to nullify the current penalization in the badness heuristic
(order 3 reduction) if a candidate task does not share nodes with
current's allowed set either by way of cpusets or mempolicies. For
example, an oom caused by an application with an MPOL_BIND on a single
node can easily kill a task that has no memory resident on that node if
its usage (or rss) is 3 orders higher than any candidate that is allowed
on my bound node.
> > - we must be able to polarize the badness heuristic to always select a
> > particular task is if its very low priority or disable oom killing for
> > a task if its must-run.
>
> Probably I haven't catch your point. What's mean "polarize"? Can you
> please describe more?
>
We need to be able to polarize tasks so they are always killed regardless
of any kernel heuristic (/proc/pid/oom_adj of +15, currently) or always
chosen last (-16, currently). We also need a way of completely disabling
oom killing for certain tasks such as with OOM_DISABLE.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2009-12-17 22:22 UTC|newest]
Thread overview: 46+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-11-04 8:09 [BUGFIX][PATCH] oom-kill: fix NUMA consraint check with nodemask KAMEZAWA Hiroyuki
2009-11-06 0:02 ` [BUGFIX][PATCH] oom-kill: fix NUMA consraint check with nodemask v2 KAMEZAWA Hiroyuki
2009-11-10 7:24 ` KOSAKI Motohiro
2009-11-10 7:24 ` KAMEZAWA Hiroyuki
2009-11-10 7:39 ` KOSAKI Motohiro
2009-11-10 7:40 ` KAMEZAWA Hiroyuki
2009-11-10 8:03 ` Daisuke Nishimura
2009-11-10 8:17 ` KAMEZAWA Hiroyuki
2009-11-11 2:24 ` [BUGFIX][PATCH] oom-kill: fix NUMA consraint check with nodemask v3 KAMEZAWA Hiroyuki
2009-11-11 2:36 ` KOSAKI Motohiro
2009-11-11 2:49 ` David Rientjes
2009-11-11 3:02 ` KOSAKI Motohiro
2009-11-11 3:10 ` KAMEZAWA Hiroyuki
2009-11-11 3:14 ` David Rientjes
2009-11-11 3:23 ` KOSAKI Motohiro
2009-11-11 3:27 ` David Rientjes
2009-11-11 3:04 ` KAMEZAWA Hiroyuki
2009-11-11 4:45 ` [BUGFIX][PATCH] oom-kill: fix NUMA consraint check with nodemask v4 KAMEZAWA Hiroyuki
2009-11-11 5:28 ` [BUGFIX][PATCH] oom-kill: fix NUMA consraint check with nodemask v4.1 KAMEZAWA Hiroyuki
2009-11-11 5:58 ` David Rientjes
2009-11-11 6:20 ` KAMEZAWA Hiroyuki
2009-11-11 6:26 ` David Rientjes
2009-11-11 6:34 ` [BUGFIX][PATCH] oom-kill: fix NUMA consraint check with nodemask v4.2 KAMEZAWA Hiroyuki
2009-11-11 7:32 ` David Rientjes
2009-11-18 0:11 ` David Rientjes
2009-11-18 0:58 ` KAMEZAWA Hiroyuki
2009-11-18 2:13 ` David Rientjes
2009-12-15 1:16 ` Andrew Morton
2009-12-15 1:32 ` KAMEZAWA Hiroyuki
2009-12-15 1:38 ` KOSAKI Motohiro
2009-12-15 4:30 ` David Rientjes
2009-12-15 4:35 ` KAMEZAWA Hiroyuki
2009-12-15 4:54 ` David Rientjes
2009-12-15 5:19 ` KOSAKI Motohiro
2009-12-17 22:21 ` David Rientjes [this message]
2009-12-18 4:30 ` KOSAKI Motohiro
2009-12-18 10:04 ` David Rientjes
2009-12-15 4:57 ` KAMEZAWA Hiroyuki
2009-12-15 4:43 ` KAMEZAWA Hiroyuki
2009-12-15 4:57 ` David Rientjes
2009-12-15 5:09 ` KAMEZAWA Hiroyuki
2009-12-17 22:23 ` David Rientjes
2009-12-17 23:33 ` KAMEZAWA Hiroyuki
2009-12-15 4:47 ` KOSAKI Motohiro
2009-12-15 5:03 ` David Rientjes
2009-11-18 1:41 ` Daisuke Nishimura
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=alpine.DEB.2.00.0912171412280.4089@chino.kir.corp.google.com \
--to=rientjes@google.com \
--cc=akpm@linux-foundation.org \
--cc=cl@linux-foundation.org \
--cc=kamezawa.hiroyu@jp.fujitsu.com \
--cc=kosaki.motohiro@jp.fujitsu.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=nishimura@mxp.nes.nec.co.jp \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox