linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Suleiman Souhlal <suleiman@google.com>
To: Pavel Emelyanov <xemul@parallels.com>
Cc: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
	balbir@linux.vnet.ibm.com, David Rientjes <rientjes@google.com>,
	Ying Han <yinghan@google.com>,
	linux-mm@kvack.org
Subject: Re: memcg: slab control
Date: Thu, 26 Nov 2009 04:52:00 -0800	[thread overview]
Message-ID: <d26f1ae00911260452w7da1f10fk5889e9506aeb1400@mail.gmail.com> (raw)
In-Reply-To: <4B0E7530.8050304@parallels.com>

On 11/26/09, Pavel Emelyanov <xemul@parallels.com> wrote:
> > Aren't there patches to make the kernel track which cgroup caused
>  > which disk I/O? If so, it should be possible to charge the bios to the
>  > right cgroup.
>  >
>  > Maybe one way to decide which kernel allocations should be accounted
>  > would be to look at the calling context: If the allocation is done in
>  > user context (syscall), then it could be counted towards that user,
>  > while if the allocation is done in interrupt or kthread context, it
>  > shouldn't be accounted.
>  >
>  > Of course, this wouldn't be perfect, but it might be a good enough
>  > approximation.
>
>
> I disagree. Bio-s are allocated in user context for all typical reads
>  (unless we requested aio) and are allocated either in pdflush context
>  or (!) in arbitrary task context for writes (e.g. via try_to_free_pages)
>  and thus such bio/buffer_head accounting will be completely random.

Yes, that's why I pointed out that you can account to the right cgroup
if you track who caused the I/O (which, I imagine, should already be
done by the block i/o bandwidth controller, or similar).

For most other allocations, on the other hand, accounting to the
current context should be fine.

>  One of the way to achieve the goal I can propose the following (it's
>  not perfect, but just smth to start discussion from).
>
>  We implement support for accounting based on a bit on a kmem_cache
>  structure and mark all kmalloc caches as not-accountable. Then we grep
>  the kernel to find all kmalloc-s and think - if a kmalloc is to be
>  accounted we turn this into kmem_cache_alloc() with dedicated
>  kmem_cache and mark it as accountable.

That sounds like a lot of work. :-)

-- Suleiman

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2009-11-26 12:52 UTC|newest]

Thread overview: 33+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-11-25 23:08 David Rientjes
2009-11-26  1:14 ` KAMEZAWA Hiroyuki
2009-11-26  8:50   ` Balbir Singh
2009-11-26  8:56     ` KAMEZAWA Hiroyuki
2009-11-26  9:10       ` Pavel Emelyanov
2009-11-26  9:33         ` KAMEZAWA Hiroyuki
2009-11-26  9:56           ` Pavel Emelyanov
2009-11-26 10:24             ` Suleiman Souhlal
2009-11-26 12:31               ` Pavel Emelyanov
2009-11-26 12:52                 ` Suleiman Souhlal [this message]
2009-12-01  7:40                   ` Balbir Singh
2009-11-27  7:15                 ` Ying Han
2009-11-27  9:45                   ` Pavel Emelyanov
2009-12-01  5:14                   ` KOSAKI Motohiro
2009-11-30 22:57                 ` David Rientjes
2009-12-01 10:31                   ` Pavel Emelyanov
2009-12-01 22:29                     ` David Rientjes
2009-12-01  7:36             ` Balbir Singh
2009-12-01 10:40               ` Pavel Emelyanov
2009-12-01 15:14                 ` Balbir Singh
2009-12-02 10:14                   ` Pavel Emelyanov
2009-12-02 10:19                     ` Balbir Singh
2009-12-02 10:51                       ` Pavel Emelyanov
2009-11-30 22:55         ` David Rientjes
2009-12-01 10:39           ` Pavel Emelyanov
2009-11-26 10:13     ` Suleiman Souhlal
2009-11-30  9:17       ` Balbir Singh
2009-11-30 22:45   ` David Rientjes
2009-11-26  1:17 ` KAMEZAWA Hiroyuki
2009-11-26 10:01   ` Suleiman Souhlal
2009-11-26  2:35 ` KOSAKI Motohiro
2009-11-27  7:01   ` Ying Han
2009-11-27  9:48     ` Pavel Emelyanov

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=d26f1ae00911260452w7da1f10fk5889e9506aeb1400@mail.gmail.com \
    --to=suleiman@google.com \
    --cc=balbir@linux.vnet.ibm.com \
    --cc=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=linux-mm@kvack.org \
    --cc=rientjes@google.com \
    --cc=xemul@parallels.com \
    --cc=yinghan@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox