From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail143.messagelabs.com (mail143.messagelabs.com [216.82.254.35]) by kanga.kvack.org (Postfix) with SMTP id B692E6B003D for ; Thu, 3 Dec 2009 00:25:45 -0500 (EST) Received: from m3.gw.fujitsu.co.jp ([10.0.50.73]) by fgwmail7.fujitsu.co.jp (Fujitsu Gateway) with ESMTP id nB35PhAP017513 for (envelope-from kamezawa.hiroyu@jp.fujitsu.com); Thu, 3 Dec 2009 14:25:43 +0900 Received: from smail (m3 [127.0.0.1]) by outgoing.m3.gw.fujitsu.co.jp (Postfix) with ESMTP id 3657145DE50 for ; Thu, 3 Dec 2009 14:25:43 +0900 (JST) Received: from s3.gw.fujitsu.co.jp (s3.gw.fujitsu.co.jp [10.0.50.93]) by m3.gw.fujitsu.co.jp (Postfix) with ESMTP id 0A9C945DE4D for ; Thu, 3 Dec 2009 14:25:43 +0900 (JST) Received: from s3.gw.fujitsu.co.jp (localhost.localdomain [127.0.0.1]) by s3.gw.fujitsu.co.jp (Postfix) with ESMTP id DBA761DB8037 for ; Thu, 3 Dec 2009 14:25:42 +0900 (JST) Received: from m105.s.css.fujitsu.com (m105.s.css.fujitsu.com [10.249.87.105]) by s3.gw.fujitsu.co.jp (Postfix) with ESMTP id 7D8E1E08001 for ; Thu, 3 Dec 2009 14:25:42 +0900 (JST) Date: Thu, 3 Dec 2009 14:22:43 +0900 From: KAMEZAWA Hiroyuki Subject: Re: [PATCH -mmotm 4/5] memcg: avoid oom during recharge at task move Message-Id: <20091203142243.5222d7bb.kamezawa.hiroyu@jp.fujitsu.com> In-Reply-To: <20091203135805.23a8b0f7.nishimura@mxp.nes.nec.co.jp> References: <20091119132734.1757fc42.nishimura@mxp.nes.nec.co.jp> <20091119133030.8ef46be0.nishimura@mxp.nes.nec.co.jp> <20091123051041.GQ31961@balbir.in.ibm.com> <20091124114358.80e0cafe.nishimura@mxp.nes.nec.co.jp> <20091127135810.ef5fee0b.nishimura@mxp.nes.nec.co.jp> <20091203135805.23a8b0f7.nishimura@mxp.nes.nec.co.jp> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Sender: owner-linux-mm@kvack.org To: Daisuke Nishimura Cc: Balbir Singh , linux-mm , Andrew Morton , Li Zefan , Paul Menage List-ID: On Thu, 3 Dec 2009 13:58:05 +0900 Daisuke Nishimura wrote: > I'm now trying to decrease these overhead as much as possible, and the current > status is bellow. > thanks. > (support for moving swap charge has not been pushed yet in my tree, so I tested > only (1) and (2) cases.) > > | 252M | 512M | 1G > -----+--------+--------+-------- > (1) | 0.20 | 0.40 | 0.81 > -----+--------+--------+-------- > (2) | 0.20 | 0.40 | 0.81 > What is the unit of each numbers ? seconds ? And migration of a process with 1G bytes requires 0.8sec ? But, hmm, speed up twice! sounds nice. > What I've done are are: > - Instead of calling res_counter_uncharge() against the old cgroup in __mem_cgroup_move_account() > evrytime, call res_counter_uncharge(PAGE_SIZE * moved) at the end of task migration once. sounds reasonable. > - Instead of calling try_charge repeatedly, call res_counter_charge(PAGE_SIZE * necessary) > in can_attach() if possible. sounds reasonable, too. > - Not only res_counter_charge/uncharge, consolidate css_get()/put() too. > please do. But, hmm, I'd like to remove css_put/get per pages ;) But I put it aside now. > > BTW, KAMEZAWA-san, are you planning to add mm_counter for swap yet ? yes. please see my newest patch ;) extreme one.http://marc.info/?l=linux-mm&m=125980393923228&w=2 > To tell the truth, instead of making use of mm_counter, I want to parse the page table > in can_attach as I did before, because: > - parsing the page table in can_attach seems not to add so big overheads(see below). ok. > - if we add support for file-cache and shmem in future, I think we need to parse the page table > anyway, because there is no independent mm_counter for shmem. I want to treat them > independently because users don't consider shmem as file-cahce, IMHO. > ok. about scanning page tables. Moving 1G means moving 262144, scanning 128 page tables. Maybe not very big cost. I still doubt moving "shared" pages "silently" is useful but it's another topic, here. > (parsing the page table in can_attach) > | 252M | 512M | 1G > -----+--------+--------+-------- > (1) | 0.21 | 0.41 | 0.83 > -----+--------+--------+-------- > (2) | 0.21 | 0.41 | 0.83 > > Hopefully, I want to post a new version in this week. > Thank you for your efforts. Thanks, -Kame -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org