From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail6.bemta8.messagelabs.com (mail6.bemta8.messagelabs.com [216.82.243.55]) by kanga.kvack.org (Postfix) with ESMTP id 08CAF6B002C for ; Wed, 12 Oct 2011 16:26:29 -0400 (EDT) Received: from hpaq5.eem.corp.google.com (hpaq5.eem.corp.google.com [172.25.149.5]) by smtp-out.google.com with ESMTP id p9CKQQpv020704 for ; Wed, 12 Oct 2011 13:26:26 -0700 Received: from pzd13 (pzd13.prod.google.com [10.243.17.205]) by hpaq5.eem.corp.google.com with ESMTP id p9CKO6Zw022490 (version=TLSv1/SSLv3 cipher=RC4-SHA bits=128 verify=NOT) for ; Wed, 12 Oct 2011 13:26:25 -0700 Received: by pzd13 with SMTP id 13so1409900pzd.3 for ; Wed, 12 Oct 2011 13:26:24 -0700 (PDT) Date: Wed, 12 Oct 2011 13:26:22 -0700 (PDT) From: David Rientjes Subject: Re: [PATCH -v2 -mm] add extra free kbytes tunable In-Reply-To: <4E95F167.5050709@redhat.com> Message-ID: References: <20110901105208.3849a8ff@annuminas.surriel.com> <20110901100650.6d884589.rdunlap@xenotime.net> <20110901152650.7a63cb8b@annuminas.surriel.com> <20111010153723.6397924f.akpm@linux-foundation.org> <65795E11DBF1E645A09CEC7EAEE94B9CB516CBC4@USINDEVS02.corp.hds.com> <20111011125419.2702b5dc.akpm@linux-foundation.org> <65795E11DBF1E645A09CEC7EAEE94B9CB516CBFE@USINDEVS02.corp.hds.com> <20111011135445.f580749b.akpm@linux-foundation.org> <4E95917D.3080507@redhat.com> <20111012122018.690bdf28.akpm@linux-foundation.org> <4E95F167.5050709@redhat.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-linux-mm@kvack.org List-ID: To: Rik van Riel Cc: Andrew Morton , Satoru Moriya , Randy Dunlap , Satoru Moriya , "linux-kernel@vger.kernel.org" , "linux-mm@kvack.org" , "lwoodman@redhat.com" , Seiji Aguchi , "hughd@google.com" , "hannes@cmpxchg.org" On Wed, 12 Oct 2011, Rik van Riel wrote: > > > The problem is that we may be dealing with bursts, not steady > > > states of allocations. Without knowing the size of a burst, > > > we have no idea when we should wake up kswapd to get enough > > > memory freed ahead of the application's allocations. > > Raising the priority of kswapd to be the highest possible when triggered by rt-tasks should help to reclaim memory faster. If that doesn't work fully with Con's patch on Satoru's testcase then we'll want to extend it to raise the priority for a running kswapd when a higher priority thread calls into the page allocator slowpath. If that also doesn't mitigate the problem entirely, then we'll need to suggest raising min_free_kbytes so these threads have a larger pool of exclusive access to memory when the burst first happens. > > That problem remains with this patch - it just takes a larger burst. > > > > Unless the admin somehow manages to configure the tunable large enough > > to cover the largest burst, and there aren't other applications > > allocating memory during that burst, and the time between bursts is > > sufficient for kswapd to be able to sufficiently replenish free-page > > reserves. All of which sounds rather unlikely. > > It depends on the system. For a setup which is packed to > the brim with workloads, this patch is not likely to help. > On the other hand, on a system that is packed to the brim > with workloads, you are unlikely to get low latencies anyway. > > For situations where people really care about low latencies, > I imagine having dedicated hardware for a workload is not at > all unusual, and the patch works for that. > If it's dedicated hardware, then you should be able to just raise min_free_kbytes so that rt-tasks get exclusive access to a larger amount of memory. -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Fight unfair telecom internet charges in Canada: sign http://stopthemeter.ca/ Don't email: email@kvack.org