From: Peter Zijlstra <a.p.zijlstra@chello.nl>
To: Christoph Lameter <clameter@sgi.com>
Cc: Linus Torvalds <torvalds@osdl.org>, Andi Kleen <ak@suse.de>,
Rohit Seth <rohitseth@google.com>, Andrew Morton <akpm@osdl.org>,
mbligh@google.com, hugh@veritas.com, riel@redhat.com,
andrea@suse.de, arjan@infradead.org, apw@shadowen.org,
mel@csn.ul.ie, marcelo@kvack.org, anton@samba.org,
paulmck@us.ibm.com, Nick Piggin <piggin@cyberone.com.au>,
linux-mm <linux-mm@kvack.org>,
Nikita Danilov <nikita@clusterfs.com>
Subject: Re: [RFC][PATCH] inactive_clean
Date: Mon, 19 Jun 2006 20:10:23 +0200 [thread overview]
Message-ID: <1150740624.28517.108.camel@lappy> (raw)
In-Reply-To: <Pine.LNX.4.64.0606190837450.1184@schroedinger.engr.sgi.com>
On Mon, 2006-06-19 at 08:45 -0700, Christoph Lameter wrote:
> On Mon, 19 Jun 2006, Peter Zijlstra wrote:
>
> > My previous efforts at tracking dirty pages focused on shared pages.
> > But shared pages are not all and, quite often even a small part of the
> > problem. Most 'normal' workloads are dominated by anonymous pages.
>
> Shared pages are the major problem because we have no way of tracking
> their dirty state. Shared file mapped pages are a problem because they require
> writeout which will not occur if we are not aware of them. The dirty state
> of anonymous pages typically does not matter because these pages are
> thrown away when a process terminates.
>
> > So, in order to guarantee easily freeable pages we also have to look
> > at anonymous memory. Thinking about it I arrived at something Rik
> > invented long ago: the inactive_clean list - a third LRU list consisting
> > of clean page
>
> I fail to see the point. What is the problem with anonymous memory? Swap?
http://linux-mm.org/NetworkStorageDeadlock
Basically, we want to free memory, but freeing costs more memory than we
currently have available.
This patch creates a pool of pages that can be evicted without IO, but
can also be taken back into service, again without IO - hence not
'wasting' memory being free.
The problem is currently being circumvented on several levels with local
mempools, these fragment the available free memory and require extra
complexity to manage.
Yes, raising the number of free pages will have the same effect, however
it wastes memory from another point of view.
Neither of these approaches will really solve the 'Network' problem,
because it does not come with a finite bound of memory. Any networked
storage can require inf. amount of memory for a single writeback.
Usually things are not that bad, esp. with dedicated storage networks
that avoid too much protocols stacks.
The only solution for the networked problem is in dropping non-critical
packets when we start to run low.
Also this does give more leeway to make things like cluster pageout:
http://linuxhacker.ru/~nikita/patches/2.6.15-rc1/05-cluster-pageout.patch
work.
In the end, I want to be able to run a diskless system, with networked
swap and, have stuff like cluster pageout working without the machine
going funny on me.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2006-06-19 18:10 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2006-06-19 12:20 Peter Zijlstra
2006-06-19 15:45 ` Christoph Lameter
2006-06-19 18:10 ` Peter Zijlstra [this message]
2006-06-19 19:03 ` Christoph Lameter
2006-06-19 19:10 ` Rik van Riel
2006-06-19 19:24 ` Christoph Lameter
2006-06-19 19:27 ` Rik van Riel
2006-06-19 19:58 ` Christoph Lameter
2006-06-19 20:05 ` Peter Zijlstra
2006-06-19 20:11 ` Christoph Lameter
2006-06-19 20:46 ` Peter Zijlstra
2006-06-19 21:48 ` Christoph Lameter
2006-06-19 20:28 ` Rik van Riel
2006-06-19 21:45 ` Christoph Lameter
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1150740624.28517.108.camel@lappy \
--to=a.p.zijlstra@chello.nl \
--cc=ak@suse.de \
--cc=akpm@osdl.org \
--cc=andrea@suse.de \
--cc=anton@samba.org \
--cc=apw@shadowen.org \
--cc=arjan@infradead.org \
--cc=clameter@sgi.com \
--cc=hugh@veritas.com \
--cc=linux-mm@kvack.org \
--cc=marcelo@kvack.org \
--cc=mbligh@google.com \
--cc=mel@csn.ul.ie \
--cc=nikita@clusterfs.com \
--cc=paulmck@us.ibm.com \
--cc=piggin@cyberone.com.au \
--cc=riel@redhat.com \
--cc=rohitseth@google.com \
--cc=torvalds@osdl.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox