From: Nick Piggin <nickpiggin@yahoo.com.au>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Rik van Riel <riel@redhat.com>,
Linus Torvalds <torvalds@linux-foundation.org>,
KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
LKML <linux-kernel@vger.kernel.org>,
linux-mm <linux-mm@kvack.org>,
Gene Heskett <gene.heskett@gmail.com>
Subject: Re: [PATCH] mm: evict streaming IO cache first
Date: Mon, 17 Nov 2008 17:19:31 +1100 [thread overview]
Message-ID: <200811171719.31936.nickpiggin@yahoo.com.au> (raw)
In-Reply-To: <20081116204720.1b8cbe18.akpm@linux-foundation.org>
On Monday 17 November 2008 15:47, Andrew Morton wrote:
> On Sun, 16 Nov 2008 16:20:26 -0500 Rik van Riel <riel@redhat.com> wrote:
> > I will take a look at producing smoother self tuning behaviour
> > in get_scan_ratio(), with logic along these lines:
> > - the more file pages are inactive, the more eviction should
> > focus on file pages, because we are not eating away at the
> > working set yet
> > - the more file pages are active, the more there needs to be
> > a balance between file and anon scanning, because we are
> > starting to get to the working sets for both
>
> hm. I wonder if it would be prohibitive to say "hey, we did the wrong
> thing in that scanning pass - rewind and try it again". Probably it
> would be.
>
> Anyway, we need to do something.
>
> Shouldn't get_scan_ratio() be handling this case already?
I have a patch that was actually for the old vmscan logic that I
found really helps prevent working set get paged out. Actually
the old vmscan behaviour wasn't any good either at preventing
unmapped pagecache from being evicted, which is the main thing I
was trying to fix (eg. keep git tree in cache while doing other
use-once IO).
It ended up working really well, but I suspect it would still fall
over in the case where you were trying to populate your caches with
the git tree *while* the streaming IO is happening (if those pages
don't have a chance to get touched again for a while, they'll look
like use-once IO to the vm)... but still no worse than current
behaviour.
I need to forward port it to the new system, however...
But this would be a pretty big change and I can't see how it could
be appropriate for -rc6. Aren't we allergic to even single-line
changes in vmscan without seemingly multi-year "testing" phases? :)
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2008-11-17 6:19 UTC|newest]
Thread overview: 27+ messages / expand[flat|nested] mbox.gz Atom feed top
2008-11-15 9:38 KOSAKI Motohiro
2008-11-16 0:58 ` Rik van Riel
2008-11-16 5:00 ` Andrew Morton
2008-11-16 18:15 ` Linus Torvalds
2008-11-16 21:20 ` Rik van Riel
2008-11-16 21:28 ` Hugh Dickins
2008-11-17 4:47 ` Andrew Morton
2008-11-17 6:19 ` Nick Piggin [this message]
2008-11-17 6:30 ` KAMEZAWA Hiroyuki
2008-11-17 6:39 ` KOSAKI Motohiro
2008-11-17 6:54 ` KAMEZAWA Hiroyuki
2008-11-17 7:03 ` KOSAKI Motohiro
2008-11-17 8:22 ` KAMEZAWA Hiroyuki
2008-11-17 8:32 ` KOSAKI Motohiro
2008-11-17 16:22 ` Rik van Riel
2008-11-17 16:22 ` Linus Torvalds
2008-11-17 16:27 ` Rik van Riel
2008-11-17 16:37 ` Linus Torvalds
2008-11-17 16:54 ` Rik van Riel
2008-11-17 17:06 ` Linus Torvalds
2008-11-17 17:16 ` [PATCH] vmscan: fix get_scan_ratio comment Rik van Riel
2008-11-17 17:32 ` KOSAKI Motohiro
2008-11-17 17:35 ` Linus Torvalds
2008-11-17 18:53 ` Rik van Riel
2008-11-17 20:23 ` Rik van Riel
2008-11-18 0:06 ` [PATCH] vmscan: evict streaming IO first Rik van Riel
2008-12-01 20:24 ` Andrew Morton
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=200811171719.31936.nickpiggin@yahoo.com.au \
--to=nickpiggin@yahoo.com.au \
--cc=akpm@linux-foundation.org \
--cc=gene.heskett@gmail.com \
--cc=kosaki.motohiro@jp.fujitsu.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=riel@redhat.com \
--cc=torvalds@linux-foundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox