linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Wanpeng Li <liwanp@linux.vnet.ibm.com>
To: Dave Hansen <dave@sr71.net>
Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	akpm@linux-foundation.org, mgorman@suse.de,
	tim.c.chen@linux.intel.com, minchan@kernel.org
Subject: Re: [v5][PATCH 6/6] mm: vmscan: drain batch list during long operations
Date: Mon, 15 Jul 2013 07:51:08 +0800	[thread overview]
Message-ID: <20130714235108.GF23628@hacker.(null)> (raw)
In-Reply-To: <20130603200210.259954C3@viggo.jf.intel.com>

On Mon, Jun 03, 2013 at 01:02:10PM -0700, Dave Hansen wrote:
>
>From: Dave Hansen <dave.hansen@linux.intel.com>
>
>This was a suggestion from Mel:
>
>	http://lkml.kernel.org/r/20120914085634.GM11157@csn.ul.ie
>
>Any pages we collect on 'batch_for_mapping_removal' will have
>their lock_page() held during the duration of their stay on the
>list.  If some other user is trying to get at them during this
>time, they might end up having to wait.
>
>This ensures that we drain the batch if we are about to perform a
>pageout() or congestion_wait(), either of which will take some
>time.  We expect this to help mitigate the worst of the latency
>increase that the batching could cause.
>
>I added some statistics to the __remove_mapping_batch() code to
>track how large the lists are that we pass in to it.  With this
>patch, the average list length drops about 10% (from about 4.1 to
>3.8).  The workload here was a make -j4 kernel compile on a VM
>with 200MB of RAM.
>
>I've still got the statistics patch around if anyone is
>interested.
>
>Signed-off-by: Dave Hansen <dave.hansen@linux.intel.com>
>---
>

Reviewed-by: Wanpeng Li <liwanp@linux.vnet.ibm.com>

> linux.git-davehans/mm/vmscan.c |   10 ++++++++++
> 1 file changed, 10 insertions(+)
>
>diff -puN mm/vmscan.c~drain-batch-list-during-long-operations mm/vmscan.c
>--- linux.git/mm/vmscan.c~drain-batch-list-during-long-operations	2013-06-03 12:41:31.661762522 -0700
>+++ linux.git-davehans/mm/vmscan.c	2013-06-03 12:41:31.665762700 -0700
>@@ -1001,6 +1001,16 @@ static unsigned long shrink_page_list(st
> 			if (!sc->may_writepage)
> 				goto keep_locked;
>
>+			/*
>+			 * We hold a bunch of page locks on the batch.
>+			 * pageout() can take a while, so drain the
>+			 * batch before we perform pageout.
>+			 */
>+			nr_reclaimed +=
>+		               __remove_mapping_batch(&batch_for_mapping_rm,
>+		                                      &ret_pages,
>+		                                      &free_pages);
>+
> 			/* Page is dirty, try to write it out here */
> 			switch (pageout(page, mapping, sc)) {
> 			case PAGE_KEEP:
>_
>
>--
>To unsubscribe, send a message with 'unsubscribe linux-mm' in
>the body to majordomo@kvack.org.  For more info on Linux MM,
>see: http://www.linux-mm.org/ .
>Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

      parent reply	other threads:[~2013-07-14 23:51 UTC|newest]

Thread overview: 37+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-06-03 20:02 [v5][PATCH 0/6] mm: vmscan: Batch page reclamation under shink_page_list Dave Hansen
2013-06-03 20:02 ` [v5][PATCH 1/6] mm: swap: defer clearing of page_private() for swap cache pages Dave Hansen
2013-07-14 23:47   ` Wanpeng Li
2013-07-14 23:47   ` Wanpeng Li
2013-06-03 20:02 ` [v5][PATCH 2/6] mm: swap: make 'struct page' and swp_entry_t variants of swapcache_free() Dave Hansen
2013-07-14 23:48   ` Wanpeng Li
2013-07-14 23:48   ` Wanpeng Li
2013-06-03 20:02 ` [v5][PATCH 3/6] mm: vmscan: break up __remove_mapping() Dave Hansen
2013-07-14 23:49   ` Wanpeng Li
2013-07-14 23:49   ` Wanpeng Li
2013-06-03 20:02 ` [v5][PATCH 4/6] mm: vmscan: break out mapping "freepage" code Dave Hansen
2013-07-14 23:49   ` Wanpeng Li
2013-07-14 23:49   ` Wanpeng Li
2013-06-03 20:02 ` [v5][PATCH 5/6] mm: vmscan: batch shrink_page_list() locking operations Dave Hansen
2013-06-04  1:17   ` Hillf Danton
2013-06-04  5:07     ` Minchan Kim
2013-06-04 15:22       ` Dave Hansen
2013-06-05  7:28       ` Hillf Danton
2013-06-05  7:57         ` Minchan Kim
2013-06-05 14:24         ` Dave Hansen
2013-06-04  5:01   ` Minchan Kim
2013-06-04  6:02     ` Minchan Kim
2013-06-04 15:29       ` Dave Hansen
2013-06-04 23:32         ` Minchan Kim
2013-06-04  6:10     ` Dave Hansen
2013-06-04  6:59       ` Minchan Kim
2013-07-14 23:50       ` Wanpeng Li
2013-07-14 23:50       ` Wanpeng Li
2013-06-03 20:02 ` [v5][PATCH 6/6] mm: vmscan: drain batch list during long operations Dave Hansen
2013-06-04  6:05   ` Minchan Kim
2013-06-04 15:24     ` Dave Hansen
2013-06-04 23:23       ` Minchan Kim
2013-06-04 23:31         ` Dave Hansen
2013-06-04 23:36           ` Minchan Kim
2013-06-04 23:37   ` Minchan Kim
2013-07-14 23:51   ` Wanpeng Li
2013-07-14 23:51   ` Wanpeng Li [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='20130714235108.GF23628@hacker.(null)' \
    --to=liwanp@linux.vnet.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=dave@sr71.net \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mgorman@suse.de \
    --cc=minchan@kernel.org \
    --cc=tim.c.chen@linux.intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox