linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Mel Gorman <mgorman@techsingularity.net>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: Henry Willard <henry.willard@oracle.com>,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH] mm: Limit boost_watermark on small zones.
Date: Tue, 5 May 2020 08:58:31 +0100	[thread overview]
Message-ID: <20200505075831.GC3758@techsingularity.net> (raw)
In-Reply-To: <20200504133604.5fd0b0b11b93bb4d9a0fed68@linux-foundation.org>

On Mon, May 04, 2020 at 01:36:04PM -0700, Andrew Morton wrote:
> On Mon, 4 May 2020 13:44:09 +0100 Mel Gorman <mgorman@techsingularity.net> wrote:
> 
> > On Fri, May 01, 2020 at 03:57:29PM -0700, Andrew Morton wrote:
> > > On Thu, 30 Apr 2020 17:49:08 -0700 Henry Willard <henry.willard@oracle.com> wrote:
> > > 
> > > > Commit 1c30844d2dfe ("mm: reclaim small amounts of memory when an external
> > > > fragmentation event occurs") adds a boost_watermark() function which
> > > > increases the min watermark in a zone by at least pageblock_nr_pages or
> > > > the number of pages in a page block. On Arm64, with 64K pages and 512M
> > > > huge pages, this is 8192 pages or 512M. It does this regardless of the
> > > > number of managed pages managed in the zone or the likelihood of success.
> > > > This can put the zone immediately under water in terms of allocating pages
> > > > from the zone, and can cause a small machine to fail immediately due to
> > > > OoM. Unlike set_recommended_min_free_kbytes(), which substantially
> > > > increases min_free_kbytes and is tied to THP, boost_watermark() can be
> > > > called even if THP is not active. The problem is most likely to appear
> > > > on architectures such as Arm64 where pageblock_nr_pages is very large.
> > > > 
> > > > It is desirable to run the kdump capture kernel in as small a space as
> > > > possible to avoid wasting memory. In some architectures, such as Arm64,
> > > > there are restrictions on where the capture kernel can run, and therefore,
> > > > the space available. A capture kernel running in 768M can fail due to OoM
> > > > immediately after boost_watermark() sets the min in zone DMA32, where
> > > > most of the memory is, to 512M. It fails even though there is over 500M of
> > > > free memory. With boost_watermark() suppressed, the capture kernel can run
> > > > successfully in 448M.
> > > > 
> > > > This patch limits boost_watermark() to boosting a zone's min watermark only
> > > > when there are enough pages that the boost will produce positive results.
> > > > In this case that is estimated to be four times as many pages as
> > > > pageblock_nr_pages.
> > > > 
> > > 
> > ...
> > Acked-by: Mel Gorman <mgorman@techsingularity.net>
> 
> Cool.  I wonder if we should backport this into -stable kernels?  "can
> cause a small machine to fail immediately" sounds serious, but
> 1c30844d2dfe is from December 2018.  Any thoughts?

There is no harm in marking it stable. Clearly it does not happen very
often but it's not impossible. 32-bit x86 is a lot less common now which
would previously have been vulnerable to triggering this easily. ppc64
has a larger base page size but typically only has one zone. arm64 is
likely the most vulnerable, particularly when CMA is configured with a
small movable zone.

-- 
Mel Gorman
SUSE Labs


  parent reply	other threads:[~2020-05-05  7:58 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-05-01  0:49 Henry Willard
2020-05-01 22:57 ` Andrew Morton
2020-05-04 12:44   ` Mel Gorman
2020-05-04 20:36     ` Andrew Morton
2020-05-05  0:27       ` Henry Willard
2020-05-05  7:58       ` Mel Gorman [this message]
2020-05-05  8:30 ` David Hildenbrand

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20200505075831.GC3758@techsingularity.net \
    --to=mgorman@techsingularity.net \
    --cc=akpm@linux-foundation.org \
    --cc=henry.willard@oracle.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox