From: Jaewon Kim <jaewon31.kim@samsung.com>
To: Mel Gorman <mgorman@techsingularity.net>,
Jaewon Kim <jaewon31.kim@samsung.com>
Cc: "minchan@kernel.org" <minchan@kernel.org>,
"akpm@linux-foundation.org" <akpm@linux-foundation.org>,
"bhe@redhat.com" <bhe@redhat.com>,
"vbabka@suse.cz" <vbabka@suse.cz>,
"hannes@cmpxchg.org" <hannes@cmpxchg.org>,
"mhocko@kernel.org" <mhocko@kernel.org>,
"linux-mm@kvack.org" <linux-mm@kvack.org>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
GyeongHwan Hong <gh21.hong@samsung.com>,
YongTaek Lee <ytk.lee@samsung.com>,
"jaewon31.kim@gmail.com" <jaewon31.kim@gmail.com>
Subject: RE: [PATCH] page_alloc: fix invalid watemark check on a negative value
Date: Mon, 25 Jul 2022 18:47:59 +0900 [thread overview]
Message-ID: <20220725094759epcms1p6b3940f68126bd9b3d9a4e4c1ad4b0aa2@epcms1p6> (raw)
In-Reply-To: <20220725084204.52kdi6jyjhytzudm@techsingularity.net>
>On Mon, Jul 25, 2022 at 10:28:43AM +0900, Jaewon Kim wrote:
>> There was a report that a task is waiting at the
>> throttle_direct_reclaim. The pgscan_direct_throttle in vmstat was
>> increasing.
>>
>> This is a bug where zone_watermark_fast returns true even when the free
>> is very low. The commit f27ce0e14088 ("page_alloc: consider highatomic
>> reserve in watermark fast") changed the watermark fast to consider
>> highatomic reserve. But it did not handle a negative value case which
>> can be happened when reserved_highatomic pageblock is bigger than the
>> actual free.
>>
>> If watermark is considered as ok for the negative value, allocating
>> contexts for order-0 will consume all free pages without direct reclaim,
>> and finally free page may become depleted except highatomic free.
>>
>> Then allocating contexts may fall into throttle_direct_reclaim. This
>> symptom may easily happen in a system where wmark min is low and other
>> reclaimers like kswapd does not make free pages quickly.
>>
>> To handle the negative value, get the value as long type like
>> __zone_watermark_ok does.
>>
>> Reported-by: GyeongHwan Hong <gh21.hong@samsung.com>
>> Signed-off-by: Jaewon Kim <jaewon31.kim@samsung.com>
>
>Add
>
>Fixes: f27ce0e14088 ("page_alloc: consider highatomic reserve in watermark fast")
I will add the Fixes.
>
>The fix is fine as-is but it's not immediately obvious why this
>can wrap negative as it depends on an implementation detail of
>__zone_watermark_unusable_free. The variable copy just to change the sign
>could get accidentally "fixed" later as a micro-optimisation (same if the
>type of mark was changed) so maybe leave a comment like
>
> /* unusable may over-estimate high-atomic reserves */
>
>Otherwise
>
>Acked-by: Mel Gorman <mgorman@techsingularity.net>
Thank you for your Ack
Yes leaving comment will be helpful. Actually let me take your patch.
I think this but is obvious and fix is sipmle, I can resubmit right away.
>
>The problem could also be made explicit with something like below. I know
>you are copying the logic of __zone_watermark_ok but I don't think min
>can go negative there.
The min in __zone_watermark_ok is positive because mark is always unsigned.
But I think free_pages in __zone_watermark_ok can go negative because of the
same reason.
>
>diff --git a/mm/page_alloc.c b/mm/page_alloc.c
>index 934d1b5a5449..f8f50a2aa43e 100644
>--- a/mm/page_alloc.c
>+++ b/mm/page_alloc.c
>@@ -4048,11 +4048,15 @@ static inline bool zone_watermark_fast(struct zone *z, unsigned int order,
> * need to be calculated.
> */
> if (!order) {
>- long fast_free;
>+ long usable_free;
>+ long reserved;
>
>- fast_free = free_pages;
>- fast_free -= __zone_watermark_unusable_free(z, 0, alloc_flags);
>- if (fast_free > mark + z->lowmem_reserve[highest_zoneidx])
>+ usable_free = free_pages;
>+ reserved = __zone_watermark_unusable_free(z, 0, alloc_flags);
>+
>+ /* reserved may over estimate high-atomic reserves. */
>+ usable_free -= min(usable_free, reserved);
>+ if (usable_free > mark + z->lowmem_reserve[highest_zoneidx])
> return true;
> }
>
>--
>Mel Gorman
>SUSE Labs
prev parent reply other threads:[~2022-07-25 9:48 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <CGME20220725012840epcas1p4ae36f072b813f97fc27d33b46da5bc67@epcas1p4.samsung.com>
2022-07-25 1:28 ` Jaewon Kim
2022-07-25 8:42 ` Mel Gorman
[not found] ` <CGME20220725012840epcas1p4ae36f072b813f97fc27d33b46da5bc67@epcms1p6>
2022-07-25 9:47 ` Jaewon Kim [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20220725094759epcms1p6b3940f68126bd9b3d9a4e4c1ad4b0aa2@epcms1p6 \
--to=jaewon31.kim@samsung.com \
--cc=akpm@linux-foundation.org \
--cc=bhe@redhat.com \
--cc=gh21.hong@samsung.com \
--cc=hannes@cmpxchg.org \
--cc=jaewon31.kim@gmail.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mgorman@techsingularity.net \
--cc=mhocko@kernel.org \
--cc=minchan@kernel.org \
--cc=vbabka@suse.cz \
--cc=ytk.lee@samsung.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox