From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-11.3 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI,NICE_REPLY_A, SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 157E1C00A89 for ; Mon, 2 Nov 2020 13:03:31 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 9CDD4223EA for ; Mon, 2 Nov 2020 13:03:30 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9CDD4223EA Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=suse.cz Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 0DC3F6B0070; Mon, 2 Nov 2020 08:03:30 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 08E5C6B0072; Mon, 2 Nov 2020 08:03:30 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id EC0B76B0073; Mon, 2 Nov 2020 08:03:29 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0223.hostedemail.com [216.40.44.223]) by kanga.kvack.org (Postfix) with ESMTP id BDF4D6B0070 for ; Mon, 2 Nov 2020 08:03:29 -0500 (EST) Received: from smtpin29.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 4BAEE1EE6 for ; Mon, 2 Nov 2020 13:03:29 +0000 (UTC) X-FDA: 77439494538.29.rifle35_4d12b7a272b0 Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin29.hostedemail.com (Postfix) with ESMTP id 88FA618086CDD for ; Mon, 2 Nov 2020 13:03:27 +0000 (UTC) X-HE-Tag: rifle35_4d12b7a272b0 X-Filterd-Recvd-Size: 4715 Received: from mx2.suse.de (mx2.suse.de [195.135.220.15]) by imf11.hostedemail.com (Postfix) with ESMTP for ; Mon, 2 Nov 2020 13:03:26 +0000 (UTC) X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.221.27]) by mx2.suse.de (Postfix) with ESMTP id ED37FB02D; Mon, 2 Nov 2020 13:03:25 +0000 (UTC) Subject: Re: [PATCH] mm/compaction: count pages and stop correctly during page isolation. To: Yang Shi , Zi Yan Cc: Michal Hocko , Andrew Morton , Linux MM , Rik van Riel , Linux Kernel Mailing List , Minchan Kim References: <20201029200435.3386066-1-zi.yan@sent.com> <20201030094308.GG1478@dhcp22.suse.cz> <6CAAB1FC-2B41-490B-A67A-93063629C19B@nvidia.com> <20201030133625.GJ1478@dhcp22.suse.cz> From: Vlastimil Babka Message-ID: Date: Mon, 2 Nov 2020 14:03:25 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 10/30/20 7:55 PM, Yang Shi wrote: > On Fri, Oct 30, 2020 at 11:39 AM Zi Yan wrote: >> >> On 30 Oct 2020, at 14:33, Yang Shi wrote: >> >> > On Fri, Oct 30, 2020 at 6:36 AM Michal Hocko wrote= : >> >> >> >> On Fri 30-10-20 08:20:50, Zi Yan wrote: >> >>> On 30 Oct 2020, at 5:43, Michal Hocko wrote: >> >>> >> >>>> [Cc Vlastimil] >> >>>> >> >>>> On Thu 29-10-20 16:04:35, Zi Yan wrote: >> >>>>> From: Zi Yan >> >>>>> >> >>>>> In isolate_migratepages_block, when cc->alloc_contig is true, we= are >> >>>>> able to isolate compound pages, nr_migratepages and nr_isolated = did not >> >>>>> count compound pages correctly, causing us to isolate more pages= than we >> >>>>> thought. Use thp_nr_pages to count pages. Otherwise, we might be= trapped >> >>>>> in too_many_isolated while loop, since the actual isolated pages= can go >> >>>>> up to COMPACT_CLUSTER_MAX*512=3D16384, where COMPACT_CLUSTER_MAX= is 32, >> >>>>> since we stop isolation after cc->nr_migratepages reaches to >> >>>>> COMPACT_CLUSTER_MAX. >> >>>>> >> >>>>> In addition, after we fix the issue above, cc->nr_migratepages c= ould >> >>>>> never be equal to COMPACT_CLUSTER_MAX if compound pages are isol= ated, >> >>>>> thus page isolation could not stop as we intended. Change the is= olation >> >>>>> stop condition to >=3D. >> >>>>> >> >>>>> Signed-off-by: Zi Yan >> >>>>> --- >> >>>>> mm/compaction.c | 8 ++++---- >> >>>>> 1 file changed, 4 insertions(+), 4 deletions(-) >> >>>>> >> >>>>> diff --git a/mm/compaction.c b/mm/compaction.c >> >>>>> index ee1f8439369e..0683a4999581 100644 >> >>>>> --- a/mm/compaction.c >> >>>>> +++ b/mm/compaction.c >> >>>>> @@ -1012,8 +1012,8 @@ isolate_migratepages_block(struct compact_= control *cc, unsigned long low_pfn, >> >>>>> >> >>>>> isolate_success: >> >>>>> list_add(&page->lru, &cc->migratepages); >> >>>>> - cc->nr_migratepages++; >> >>>>> - nr_isolated++; >> >>>>> + cc->nr_migratepages +=3D thp_nr_pages(page); >> >>>>> + nr_isolated +=3D thp_nr_pages(page); >> >>>> >> >>>> Does thp_nr_pages work for __PageMovable pages? >> >>> >> >>> Yes. It is the same as compound_nr() but compiled >> >>> to 1 when THP is not enabled. >> >> >> >> I am sorry but I do not follow. First of all the implementation of = the >> >> two is different and also I was asking about __PageMovable which sh= ould >> >> never be THP IIRC. Can they be compound though? >> > >> > I have the same question, can they be compound? If they can be >> > compound, PageTransHuge() can't tell from THP and compound movable >> > page, right? >> >> Right. I have updated the patch and use compound_nr instead. >=20 > Thanks. Actually I'm wondering what kind of movable page could be > compound. Any real examples? Looks like there's currently none. Compaction also wouldn't work properly= with=20 movable pages with order>0 as the free page scanner looks for order-0 pag= es=20 only. But it won't hurt to use compound_nr() anyway. >> >> =E2=80=94 >> Best Regards, >> Yan Zi >=20