From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 55054C48BC4 for ; Wed, 14 Feb 2024 16:25:15 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C82456B008A; Wed, 14 Feb 2024 11:25:14 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id C0B6F6B008C; Wed, 14 Feb 2024 11:25:14 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id AD2FC6B0092; Wed, 14 Feb 2024 11:25:14 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 99F256B008A for ; Wed, 14 Feb 2024 11:25:14 -0500 (EST) Received: from smtpin04.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 27A28C0DF0 for ; Wed, 14 Feb 2024 16:25:14 +0000 (UTC) X-FDA: 81790934148.04.D8ED735 Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by imf24.hostedemail.com (Postfix) with ESMTP id 553B8180032 for ; Wed, 14 Feb 2024 16:25:12 +0000 (UTC) Authentication-Results: imf24.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf24.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1707927912; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=zLy5OtC4ZuOCti2GpzzLhBHWjh9DdSuNLKVsR5xE9qg=; b=Kgdn+WTJ8qYsUOfz4Y+65zdfskIZr4OGr9bHHUn/ahpdFM33nvRHmF8ZIQVlCD1EDx6eOI ww4I88dqj3OUyS+a/LrfBKiC2IcM0FTkm6v/zA9UwWgySERaetCjIS3vJ7FJkujbGNZVlH DCbIoy48uWYpzytllHte0BqiZzmsDbM= ARC-Authentication-Results: i=1; imf24.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf24.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1707927912; a=rsa-sha256; cv=none; b=b4Ra7W7S/qpFViwMTa2H8m5i9qvi3rnv0H6TClbI8W2EtfapYCIqWV2lsgxf7yWeBDZ8ss K6Co43D19diIs9/217pyn72RRJNRdOA22eANVIZXrykA0Q2337kWH6O0mMHsT8ynPW94um z94xK5dfaTTzAF/IrV0QseOQQkJ02EQ= Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 4018E1FB; Wed, 14 Feb 2024 08:25:52 -0800 (PST) Received: from [10.57.64.120] (unknown [10.57.64.120]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id AFAD03F762; Wed, 14 Feb 2024 08:25:08 -0800 (PST) Message-ID: <48e15a5a-b8e8-4ed7-91df-049f5525f648@arm.com> Date: Wed, 14 Feb 2024 16:25:07 +0000 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v4 6/7] mm: truncate: split huge page cache page to a non-zero order if possible. Content-Language: en-GB To: Zi Yan Cc: "Pankaj Raghav (Samsung)" , linux-mm@kvack.org, "Matthew Wilcox (Oracle)" , David Hildenbrand , Yang Shi , Yu Zhao , "Kirill A . Shutemov" , =?UTF-8?Q?Michal_Koutn=C3=BD?= , Roman Gushchin , Zach O'Keefe , Hugh Dickins , Mcgrof Chamberlain , Andrew Morton , linux-kernel@vger.kernel.org, cgroups@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-kselftest@vger.kernel.org References: <20240213215520.1048625-1-zi.yan@sent.com> <20240213215520.1048625-7-zi.yan@sent.com> <1C274CBB-C809-442E-9575-858460C0F62D@nvidia.com> From: Ryan Roberts In-Reply-To: <1C274CBB-C809-442E-9575-858460C0F62D@nvidia.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 553B8180032 X-Rspam-User: X-Rspamd-Server: rspam02 X-Stat-Signature: if3ai4pao88er799jdtwj8p7dtuuhp4e X-HE-Tag: 1707927912-843500 X-HE-Meta: U2FsdGVkX19blKp0MfYhTJCvko4IY9jnaj4ZoWb4uFRdOjqvuZL5gnY4FHZ6QR5jU//mdAvVlVSkY+QWEx3NlcCKUxFX1PznvTo4wZAznsiV7MgARqYhFcs2bBczCdL2Ai+o6P90797mpcXLgNFZ4rgJfCDRtIC2SjxQhUEv5igWsX56o11j22C3dGVwY+EO1t8OuVFb56mHw3fgqd+Ow87+gKS4zCUGymYlZTG4TVH4yZntCNeUAy3WnX1Ls890oisX9sNi9iHpeHiHeEfOAWTm8gRFaBLUQ6KbXtinT5PXoJ7rH2KUBaWUNOtLcbjE8CNiPAKrdKUnjwUMB/0J6tWwfdI8hk/Ih/crFfejF7RXuaAncRLXNicRm6mdJcPfKJOpKCptMXkqWT80xagScdnqhyVcgvcMzNA+yFAg4vtAlZapqXhID5MtQzZCPDAdadpG/bJdAYsWMSBSSI+lou0RZ1vOkRwIs2i90hzxqIh9/0aAuGpHdAmVu7y2ABHrQbmVF6zewdCIQkH0zBXY8e3vUJfVDHa4NMWCkAVsYaIwspX+ADBIVsl3HDkIwvK8w2hQMq2VS1atpmY5gGU5sbNsRjyUNM/WNf5lqM5X6SKDrZ63bbmE/cN7Z/FmTZk/JPCXKlJMBSjoJlfszf7OMRPi8mSZi1NmjPcljUGXNfRfnIqiWFblWIpuTok41HxeMOm7q0SI5uDUkxbGS+DnoIMiDBCbpqCZH9fwV19IsyxXgALVaniI5YSC5zfGm3o9o04n4gylXBbwajawDP6NE2/qqCY9mAa3z5ljReUvTyBvypT1f7xJXIqYlcGyxax5PFYCP7UmjjFWy96U4qqYPWXVBkePfFcaErh3s/H+La+wfOlhE+xKVzWZUcoBdfYgBRr52ZLxY+Luvx97JZcUWDgqi5nsjFeIpJ4pvTYiBN5VLq135OffoF+Gyu2VwNYuQuJa6Jrx1+Yica9JoUY +2HM8SqD rUJFGcVQGzA0C6TP3ROSNWdZlkAIWV6b+MymAFzpegBlcrNrbox0CviqNlvekhxU1c/FSUSzac55GwKLKYOZrvsXo/QtmHTK6PnJ6n4FO74w1YtcgxBarnC1CPQxn//+GvnVyu905NRtBuauun3jvTxujQQJMQbJC8cE8y3QPPxS4LB2fi9Nb8IkMUSXPBqtcvcrAR/NSNfxmBY5AFGXMeWWvfzegprN4sOXYxxleNbI1IJCC2w/6X1TgtzHeXbwIaGKJ X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 14/02/2024 16:19, Zi Yan wrote: > On 14 Feb 2024, at 5:43, Ryan Roberts wrote: > >> On 13/02/2024 21:55, Zi Yan wrote: >>> From: Zi Yan >>> >>> To minimize the number of pages after a huge page truncation, we do not >>> need to split it all the way down to order-0. The huge page has at most >>> three parts, the part before offset, the part to be truncated, the part >>> remaining at the end. Find the greatest common divisor of them to >>> calculate the new page order from it, so we can split the huge >>> page to this order and keep the remaining pages as large and as few as >>> possible. >>> >>> Signed-off-by: Zi Yan >>> --- >>> mm/truncate.c | 21 +++++++++++++++++++-- >>> 1 file changed, 19 insertions(+), 2 deletions(-) >>> >>> diff --git a/mm/truncate.c b/mm/truncate.c >>> index 725b150e47ac..49ddbbf7a617 100644 >>> --- a/mm/truncate.c >>> +++ b/mm/truncate.c >>> @@ -21,6 +21,7 @@ >>> #include >>> #include >>> #include >>> +#include >>> #include "internal.h" >>> >>> /* >>> @@ -210,7 +211,8 @@ int truncate_inode_folio(struct address_space *mapping, struct folio *folio) >>> bool truncate_inode_partial_folio(struct folio *folio, loff_t start, loff_t end) >>> { >>> loff_t pos = folio_pos(folio); >>> - unsigned int offset, length; >>> + unsigned int offset, length, remaining; >>> + unsigned int new_order = folio_order(folio); >>> >>> if (pos < start) >>> offset = start - pos; >>> @@ -221,6 +223,7 @@ bool truncate_inode_partial_folio(struct folio *folio, loff_t start, loff_t end) >>> length = length - offset; >>> else >>> length = end + 1 - pos - offset; >>> + remaining = folio_size(folio) - offset - length; >>> >>> folio_wait_writeback(folio); >>> if (length == folio_size(folio)) { >>> @@ -235,11 +238,25 @@ bool truncate_inode_partial_folio(struct folio *folio, loff_t start, loff_t end) >>> */ >>> folio_zero_range(folio, offset, length); >>> >>> + /* >>> + * Use the greatest common divisor of offset, length, and remaining >>> + * as the smallest page size and compute the new order from it. So we >>> + * can truncate a subpage as large as possible. Round up gcd to >>> + * PAGE_SIZE, otherwise ilog2 can give -1 when gcd/PAGE_SIZE is 0. >>> + */ >>> + new_order = ilog2(round_up(gcd(gcd(offset, length), remaining), >>> + PAGE_SIZE) / PAGE_SIZE); >> >> Given you have up to 2 regions remaining, isn't it possible that you want a >> different order for both those regions (or even multiple orders within the same >> region)? I guess you just choose gcd for simplicity? > > Right. You raise the same concern as Hugh[1]. I am minimizing the call of > split_huge_page_to_list_to_order() and you and Hugh want to minimize the > number of folios after the split. Yours will give better outcome after split, > but requires either multiple calls or a more sophisticated implementation > of page split[2]. We probably can revisit this once splitting to any order > gets wider use. Yeah, fair enough. Sorry hadn't read Hugh's original feedback. > >>> + >>> + /* order-1 THP not supported, downgrade to order-0 */ >>> + if (new_order == 1) >>> + new_order = 0; >> >> I guess this would need to change if supporting order-1 file folios? > > Right. > >>> + >>> + >>> if (folio_has_private(folio)) >>> folio_invalidate(folio, offset, length); >>> if (!folio_test_large(folio)) >>> return true; >>> - if (split_folio(folio) == 0) >>> + if (split_huge_page_to_list_to_order(&folio->page, NULL, new_order) == 0) >> >> I know you are discussing removing this patch, but since you created >> split_folio_to_order() wouldn't that be better here? > > Sure. Will change the patch locally. > > [1] https://lore.kernel.org/linux-mm/9dd96da-efa2-5123-20d4-4992136ef3ad@google.com/ > [2] https://lore.kernel.org/linux-mm/0AC0520E-1BD2-497E-A7ED-05394400BFC9@nvidia.com/ > > -- > Best Regards, > Yan, Zi