From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id D965DC54798 for ; Tue, 27 Feb 2024 10:53:10 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 5D2446B016E; Tue, 27 Feb 2024 05:53:10 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 5822C6B0171; Tue, 27 Feb 2024 05:53:10 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3FD79940008; Tue, 27 Feb 2024 05:53:10 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 216AB6B016E for ; Tue, 27 Feb 2024 05:53:10 -0500 (EST) Received: from smtpin07.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id BA82CA107E for ; Tue, 27 Feb 2024 10:53:09 +0000 (UTC) X-FDA: 81837271698.07.FB102DC Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by imf25.hostedemail.com (Postfix) with ESMTP id 266D5A000B for ; Tue, 27 Feb 2024 10:53:07 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf25.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1709031188; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZDemDWDhHX7jSpCmwQSi+/ffQ+/jXBi7Q3CM/3QBYJY=; b=qzfgyJhG7EoDDWNKNGJNoeMn2O81S+cUeuF4tgZ4dXF/1Lh6Uuc6p1wlJCxPi3WmGCKG4v S5yQ5ZkhULVxK7n5UnTvO0ZXhSmcQE8n0KtDD4RiIcCowQJyYh4pgZWirir58QXD0QM4F4 938qBZw2pOMC5/LdaVSjid/MVlQ76/s= ARC-Authentication-Results: i=1; imf25.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf25.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1709031188; a=rsa-sha256; cv=none; b=IYwnySWYH4kMaBoshwBNUPHqX7Y+wWKF22c7GnqSzv1yuJ3WrtuDxdHp903e5BFtiOZmMe avr7/uOh3oWCI3jPWv9cxs9amCIMc6kq9Jh/dQOhoNfQj+aW9XWMbZZSV1nSrmpCJ4qRSX xCyltpGNfl8n9bRAfqsDPJecjGKbNFk= Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id AA6DBFEC; Tue, 27 Feb 2024 02:53:45 -0800 (PST) Received: from [10.1.30.188] (XHFQ2J9959.cambridge.arm.com [10.1.30.188]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id B8F5F3F6C4; Tue, 27 Feb 2024 02:53:05 -0800 (PST) Message-ID: Date: Tue, 27 Feb 2024 10:53:03 +0000 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH] mm: export folio_pte_batch as a couple of modules might need it Content-Language: en-GB To: David Hildenbrand , Lance Yang Cc: Barry Song <21cnbao@gmail.com>, akpm@linux-foundation.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, Barry Song , Yin Fengwei References: <20240227024050.244567-1-21cnbao@gmail.com> <61b9dfc9-5522-44fd-89a4-140833ede8af@arm.com> From: Ryan Roberts In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Rspam-User: X-Stat-Signature: o3979isc55q8z69iyayhpa4mkgntazsd X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: 266D5A000B X-HE-Tag: 1709031187-44808 X-HE-Meta: U2FsdGVkX18Bjtiz9+GuC+nXPhwSzmVPzgQHLEKJky4nSlQyk1DzOOVPivZZ0EazFr7YdMcsaGGZDjIa1EmWYbiasAFZTtOJ0/0yJEFckFCkMnbZ6oL8nxA1oZAlroPp+V1YlWRPTZbXsin6R8b0Hvwy/sLhjDphgGabsPktPqaf6EePRINg0bCTZKsc/RgQfcRCoEG32qCcxN1hC81wsSY7MG1EGGQ+ehxmoklrqFlgxXLUjL0arqRAqLHOM+7OyZf+OjZG75WG8lZy26B2YMZccNgjbOtduO+qg7Jxru4vg7MDo1b6mWQhQVg4cIiYhtjTUGxCmWT39rY5CscAJ8E0fbWrGCUmpPmFtuHm06CvYuCZ3PgW6fhn3m2whHn++qkgC8HCxzh8njKIf8oLvPuSyNnou9S/JPh7Wt2EUSC/VI6k3xpg62HPLkmslyYr+6X2ckeKYG+KZYjuXQaSu1djzrfdGncn483XuMp65G1nhR7jBxGXnOlZkqor8gpqEo9mYSQxhh55VAD3TpWYh8r9V4KNS5TjIBMA8y+pANwD2x2Fqr45n7+eeJP7aKzwObYNVOJVTW+Ypn2QVijH/sNYTrfEiOx2Ne8IVuUoSo5LBJIs7/k+C/k4Uu/xDm1m/xNrjXH+iQbTYRSzV4Wco7F09sHFm2HmHKFxvuz7ApkeHTAlPVFrI3OHWk/10tizsOTNKfCc1HurBeuUceyCpvrYekpY9s9ik5CCflMXqdgLNbkkMoDh1LOGivj+i/EXJhxK0boNtOCBAUABurfChY1h4C32B+mraYZWqgDmC1ft1UkOuUUTzyFsYJxOJWCjuTse0RqxAGPbCGqwdGTgfLW1MhnAsTEICAYZjNx+SAANtovN/X/Jv9ZZT/faMyshYBypQy5YapU= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 27/02/2024 10:30, David Hildenbrand wrote: > On 27.02.24 11:21, Lance Yang wrote: >> On Tue, Feb 27, 2024 at 5:14 PM David Hildenbrand wrote: >>> >>> On 27.02.24 10:07, Ryan Roberts wrote: >>>> On 27/02/2024 02:40, Barry Song wrote: >>>>> From: Barry Song >>>>> >>>>> madvise and some others might need folio_pte_batch to check if a range >>>>> of PTEs are completely mapped to a large folio with contiguous physcial >>>>> addresses. Let's export it for others to use. >>>>> >>>>> Cc: Lance Yang >>>>> Cc: Ryan Roberts >>>>> Cc: David Hildenbrand >>>>> Cc: Yin Fengwei >>>>> Signed-off-by: Barry Song >>>>> --- >>>>>    -v1: >>>>>    at least two jobs madv_free and madv_pageout depend on it. To avoid >>>>>    conflicts and dependencies, after discussing with Lance, we prefer >>>>>    this one can land earlier. >>>> >>>> I think this will also ultimately be useful for mprotect too, though I haven't >>>> looked at it properly yet. >>>> >>> >>> Yes, I think we briefly discussed that. >>> >>>>> >>>>>    mm/internal.h | 13 +++++++++++++ >>>>>    mm/memory.c   | 11 +---------- >>>>>    2 files changed, 14 insertions(+), 10 deletions(-) >>>>> >>>>> diff --git a/mm/internal.h b/mm/internal.h >>>>> index 13b59d384845..8e2bc304f671 100644 >>>>> --- a/mm/internal.h >>>>> +++ b/mm/internal.h >>>>> @@ -83,6 +83,19 @@ static inline void *folio_raw_mapping(struct folio *folio) >>>>>       return (void *)(mapping & ~PAGE_MAPPING_FLAGS); >>>>>    } >>>>> >>>>> +/* Flags for folio_pte_batch(). */ >>>>> +typedef int __bitwise fpb_t; >>>>> + >>>>> +/* Compare PTEs after pte_mkclean(), ignoring the dirty bit. */ >>>>> +#define FPB_IGNORE_DIRTY            ((__force fpb_t)BIT(0)) >>>>> + >>>>> +/* Compare PTEs after pte_clear_soft_dirty(), ignoring the soft-dirty bit. */ >>>>> +#define FPB_IGNORE_SOFT_DIRTY               ((__force fpb_t)BIT(1)) >>>>> + >>>>> +extern int folio_pte_batch(struct folio *folio, unsigned long addr, >>>>> +            pte_t *start_ptep, pte_t pte, int max_nr, fpb_t flags, >>>>> +            bool *any_writable); >>>>> + >>>>>    void __acct_reclaim_writeback(pg_data_t *pgdat, struct folio *folio, >>>>>                                               int nr_throttled); >>>>>    static inline void acct_reclaim_writeback(struct folio *folio) >>>>> diff --git a/mm/memory.c b/mm/memory.c >>>>> index 1c45b6a42a1b..319b3be05e75 100644 >>>>> --- a/mm/memory.c >>>>> +++ b/mm/memory.c >>>>> @@ -953,15 +953,6 @@ static __always_inline void __copy_present_ptes(struct >>>>> vm_area_struct *dst_vma, >>>>>       set_ptes(dst_vma->vm_mm, addr, dst_pte, pte, nr); >>>>>    } >>>>> >>>>> -/* Flags for folio_pte_batch(). */ >>>>> -typedef int __bitwise fpb_t; >>>>> - >>>>> -/* Compare PTEs after pte_mkclean(), ignoring the dirty bit. */ >>>>> -#define FPB_IGNORE_DIRTY            ((__force fpb_t)BIT(0)) >>>>> - >>>>> -/* Compare PTEs after pte_clear_soft_dirty(), ignoring the soft-dirty bit. */ >>>>> -#define FPB_IGNORE_SOFT_DIRTY               ((__force fpb_t)BIT(1)) >>>>> - >>>>>    static inline pte_t __pte_batch_clear_ignored(pte_t pte, fpb_t flags) >>>>>    { >>>>>       if (flags & FPB_IGNORE_DIRTY) >>>>> @@ -982,7 +973,7 @@ static inline pte_t __pte_batch_clear_ignored(pte_t >>>>> pte, fpb_t flags) >>>>>     * If "any_writable" is set, it will indicate if any other PTE besides the >>>>>     * first (given) PTE is writable. >>>>>     */ >>>> >>>> David was talking in Lance's patch thread, about improving the docs for this >>>> function now that its exported. Might be worth syncing on that. >>> >>> Here is my take: >>> >>> Signed-off-by: David Hildenbrand >>> --- >>>    mm/memory.c | 22 ++++++++++++++++++---- >>>    1 file changed, 18 insertions(+), 4 deletions(-) >>> >>> diff --git a/mm/memory.c b/mm/memory.c >>> index d0b855a1837a8..098356b8805ae 100644 >>> --- a/mm/memory.c >>> +++ b/mm/memory.c >>> @@ -971,16 +971,28 @@ static inline pte_t __pte_batch_clear_ignored(pte_t >>> pte, fpb_t flags) >>>          return pte_wrprotect(pte_mkold(pte)); >>>    } >>> >>> -/* >>> +/** >>> + * folio_pte_batch - detect a PTE batch for a large folio >>> + * @folio: The large folio to detect a PTE batch for. >>> + * @addr: The user virtual address the first page is mapped at. >>> + * @start_ptep: Page table pointer for the first entry. >>> + * @pte: Page table entry for the first page. >> >> Nit: >> >> - * @pte: Page table entry for the first page. >> + * @pte: Page table entry for the first page that must be the first subpage of >> + *               the folio excluding arm64 for now. >> >> IIUC, pte_batch_hint is always 1 excluding arm64 for now. >> I'm not sure if this modification will be helpful? > > IIRC, Ryan made sure that this also works when passing another subpage, after > when cont-pte is set. Otherwise this would already be broken for fork/zap. > > So I don't think this comment would actually be correct. Indeed, the spec for the function is exactly the same for arm64 as for other arches. It's just that arm64 can accelerate the implementation by skipping forward to the next contpte boundary when the current pte is part of a contpte block. There is no requirement for pte (or addr or start_ptep) to point to the first subpage of a folio - they can point to any subpage. pte, addr and start_ptep must all refer to the same entry, but I think that's clear from the existing text.