From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id D4362CD4F2B for ; Fri, 22 Sep 2023 07:40:43 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 70C776B028F; Fri, 22 Sep 2023 03:40:43 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 6BBC26B0291; Fri, 22 Sep 2023 03:40:43 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5AA8C6B0293; Fri, 22 Sep 2023 03:40:43 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 4A3BE6B028F for ; Fri, 22 Sep 2023 03:40:43 -0400 (EDT) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 153D6809AF for ; Fri, 22 Sep 2023 07:40:43 +0000 (UTC) X-FDA: 81263436366.30.E2AA28B Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by imf03.hostedemail.com (Postfix) with ESMTP id DBE2A20003 for ; Fri, 22 Sep 2023 07:40:40 +0000 (UTC) Authentication-Results: imf03.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf03.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1695368441; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=RJ+VF0vxH1lScU1ykJ3Oso3c02J8nkbGBURu2OqCkug=; b=Jb91k5NKxJPY5rwjhBxcwlzFMlhDJrfP2VlSYu6m5S27IjqkaAi+8e3T6f03S7qdXe5o7f PmPKs0n17rdXN2cb41bTnVxiPQPE09B4GIBp2YAitPKTmpztgMr7Fh5eYWBmPQQV9jVdX3 Tq3EMrcb17J8wAGdZKJCNFxqg6VmpPo= ARC-Authentication-Results: i=1; imf03.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf03.hostedemail.com: domain of ryan.roberts@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=ryan.roberts@arm.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1695368441; a=rsa-sha256; cv=none; b=dzKrg/skXQsLZJglabZGaBnx4OpT2Cq2Ymx91ntdhfk3Uim8nQFMpyLqOXU3GtSD75I2xK 0D/RI18R5Bbx5YpIWEBzRTPXS5pYWROIut1Cn1hrnSd/f8pCMDq7Q4NDNpCAYKWx/baLFa +2QLmdvXbyyVe08IttFXgXES3Yd6JvQ= Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 3803DDA7; Fri, 22 Sep 2023 00:41:16 -0700 (PDT) Received: from [10.57.65.11] (unknown [10.57.65.11]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 65CC23F5A1; Fri, 22 Sep 2023 00:40:29 -0700 (PDT) Message-ID: <3358e732-8df9-4408-8249-384b102f5d75@arm.com> Date: Fri, 22 Sep 2023 08:40:26 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v1 8/8] arm64: hugetlb: Fix set_huge_pte_at() to work with all swap entries Content-Language: en-GB To: Qi Zheng Cc: Catalin Marinas , Will Deacon , "James E.J. Bottomley" , Helge Deller , Nicholas Piggin , Christophe Leroy , Paul Walmsley , Palmer Dabbelt , Albert Ou , Heiko Carstens , Vasily Gorbik , Alexander Gordeev , Christian Borntraeger , Sven Schnelle , Gerald Schaefer , "David S. Miller" , Arnd Bergmann , Mike Kravetz , Muchun Song , SeongJae Park , Andrew Morton , Uladzislau Rezki , Christoph Hellwig , Lorenzo Stoakes , Anshuman Khandual , Peter Xu , Axel Rasmussen , linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-riscv@lists.infradead.org, linux-s390@vger.kernel.org, sparclinux@vger.kernel.org, linux-mm@kvack.org, stable@vger.kernel.org References: <20230921162007.1630149-1-ryan.roberts@arm.com> <20230921162007.1630149-9-ryan.roberts@arm.com> <217bb956-b9f6-1057-914b-436d4c775a8b@bytedance.com> From: Ryan Roberts In-Reply-To: <217bb956-b9f6-1057-914b-436d4c775a8b@bytedance.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: DBE2A20003 X-Rspam-User: X-Rspamd-Server: rspam05 X-Stat-Signature: 1nekiuu74it4ub3d5igatg648j1gihkh X-HE-Tag: 1695368440-529938 X-HE-Meta: U2FsdGVkX1+Nf15OtFRh/GWOhBC8lioEu5IWohjxlJ0LWinF33SAmc9gEOHzGRMlQK7XrCr0uh25YKiF/nJw9KDP+SL1Y+nydT7Zk6HuZfi4FOen7FF/UxQxUuOWkz+mrjhCHBSDqdFZ2x5TuZMXVEFsQvsqyF+78gix8iq7USdem2ZS0nghVxAx+T3gepPZI5O5bMwB54Kg5wiC+upABjaAIjvYWSJPDPTuUEl1Zr/fblxGhWijV+sKoOHwEkAbA9aG+w8eEsZdqD4av8QDdLSxOJAfkn1Kn6/JltjK+eGpoN4y63+ahAGPvCvLhe6wWUxLN4bw+OKOXNQXoCR2rsN/5rvoHL6I1jUrvjwQbCI4Gd4kdZ2XG3oqHiXOmJ8m6T/XYO1je0SQaLAg7tDbXlIHPUxQRpYZajnsWOKA6oKo90P4+s3njucL0O/eHUlzgMXRAdbeZlIDCLwtsCG4xzm6Wo7CBuOJKymYj5I9j8BA+6GTFoqX2qWtC64Y4FDtX/tDATw3NVnSzE5gRaxqS4h3GpXzi0bdmE2hi9wyxJCRHXvltmdZUawmG5RX5/7Z9C460c9qKh4vYkAkWNwNM9xEeEY5XAXTBRdkw/8t4XcgzSuo61NokZ/nHpY5902+qWmujYPxoJnc8MKY8HeTJZdqIGNaQMfOomxqL1C/D9XmuXRARBLnOmR/3YOqb8XHVWW1SaFrOJeprA8qJKyMzyiQf879szwfufXAS+T/ApnxOzDWwGkpHksm3zuMGJNF63bK0f1Q/YoxOyt08eyRoduDGnwpFhrq0CltAoKg+Vk50U6pKUIuV7VLM+yF40imKsPiJ0IeMwd/tfdOdlwUTueMi4xOXRqukitQ45pESgUhcBsZJh7GyKa6V9NHHbxwwuDmBFhLbj5TaD9DkegJA4dGAhaH+svZl8lcBOdlladYNvNlHMP4c210qHpsynTVEWn2xyuv6WoGBiXhJyG 0E1KqNKH ySI1ZrANDtFlrKnApasKsyelb9s8S7uUHTUwMvMJ6s/5IBdFxShkEdGXLxwWDlFQ6KaPQOvFxEcw91Dw3bbAs9RY857odPtRcm+Le08/galmjwyOe574+Kz24zAARNH8vHov+M68gUmcnX3Pz6Shvg/qtJg22YwytZzlDD2jNnRX+xfcRRy4xskCR5oFhurQtf6cc8ivdn6AX8tt1HGTnPvVX9ru/eI4M/20LZJgJEyH5gRa/pPB/D2bydbZx04pzXYxO X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 22/09/2023 03:54, Qi Zheng wrote: > Hi Ryan, > > On 2023/9/22 00:20, Ryan Roberts wrote: >> When called with a swap entry that does not embed a PFN (e.g. >> PTE_MARKER_POISONED or PTE_MARKER_UFFD_WP), the previous implementation >> of set_huge_pte_at() would either cause a BUG() to fire (if >> CONFIG_DEBUG_VM is enabled) or cause a dereference of an invalid address >> and subsequent panic. >> >> arm64's huge pte implementation supports multiple huge page sizes, some >> of which are implemented in the page table with contiguous mappings. So >> set_huge_pte_at() needs to work out how big the logical pte is, so that >> it can also work out how many physical ptes (or pmds) need to be >> written. It does this by grabbing the folio out of the pte and querying >> its size. >> >> However, there are cases when the pte being set is actually a swap >> entry. But this also used to work fine, because for huge ptes, we only >> ever saw migration entries and hwpoison entries. And both of these types >> of swap entries have a PFN embedded, so the code would grab that and >> everything still worked out. >> >> But over time, more calls to set_huge_pte_at() have been added that set >> swap entry types that do not embed a PFN. And this causes the code to go >> bang. The triggering case is for the uffd poison test, commit >> 99aa77215ad0 ("selftests/mm: add uffd unit test for UFFDIO_POISON"), >> which sets a PTE_MARKER_POISONED swap entry. But review shows there are >> other places too (PTE_MARKER_UFFD_WP). >> >> So the root cause is due to commit 18f3962953e4 ("mm: hugetlb: kill >> set_huge_swap_pte_at()"), which aimed to simplify the interface to the >> core code by removing set_huge_swap_pte_at() (which took a page size >> parameter) and replacing it with calls to set_huge_swap_pte_at() where >> the size was inferred from the folio, as descibed above. While that >> commit didn't break anything at the time, > > If it didn't break anything at that time, then shouldn't the Fixes tag > be added to this commit? > >> it did break the interface >> because it couldn't handle swap entries without PFNs. And since then new >> callers have come along which rely on this working. > > So the Fixes tag should be added only to the commit that introduces the > first new callers? Well I guess it's a matter of point of view; My view is that 18f3962953e4 is the buggy change because it broke the interface to not be able to handle swap entries which do not contain PFNs. The fact that there were no callers that used the interface in this way at the time of the commit is irrelevant in my view. But I already added 2 fixes tags; one for the buggy commit, and the other for the commit containing the new user of the interface. > > Other than that, LGTM. Thanks! > > Thanks, > Qi > >> >> Now that we have modified the set_huge_pte_at() interface to pass the >> vma, we can extract the huge page size from it and fix this issue. >> >> I'm tagging the commit that added the uffd poison feature, since that is >> what exposed the problem, as well as the original change that broke the >> interface. Hopefully this is valuable for people doing bisect. >> >> Signed-off-by: Ryan Roberts >> Fixes: 18f3962953e4 ("mm: hugetlb: kill set_huge_swap_pte_at()") >> Fixes: 8a13897fb0da ("mm: userfaultfd: support UFFDIO_POISON for hugetlbfs") >> --- >>   arch/arm64/mm/hugetlbpage.c | 17 +++-------------- >>   1 file changed, 3 insertions(+), 14 deletions(-) >> >> diff --git a/arch/arm64/mm/hugetlbpage.c b/arch/arm64/mm/hugetlbpage.c >> index 844832511c1e..a08601a14689 100644 >> --- a/arch/arm64/mm/hugetlbpage.c >> +++ b/arch/arm64/mm/hugetlbpage.c >> @@ -241,13 +241,6 @@ static void clear_flush(struct mm_struct *mm, >>       flush_tlb_range(&vma, saddr, addr); >>   } >>   -static inline struct folio *hugetlb_swap_entry_to_folio(swp_entry_t entry) >> -{ >> -    VM_BUG_ON(!is_migration_entry(entry) && !is_hwpoison_entry(entry)); >> - >> -    return page_folio(pfn_to_page(swp_offset_pfn(entry))); >> -} >> - >>   void set_huge_pte_at(struct vm_area_struct *vma, unsigned long addr, >>                   pte_t *ptep, pte_t pte) >>   { >> @@ -258,13 +251,10 @@ void set_huge_pte_at(struct vm_area_struct *vma, >> unsigned long addr, >>       unsigned long pfn, dpfn; >>       pgprot_t hugeprot; >>   -    if (!pte_present(pte)) { >> -        struct folio *folio; >> - >> -        folio = hugetlb_swap_entry_to_folio(pte_to_swp_entry(pte)); >> -        ncontig = num_contig_ptes(folio_size(folio), &pgsize); >> +    ncontig = num_contig_ptes(huge_page_size(hstate_vma(vma)), &pgsize); >>   -        for (i = 0; i < ncontig; i++, ptep++) >> +    if (!pte_present(pte)) { >> +        for (i = 0; i < ncontig; i++, ptep++, addr += pgsize) >>               set_pte_at(mm, addr, ptep, pte); >>           return; >>       } >> @@ -274,7 +264,6 @@ void set_huge_pte_at(struct vm_area_struct *vma, unsigned >> long addr, >>           return; >>       } >>   -    ncontig = find_num_contig(mm, addr, ptep, &pgsize); >>       pfn = pte_pfn(pte); >>       dpfn = pgsize >> PAGE_SHIFT; >>       hugeprot = pte_pgprot(pte);