From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4E0B7C3ABBC for ; Tue, 6 May 2025 05:01:36 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id CD9526B0085; Tue, 6 May 2025 01:01:33 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id C606F6B0088; Tue, 6 May 2025 01:01:33 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B01C56B0089; Tue, 6 May 2025 01:01:33 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 939746B0085 for ; Tue, 6 May 2025 01:01:33 -0400 (EDT) Received: from smtpin29.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id ED88D1A1841 for ; Tue, 6 May 2025 05:01:34 +0000 (UTC) X-FDA: 83411284908.29.191EDD4 Received: from foss.arm.com (foss.arm.com [217.140.110.172]) by imf08.hostedemail.com (Postfix) with ESMTP id 64C2E160005 for ; Tue, 6 May 2025 05:01:33 +0000 (UTC) Authentication-Results: imf08.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf08.hostedemail.com: domain of dev.jain@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=dev.jain@arm.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1746507693; a=rsa-sha256; cv=none; b=1jABByJNVYNj61nwChKj7GWYUJHN0JIvFtvpkicx+EJHHUUcNO/CuCMLkmIiuisVCx6zXa ZuTmNoDehDWbDE5gKT6Cy9SQpVB696BBwZT9035tcQWaPW2hFr2+ye6K8OLqZQyQ9ta9Ce YwadqoLElwfLawlklXYaazdh3yxV8eY= ARC-Authentication-Results: i=1; imf08.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=arm.com; spf=pass (imf08.hostedemail.com: domain of dev.jain@arm.com designates 217.140.110.172 as permitted sender) smtp.mailfrom=dev.jain@arm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1746507693; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ZyullRICK/tjw+J8m+nUyZiscky1fhGnGk7EsGXgn7c=; b=7AuEP3upJvkHUOcsz3YVDJ8u9ZWs2b3GhUG/GhTaZCJQi4Kj9nHKqJUXjX7ub3TpGuxB41 fI2gdxHjj8AFVNtkscdEdCfN1gJx5zmGTXng68GgM88PSz3vARIgSLi0/NsKnKJ3rr/gf+ 43OIG9pcoH8wgJf5lsQF+1L1wypABPs= Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id E63CF1E5E; Mon, 5 May 2025 22:01:22 -0700 (PDT) Received: from K4MQJ0H1H2.emea.arm.com (K4MQJ0H1H2.blr.arm.com [10.162.43.13]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 7F33F3F5A1; Mon, 5 May 2025 22:01:26 -0700 (PDT) From: Dev Jain To: akpm@linux-foundation.org Cc: Liam.Howlett@oracle.com, lorenzo.stoakes@oracle.com, vbabka@suse.cz, jannh@google.com, pfalcato@suse.de, linux-mm@kvack.org, linux-kernel@vger.kernel.org, david@redhat.com, peterx@redhat.com, ryan.roberts@arm.com, mingo@kernel.org, libang.li@antgroup.com, maobibo@loongson.cn, zhengqi.arch@bytedance.com, baohua@kernel.org, anshuman.khandual@arm.com, willy@infradead.org, ioworker0@gmail.com, yang@os.amperecomputing.com, Dev Jain Subject: [PATCH 2/3] mm: Add generic helper to hint a large folio Date: Tue, 6 May 2025 10:30:55 +0530 Message-Id: <20250506050056.59250-3-dev.jain@arm.com> X-Mailer: git-send-email 2.39.3 (Apple Git-146) In-Reply-To: <20250506050056.59250-1-dev.jain@arm.com> References: <20250506050056.59250-1-dev.jain@arm.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: 64C2E160005 X-Stat-Signature: inudyin1dupo9ur4uocrintgytw3dw4g X-Rspam-User: X-HE-Tag: 1746507693-603456 X-HE-Meta: U2FsdGVkX18b5SN2Kki9CmklCi2Xn1HhCT9lV0OgKRJ6cb8WAD+NRfqndpKGbKztLW8Dp/gvIThuoOvvhxfTFX/4Nws/++zLDRYW2f233FU1IKtg5nfFkMPcAWtQYsG85ExITifaghDw/GYn/U/vracmzcePDZk2byW1r7VoR+pbg52KHzQbzKaqD920FYr8H12WzRN+ZTRtCiGOmUxyyl14U1+aH1Qzx4PCxq5ry5BgII+vNOMPtWGptm62kX9f3wXvCOtHez09ke1/leEOxdhn6A2HHBKPG8rE0n5foC7/uKYlrNI1Nlz0IHsIYJxi6/6MKBbPqqgBeNVlgCP4ZvSu90WEXfoTlqBqYUJX0zLfI5snyo/vFTdWxDK7vlxwqWUp1T581cFW8Jzj5O7ytppAa+KjecJkejZYUCPfbhzdEnTSxYgyFIi1GHgfNeyy0PjgQ053Z99ln58aI6SePt4cR6QNhZLNAhMjD3WNWFqY01q9GefkyNOf+NTdOKdS+VNv6kbrIR0Zg+YZ6IgZxNcUl/KNnKT/Qm+9V67IxRwwgvwF85jIDqEGxjtLLY8Qoqq2aQDXsCqRiC3Tvy8NaCYK7VpYmoeNeiturPy56op1u5F67Qzw1Rgyb6jo/PmcGTfr9ZZ4GUks7+MayVVSQql7E2sqDv6/7uJehphcmTLTesCXXzFH9YUC/jkB7RRwxtPEWi5YIke2BdzyzQyuDAfvUWf6VLF0NlLlrEpjQ0ZrD7wyJLlkG2z42AGUnVGuYLnXN6BM5r0o5GD9q+tBjlJPAl9kKp8uKrXtkAHwGJj/tsP03dsJxM25f6SJly0MGYGeRcucT6422YaW6c5NnObjwEEdb8bH9ja6LG7xW7wURvg71G3mh/bbQM5YeEI2Pb2HJmMAbLGG12kmh39t0j4nF5YaYljrKNQ8ys8gXqGi+dDjXi6y+6ClSvnrd0RwN4dXet9b5+Yf1DUXvna Nj1b5wFs yDmSKpGUNjqhy+ozzbI31T7pXp8VlpHiI69m4CdFUlrydzJ4h3XUz6etY8TsVu9VfdLL/3wTElDLHXttwgijJ/6HMMpQtCfOhfWKa5RTomYcvOjhKKyjQUZMDkH+qS1AyKe/q2JD/RVSpDHG+PJlJvi7WZw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: To use PTE batching, we want to determine whether the folio mapped by the PTE is large, thus requiring the use of vm_normal_folio(). We want to avoid the cost of vm_normal_folio() if the code path doesn't already require the folio. For arm64, pte_batch_hint() does the job. To generalize this hint, add a helper which will determine whether two consecutive PTEs point to consecutive PFNs, in which case there is a high probability that the underlying folio is large. Signed-off-by: Dev Jain --- include/linux/pgtable.h | 16 ++++++++++++++++ 1 file changed, 16 insertions(+) diff --git a/include/linux/pgtable.h b/include/linux/pgtable.h index b50447ef1c92..28e21fcc7837 100644 --- a/include/linux/pgtable.h +++ b/include/linux/pgtable.h @@ -369,6 +369,22 @@ static inline pgd_t pgdp_get(pgd_t *pgdp) } #endif +/* Caller must ensure that ptep + 1 exists */ +static inline bool maybe_contiguous_pte_pfns(pte_t *ptep, pte_t pte) +{ + pte_t *next_ptep, next_pte; + + if (pte_batch_hint(ptep, pte) != 1) + return true; + + next_ptep = ptep + 1; + next_pte = ptep_get(next_ptep); + if (!pte_present(next_pte)) + return false; + + return unlikely(pte_pfn(next_pte) - pte_pfn(pte) == PAGE_SIZE); +} + #ifndef __HAVE_ARCH_PTEP_TEST_AND_CLEAR_YOUNG static inline int ptep_test_and_clear_young(struct vm_area_struct *vma, unsigned long address, -- 2.30.2