From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9A998C77B7A for ; Mon, 17 Apr 2023 20:52:56 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 38B6C900003; Mon, 17 Apr 2023 16:52:54 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 33BB08E0002; Mon, 17 Apr 2023 16:52:54 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 18D9A900003; Mon, 17 Apr 2023 16:52:54 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 07A1A8E0002 for ; Mon, 17 Apr 2023 16:52:54 -0400 (EDT) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id CA1881205C7 for ; Mon, 17 Apr 2023 20:52:53 +0000 (UTC) X-FDA: 80692082226.30.1A9E970 Received: from mail-pl1-f174.google.com (mail-pl1-f174.google.com [209.85.214.174]) by imf30.hostedemail.com (Postfix) with ESMTP id EEE0A8000E for ; Mon, 17 Apr 2023 20:52:51 +0000 (UTC) Authentication-Results: imf30.hostedemail.com; dkim=pass header.d=gmail.com header.s=20221208 header.b=W9nPVyoX; spf=pass (imf30.hostedemail.com: domain of vishal.moola@gmail.com designates 209.85.214.174 as permitted sender) smtp.mailfrom=vishal.moola@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1681764772; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=73w88W+Bv7iZwJaXp6X3OPD7H4X7IV5/5eDbDnIxbNE=; b=aADw+JzT20r3pkAU9nQHNdUv3BWNdlBoNiIpfNvJouYXeOqqNrEl6E76yQSm8Y/MOeqsCv 8yVV3Aykx7DrYDhvTeJknYzX8DjtcOJaWX7YFYBb9LeStlMxMwABA87jlUo6MY3oU1C+j1 sHRrQTEdjx41RKZHWsvQytoC4jCl7/M= ARC-Authentication-Results: i=1; imf30.hostedemail.com; dkim=pass header.d=gmail.com header.s=20221208 header.b=W9nPVyoX; spf=pass (imf30.hostedemail.com: domain of vishal.moola@gmail.com designates 209.85.214.174 as permitted sender) smtp.mailfrom=vishal.moola@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1681764772; a=rsa-sha256; cv=none; b=fSDcLU2nGM5iOe4yYWxHMYaQL11v7rW8B2BIdipyMlNO7WSYhW5P8uU5gvmBTbGpzflPmK 2Q4RDA/tZMODfLLRRS9yEbhrr5+198NWdk5tnI+yE5JWq0rwP+P0t8v54KuQF5KtRUY9OU FAx0qBE4xSGa4Mxn7V0mQE8odxKNqVo= Received: by mail-pl1-f174.google.com with SMTP id p8so27386645plk.9 for ; Mon, 17 Apr 2023 13:52:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1681764771; x=1684356771; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=73w88W+Bv7iZwJaXp6X3OPD7H4X7IV5/5eDbDnIxbNE=; b=W9nPVyoXWKBUEnGfTyhkHARBTsZqdpJrkrNTKo667lyZEzjN6PxmFbbY0YylZMq9yl YfrdFmghyeO5HwXhYCrYBTje7eKqSW91jSFSDlT0dbMWvyCEN9ttpAXe7AFMT1oxAH0K BCnetbVzBpycS1Tax/m+o/Gfxhef/Kkj1D6sF8rcDiRlOa7VvGL8i+xK5Gl2/zoIf4yK M/9RMi7Hd+G3wH7cuJrpgQnusczVewZS29/AobewpqmBg09r8g/9YIIka/gTIbj6DHBc MFg7CjS5kCFyT6XG4/q3MJQ78bnC2QIXJhA82Tu9j9zbgdzbLpx3IE+L7G092ISLAdCE r0mA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1681764771; x=1684356771; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=73w88W+Bv7iZwJaXp6X3OPD7H4X7IV5/5eDbDnIxbNE=; b=NY8zx+e3/gGc/TBWJ4DiYPIsFfIc4QLhPCp/OdYpSg5WnC0hlRJ19AvyNK/GfLJt0e 0IPFDsvuJBcUmUAL33qewIPTdKntCUDMmjcOB9ANVI4scr+UG4rGO3wR7MCAZeRVqn2t Ysj7tgyYLmgSYHDwo5FxllxXOdo8rnQeVhXlVqZMG/fREbsL47UWLk49/vhEMEdnDBAs lHKiqImxWn3EM8YoyWvthTGCO8BvhtRfBqzqGSNybxWhzpKQPrVUUtCSIjat+upxtkiv A7X0L+sYpZJv+qOV2M6H1INOiS9Cz94wRrBaoLgCBk0TjhlYARFBg2/d4k5eLwKmNhlm e6KA== X-Gm-Message-State: AAQBX9defhHXY+AFPKofCZkk/UoSlni+lV4bRdwo7oOK9jFl9fIokD6p +vZk4Hm/gS14SfsXOdxYG4s= X-Google-Smtp-Source: AKy350ZgO/j6WOIysdkqHxj8eua8dcgo+KDK2FD0csNlrjJfCGtmgVmsUk4Xos3l7Ag2y16revzrHg== X-Received: by 2002:a17:902:8bc6:b0:1a2:8924:224a with SMTP id r6-20020a1709028bc600b001a28924224amr205356plo.25.1681764770838; Mon, 17 Apr 2023 13:52:50 -0700 (PDT) Received: from fedora.hsd1.ca.comcast.net ([2601:644:937f:7f20::c139]) by smtp.googlemail.com with ESMTPSA id h7-20020a17090ac38700b0022335f1dae2sm7609707pjt.22.2023.04.17.13.52.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 17 Apr 2023 13:52:50 -0700 (PDT) From: "Vishal Moola (Oracle)" To: Andrew Morton , Matthew Wilcox Cc: linux-mm@kvack.org, linux-arch@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-csky@vger.kernel.org, linux-hexagon@vger.kernel.org, loongarch@lists.linux.dev, linux-m68k@lists.linux-m68k.org, linux-mips@vger.kernel.org, linux-openrisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-riscv@lists.infradead.org, linux-s390@vger.kernel.org, linux-sh@vger.kernel.org, sparclinux@vger.kernel.org, linux-um@lists.infradead.org, xen-devel@lists.xenproject.org, kvm@vger.kernel.org, "Vishal Moola (Oracle)" Subject: [PATCH 04/33] mm: add utility functions for ptdesc Date: Mon, 17 Apr 2023 13:50:19 -0700 Message-Id: <20230417205048.15870-5-vishal.moola@gmail.com> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20230417205048.15870-1-vishal.moola@gmail.com> References: <20230417205048.15870-1-vishal.moola@gmail.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspam-User: X-Rspamd-Server: rspam03 X-Stat-Signature: gt55t3htzr958accqfhxujensyf7nxcz X-Rspamd-Queue-Id: EEE0A8000E X-HE-Tag: 1681764771-801760 X-HE-Meta: U2FsdGVkX1/R/ATbPL2FBCQlK/OBnSkX4gANU++OgPRYVP5DPKpYwKJTaYzYhIlDayOwv0cu7dDTbGPr+/5Hq7IW5+nfyVbw9zeTvKtYFgB5AR5Y4Npz6OtFdUTRDi6LocmSP5BD+cu4BXKLsFyOIyon2RfglNqbhVenVbkgJl81L6AQYJv7HKlyScs9yV98f/55SSVrCWTZDq+VOEZvzO/8BgkeRb8TmZkJT2kvAZyVgZxwP0vnX/PMZv87A+YDFtUAtBu5o7teKyEi+v5fNC9+iF6tgIraAxpJjQ77eMm79tCHUYIDwFzrxcQfbpHV199BCCW1MAWnfDNVJIxux8i6qBCntQ16gxkGM7Ak3zEkyBPGRkgpnhKHKnwjbVSNU3JqSEOIyIXOoPbrCT2try19dntPWFT9c9qnv2iwC+upo3n/u1MyuWI8Js2Eg80NMTDRtZ7ztDWk9PUPkrPIaMKoZymwxQAfeCyiLABkoCo3zVbmnLSwq4PvagpEY5QT1BcS4yM5Fti1rB7AFZ8Px7rEXfxVNOZr4Ut9tLWiVKS0/D8M1tbzN3XT3FFktRrXGmCYs49lWx14pQMdMQlzAhsujj5aRZhfAUgLSZnsIp0ugLeMO8n2PKf4u03S+SUX8GSFBHvEsdsIejUBYfxvAXgwvvs0nYujxtqpZ/8PrUCjO2S5P1R1ap0Cdl1N/jeMFK8u6+4yiEKXu4nVh7mErUGTL2orDp9MolpP4BrC/gq7A5GCE7a740fLFd/c+idgQ1VEfX3qDxXXo+9aVLc40fFt0eIEDTX9QbTqb0LBKR2xNPwOU9dxdJp4WEIyiUvh15/A62P2x4mY2eZOBL4tTE6RIgI8ZImp22tNThehUYMjJ5hGSxgz6XguE5vKjrRxZzLjaB29i+NVr6oymcWZwyUtFJ330zR/Jnxgt6P6WTuDo/vcUEC/iZNq6TmLLvGGlcFgD8RqH3L81SRAk4V /lvD78gP zepZ1cclFbeP5gaV7uZLj3qDX0dTmkY6zWjND9TaaaTeBgyzLv3gr2pe8xgdcK/yZ1BibDPFlL37MCiyUgGKbnKsC6T+Emnzgv+j1OVrlsag8jSWFH1v183e7wlN10Pkty4M1WDHpjedLpdpRjEAfNLLDW7KmKeG5oDMdVa8ErcRnVKqJsWr53q6bqtNV+gPvYuuWIe6nh1a2L9Osz/Lh+wiRY2P4b+cTl2EmZTP9kFZ2lX05C/AK29ztdfWeO9db6fx3EczoNBEUHU+9TD4hoQpCNt03mq+m/YejJWjXrS4Q8A/yMXwNWumvZ/aYhWlzhN9GRHOQ3FIiisN0uJn/2BC+kDFppJAydlTlhOkWeNlCM8W+AhnXwy58MgjzcjU24NnSco+H8191SyoHvbyMc0BXIJ9qyURe9J7Q1ZQJDh1L7i7EcQKXpH/cMr1UPuJ0ehRjb8Gv2DNwdtGuO/lvSSrjdE5GzoZrFvHbbyT8slKJg61yuBbwhnJdtMjTofYrLT6scJE54BMT992dMqDs3qLye06oA1uOKdjECDm7gUNeUus= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Introduce utility functions setting the foundation for ptdescs. These will also assist in the splitting out of ptdesc from struct page. ptdesc_alloc() is defined to allocate new ptdesc pages as compound pages. This is to standardize ptdescs by allowing for one allocation and one free function, in contrast to 2 allocation and 2 free functions. Signed-off-by: Vishal Moola (Oracle) --- include/asm-generic/tlb.h | 11 ++++++++++ include/linux/mm.h | 44 +++++++++++++++++++++++++++++++++++++++ include/linux/pgtable.h | 13 ++++++++++++ 3 files changed, 68 insertions(+) diff --git a/include/asm-generic/tlb.h b/include/asm-generic/tlb.h index b46617207c93..6bade9e0e799 100644 --- a/include/asm-generic/tlb.h +++ b/include/asm-generic/tlb.h @@ -481,6 +481,17 @@ static inline void tlb_remove_page(struct mmu_gather *tlb, struct page *page) return tlb_remove_page_size(tlb, page, PAGE_SIZE); } +static inline void tlb_remove_ptdesc(struct mmu_gather *tlb, void *pt) +{ + tlb_remove_table(tlb, pt); +} + +/* Like tlb_remove_ptdesc, but for page-like page directories. */ +static inline void tlb_remove_page_ptdesc(struct mmu_gather *tlb, struct ptdesc *pt) +{ + tlb_remove_page(tlb, ptdesc_page(pt)); +} + static inline void tlb_change_page_size(struct mmu_gather *tlb, unsigned int page_size) { diff --git a/include/linux/mm.h b/include/linux/mm.h index b18848ae7e22..ec3cbe2fa665 100644 --- a/include/linux/mm.h +++ b/include/linux/mm.h @@ -2744,6 +2744,45 @@ static inline pmd_t *pmd_alloc(struct mm_struct *mm, pud_t *pud, unsigned long a } #endif /* CONFIG_MMU */ +static inline struct ptdesc *virt_to_ptdesc(const void *x) +{ + return page_ptdesc(virt_to_head_page(x)); +} + +static inline void *ptdesc_to_virt(struct ptdesc *pt) +{ + return page_to_virt(ptdesc_page(pt)); +} + +static inline void *ptdesc_address(struct ptdesc *pt) +{ + return folio_address(ptdesc_folio(pt)); +} + +static inline bool ptdesc_is_reserved(struct ptdesc *pt) +{ + return folio_test_reserved(ptdesc_folio(pt)); +} + +static inline struct ptdesc *ptdesc_alloc(gfp_t gfp, unsigned int order) +{ + struct page *page = alloc_pages(gfp | __GFP_COMP, order); + + return page_ptdesc(page); +} + +static inline void ptdesc_free(struct ptdesc *pt) +{ + struct page *page = ptdesc_page(pt); + + __free_pages(page, compound_order(page)); +} + +static inline void ptdesc_clear(void *x) +{ + clear_page(x); +} + #if USE_SPLIT_PTE_PTLOCKS #if ALLOC_SPLIT_PTLOCKS void __init ptlock_cache_init(void); @@ -2970,6 +3009,11 @@ static inline void mark_page_reserved(struct page *page) adjust_managed_page_count(page, -1); } +static inline void free_reserved_ptdesc(struct ptdesc *pt) +{ + free_reserved_page(ptdesc_page(pt)); +} + /* * Default method to free all the __init memory into the buddy system. * The freed pages will be poisoned with pattern "poison" if it's within diff --git a/include/linux/pgtable.h b/include/linux/pgtable.h index 7cc6ea057ee9..7cd803aa38eb 100644 --- a/include/linux/pgtable.h +++ b/include/linux/pgtable.h @@ -97,6 +97,19 @@ TABLE_MATCH(ptl, ptl); #undef TABLE_MATCH static_assert(sizeof(struct ptdesc) <= sizeof(struct page)); +#define ptdesc_page(pt) (_Generic((pt), \ + const struct ptdesc *: (const struct page *)(pt), \ + struct ptdesc *: (struct page *)(pt))) + +#define ptdesc_folio(pt) (_Generic((pt), \ + const struct ptdesc *: (const struct folio *)(pt), \ + struct ptdesc *: (struct folio *)(pt))) + +static inline struct ptdesc *page_ptdesc(struct page *page) +{ + return (struct ptdesc *)page; +} + /* * A page table page can be thought of an array like this: pXd_t[PTRS_PER_PxD] * -- 2.39.2