From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 715A5C3ABC3 for ; Mon, 12 May 2025 12:34:47 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id B93986B0106; Mon, 12 May 2025 08:34:45 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id B16636B0108; Mon, 12 May 2025 08:34:45 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 96A036B0109; Mon, 12 May 2025 08:34:45 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 59CE66B0106 for ; Mon, 12 May 2025 08:34:45 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 82A891A10F6 for ; Mon, 12 May 2025 12:34:45 +0000 (UTC) X-FDA: 83434199730.19.BE1BCE0 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by imf05.hostedemail.com (Postfix) with ESMTP id 5ACE2100012 for ; Mon, 12 May 2025 12:34:43 +0000 (UTC) Authentication-Results: imf05.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b="HIxj/RFt"; spf=pass (imf05.hostedemail.com: domain of dhildenb@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=dhildenb@redhat.com; dmarc=pass (policy=quarantine) header.from=redhat.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1747053283; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=13dAic06AYXZ8stgi94MXGa0Osqutl2B39hqd6w6YHE=; b=2HGgS5m7+P6OAqk4WGQMMPWIuAItLvYuhWKqZ0jbRQkVXmHwr96fBGTy0WkGso51vSH7xB AICCxutp1hMOTGetN0gL+RqapjBgIcWhsr5Tuku3nU0FpLpvUN/5o7NFGZePt35KtORDe1 POFgxyhY7+jUWOnJZuQaGa4pXeM7m3s= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1747053283; a=rsa-sha256; cv=none; b=DHIFHoc6XWWZ7MP6vEDMSZdL9V9Yh6UHf0Rev+ZcJhiYRboONVmkqiidQ0SbuJJcjvIMnT pi+AKDK5+02E5MBxCcN3RJ43SczDPZCjG2RnmRJl7kqsnyvrZ25sNWY9+AhUSpUrBzx7It vciByJOoD6mMJuu8GyCVzMTT8sp3sKs= ARC-Authentication-Results: i=1; imf05.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b="HIxj/RFt"; spf=pass (imf05.hostedemail.com: domain of dhildenb@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=dhildenb@redhat.com; dmarc=pass (policy=quarantine) header.from=redhat.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1747053282; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=13dAic06AYXZ8stgi94MXGa0Osqutl2B39hqd6w6YHE=; b=HIxj/RFt6IxzJydIndMKI805Bnh8YlJkEHAI/p0MkIFNjb/+dOgN/nHAP3mjY6lCtgsdG9 oFy2Ws0TRDRdO4q+h3nDeAsB8D1nWIIuSaw9DUwkBQfU+2eBr1I+mwlFghaqvt4xMQnQDx C4NsHTb5/lMCplL/LU8oKtpZJQEilj8= Received: from mail-wm1-f71.google.com (mail-wm1-f71.google.com [209.85.128.71]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-304-rzB4m5Y_MmivSWfV3C-BNg-1; Mon, 12 May 2025 08:34:41 -0400 X-MC-Unique: rzB4m5Y_MmivSWfV3C-BNg-1 X-Mimecast-MFC-AGG-ID: rzB4m5Y_MmivSWfV3C-BNg_1747053280 Received: by mail-wm1-f71.google.com with SMTP id 5b1f17b1804b1-43cf5196c25so21749755e9.0 for ; Mon, 12 May 2025 05:34:41 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1747053280; x=1747658080; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=13dAic06AYXZ8stgi94MXGa0Osqutl2B39hqd6w6YHE=; b=iIkIL/TvQWPD97s4LMQEAo8ud3I/eHsMC/YnCFZKPncB9HfqEvLwsY2oBKANbUHW9E EC69Gl+GJoWCfgYXHPzF9BB5CnojpKvAWN1v6tq7j4+ye7DVEIbBsT0zVqznbVHZZxha EJ6vXZXCsNDoqYrrtLfl37fUnCzRmRNLrbEgcesvgcff8jkWTloS4NvmyGWpF19n+DkO F6WvOct7VZwURsPldv4OP2r3Yl5ljPn7nEbLLSiQfElRI/QmNQ64TbCTd9Qm5r/3+9tL rJRaN0s+pwmIHEFxpoa3XT1S0rDzcKzpkrjmuW6hI5uvaGsZ6YRWEzD92pUVL7lYCdug AtOg== X-Gm-Message-State: AOJu0YxDfYlMhn5oHKbJkUvKt3j6U5UiOdXlU6TUQ0AXyDIiCPMFWyRR haY2hwwudhoeHXobyWSKch4Ov35WVIAVrtyPwW9n2VvcJSLoH3Eoy5g7UeOMq/vspY045D2RIXI iRL2VcJFXOvZ1SMpMx3cQvsSgld+9H1rvdGa8q5cECtbNF22z06XpC+sdUNg= X-Gm-Gg: ASbGncvlJAhyoMW3LfHs8geLv+G7x0UYgc9Fm7j8PRhnBT7mcFooNqsUTLTRrCjezaU oiKfDKQOT9jed+VFmQpsYuA2DeVPPG8LGdoCPsZZkiPCrV48lXJWEnfaQFqW5mPBhYGhBkfpeSy Xp4ktEYZCk2QCv0/0TVMbaukCztKZYKkJG+rfMX/+gUke8BEEMnZpWIcsL0ri342QlBMNilkExU ZLgs1czC/SamqWhIFpjOvj7L+XaDTOpAY3EM6l24X7MLF49Vubrc3pdI+hqmK4qDa1o0xAOhtMK 5umG2bdDP0D9I0WaUEHgH0biA2SVxjf7vUuB98L3ZFiQDDMtFfLDcxH3m4BT7Km4srajhQ0g X-Received: by 2002:a05:600c:8707:b0:43d:8ea:8d7a with SMTP id 5b1f17b1804b1-442d6ddd6eemr75542975e9.28.1747053280385; Mon, 12 May 2025 05:34:40 -0700 (PDT) X-Google-Smtp-Source: AGHT+IHYcR0QvFdl5lqSrPfju6l0qj9023QUSGb7KmYchmWeB3prbPPuHFd5J5L+A7FGYZKCJT6pZQ== X-Received: by 2002:a05:600c:8707:b0:43d:8ea:8d7a with SMTP id 5b1f17b1804b1-442d6ddd6eemr75542655e9.28.1747053279973; Mon, 12 May 2025 05:34:39 -0700 (PDT) Received: from localhost (p200300d82f4a5800f1ae8e20d7f451b0.dip0.t-ipconnect.de. [2003:d8:2f4a:5800:f1ae:8e20:d7f4:51b0]) by smtp.gmail.com with UTF8SMTPSA id ffacd0b85a97d-3a1f58ec0e4sm12199823f8f.40.2025.05.12.05.34.38 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 12 May 2025 05:34:39 -0700 (PDT) From: David Hildenbrand To: linux-kernel@vger.kernel.org Cc: linux-mm@kvack.org, x86@kernel.org, intel-gfx@lists.freedesktop.org, dri-devel@lists.freedesktop.org, linux-trace-kernel@vger.kernel.org, David Hildenbrand , Dave Hansen , Andy Lutomirski , Peter Zijlstra , Thomas Gleixner , Ingo Molnar , Borislav Petkov , "H. Peter Anvin" , Jani Nikula , Joonas Lahtinen , Rodrigo Vivi , Tvrtko Ursulin , David Airlie , Simona Vetter , Andrew Morton , Steven Rostedt , Masami Hiramatsu , Mathieu Desnoyers , "Liam R. Howlett" , Lorenzo Stoakes , Vlastimil Babka , Jann Horn , Pedro Falcato , Peter Xu , Ingo Molnar Subject: [PATCH v2 05/11] x86/mm/pat: remove old pfnmap tracking interface Date: Mon, 12 May 2025 14:34:18 +0200 Message-ID: <20250512123424.637989-6-david@redhat.com> X-Mailer: git-send-email 2.49.0 In-Reply-To: <20250512123424.637989-1-david@redhat.com> References: <20250512123424.637989-1-david@redhat.com> MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-MFC-PROC-ID: aMteovMVhy5ub6gskiMDgJ79NkMVvSMwXWGNQZnIi1U_1747053280 X-Mimecast-Originator: redhat.com Content-Transfer-Encoding: 8bit content-type: text/plain; charset="US-ASCII"; x-default=true X-Stat-Signature: fpiy3awzheja8eqj3pwdxaon85tjigmu X-Rspamd-Queue-Id: 5ACE2100012 X-Rspam-User: X-Rspamd-Server: rspam02 X-HE-Tag: 1747053283-350954 X-HE-Meta: U2FsdGVkX19KwapUvaA1kieS8TvYS33CLlZ2RViBBG+mUfpU97PVS/WYCdcxWcmI1fIn3udogxtNTClVXOejmQ3XJBznSIRFpHDW44JaH1411by4Tyrbuj2y8d2uRqIfOMQd6gHUJWFDCgMaWOvGWGy/P+B5AATMA4jBBqCArMnkxBD1I366NwYp+AASiYtZ02UJp/yF/N+g0DYYQnvkojh2QQ7TJ8HOyMpa52dmWXsQk6TT/y6D1pq4Y374NDxSPKE29sFAT5/l3oBETHXv1lAf4Z7FoDPd6OtA9i+LWAeFGn7VDkUs1a+gWIhyWZ4JSeqLPFHkM+TSZRcObjDgd1DMDHK38fT12fK/qRjh95qmAwcoI6hR+e+42xzBzJSLskvG4KbwJkvIAuEFN44STCQgGJ74ACih77p3gz17oJ93nMz1eCeKbLceaX+P3F2v4ecVgNm5vHkrXuqrph4Zgugms0Oit4huf/9LWwMZAiPPwQK+ZuT5Ug7gZAgtf5yqZtuVM6h1PVa2nRJs+V0U7w8+rC8vb9YCfARAE7ZPOZatWXprcVq91kGWaMxZow6W4FvZXTI4KVXOoliVA0ui/IPJzXwhl2CrDrsLKyi3BQ/wnweuW+PRBW7esO0Gpt/Sz3QgoxWMWmuESY3cHthDtz459NmpyFplo9LgLN7RVIMSH8EbKatE/eVm3gj4uktJqs5r0tAcv26HWMOqtuxz2sMBjEjO1QM7aR8iIwag9KI1Pop2hiLKCPa3TQk9yp/Lb3etT8DrPF6JtBH21971rO3r109jAlAhOdoEXp7JhRoUO3w8VobTsatBqLBLwh69OQ0syjqggLHjWfT6Bw+tMGq2yH6cEbEzLlNQUQ6iKIPxb5UxikNJr7ZhQDEGh16jT+WtpMZkfKi0yfMRXY4y5keKoHmsC70OZP7rT/ChdAzGRs3N7xCYTWL+ggpvYKCTMCwLypd+X9ZIj9J1AMY UEBdE/ZB WnHtGTAsDJLn2SzvU6SDlLeJITG+a5+L3Uy7Cm8JrMx4i+Eha4Rq44mwcaE3o6ArgVymadHw/nNGg96Q7f88PvkNkFgsIbmMZYg1TgPcP91gS81bsy5qAI7Nny4NIfZRBTNwvtqoYxDTzGnNPlW4pyz11IKjYMZfL1HAeFMw9tObsLJ/A6DIhOtsRXdCbdC2YAt44sXBzs59jNS05qqfgn1xTwXN/j6tsthmmqDdbg3TiLUUXJW3E9GmGZM3Dj/YjZ20PXb0TleQ1iEvtsybQXO5SrDhxWE/S3lJE1LmcwErA3epxU12H7WhLLPzzjGayBdTGje7v8AEEBF+cqEbOfOzRlOoDt5ZVJYGupK1SgFLX6kZpPaMyJxGHI54yU0OsmTQonrLgXvmR5fLZpzrvVXdhG8DXprsni84KVsCaxNXfPoQisFvB1fsxuT/fVcGAjkDWiCJBlbalW57gwDwG3dFKypKMmcGzHvndJ3cEg/g1B5cUPcwYpgAWIKI+dq9yEoLMAgw9C/159SDe4NJzNu/jXvqhGhMrke3VBxdgvOY7ku2/XpAs/Nfd7Wpha938Mt1fgcsKd5uST2pgQBkUGICvwOMZTe+DBbZrq6wNH5KfMIerEIRrTFBk2g3cS617EG4p X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: We can now get rid of the old interface along with get_pat_info() and follow_phys(). Reviewed-by: Lorenzo Stoakes Acked-by: Ingo Molnar # x86 bits Signed-off-by: David Hildenbrand --- arch/x86/mm/pat/memtype.c | 147 -------------------------------------- include/linux/pgtable.h | 66 ----------------- 2 files changed, 213 deletions(-) diff --git a/arch/x86/mm/pat/memtype.c b/arch/x86/mm/pat/memtype.c index 1ec8af6cad6bf..c88d1cbdc1de1 100644 --- a/arch/x86/mm/pat/memtype.c +++ b/arch/x86/mm/pat/memtype.c @@ -933,119 +933,6 @@ static void free_pfn_range(u64 paddr, unsigned long size) memtype_free(paddr, paddr + size); } -static int follow_phys(struct vm_area_struct *vma, unsigned long *prot, - resource_size_t *phys) -{ - struct follow_pfnmap_args args = { .vma = vma, .address = vma->vm_start }; - - if (follow_pfnmap_start(&args)) - return -EINVAL; - - /* Never return PFNs of anon folios in COW mappings. */ - if (!args.special) { - follow_pfnmap_end(&args); - return -EINVAL; - } - - *prot = pgprot_val(args.pgprot); - *phys = (resource_size_t)args.pfn << PAGE_SHIFT; - follow_pfnmap_end(&args); - return 0; -} - -static int get_pat_info(struct vm_area_struct *vma, resource_size_t *paddr, - pgprot_t *pgprot) -{ - unsigned long prot; - - VM_WARN_ON_ONCE(!(vma->vm_flags & VM_PAT)); - - /* - * We need the starting PFN and cachemode used for track_pfn_remap() - * that covered the whole VMA. For most mappings, we can obtain that - * information from the page tables. For COW mappings, we might now - * suddenly have anon folios mapped and follow_phys() will fail. - * - * Fallback to using vma->vm_pgoff, see remap_pfn_range_notrack(), to - * detect the PFN. If we need the cachemode as well, we're out of luck - * for now and have to fail fork(). - */ - if (!follow_phys(vma, &prot, paddr)) { - if (pgprot) - *pgprot = __pgprot(prot); - return 0; - } - if (is_cow_mapping(vma->vm_flags)) { - if (pgprot) - return -EINVAL; - *paddr = (resource_size_t)vma->vm_pgoff << PAGE_SHIFT; - return 0; - } - WARN_ON_ONCE(1); - return -EINVAL; -} - -int track_pfn_copy(struct vm_area_struct *dst_vma, - struct vm_area_struct *src_vma, unsigned long *pfn) -{ - const unsigned long vma_size = src_vma->vm_end - src_vma->vm_start; - resource_size_t paddr; - pgprot_t pgprot; - int rc; - - if (!(src_vma->vm_flags & VM_PAT)) - return 0; - - /* - * Duplicate the PAT information for the dst VMA based on the src - * VMA. - */ - if (get_pat_info(src_vma, &paddr, &pgprot)) - return -EINVAL; - rc = reserve_pfn_range(paddr, vma_size, &pgprot, 1); - if (rc) - return rc; - - /* Reservation for the destination VMA succeeded. */ - vm_flags_set(dst_vma, VM_PAT); - *pfn = PHYS_PFN(paddr); - return 0; -} - -void untrack_pfn_copy(struct vm_area_struct *dst_vma, unsigned long pfn) -{ - untrack_pfn(dst_vma, pfn, dst_vma->vm_end - dst_vma->vm_start, true); - /* - * Reservation was freed, any copied page tables will get cleaned - * up later, but without getting PAT involved again. - */ -} - -/* - * prot is passed in as a parameter for the new mapping. If the vma has - * a linear pfn mapping for the entire range, or no vma is provided, - * reserve the entire pfn + size range with single reserve_pfn_range - * call. - */ -int track_pfn_remap(struct vm_area_struct *vma, pgprot_t *prot, - unsigned long pfn, unsigned long addr, unsigned long size) -{ - resource_size_t paddr = (resource_size_t)pfn << PAGE_SHIFT; - - /* reserve the whole chunk starting from paddr */ - if (!vma || (addr == vma->vm_start - && size == (vma->vm_end - vma->vm_start))) { - int ret; - - ret = reserve_pfn_range(paddr, size, prot, 0); - if (ret == 0 && vma) - vm_flags_set(vma, VM_PAT); - return ret; - } - - return pfnmap_setup_cachemode(pfn, size, prot); -} - int pfnmap_setup_cachemode(unsigned long pfn, unsigned long size, pgprot_t *prot) { resource_size_t paddr = (resource_size_t)pfn << PAGE_SHIFT; @@ -1082,40 +969,6 @@ void pfnmap_untrack(unsigned long pfn, unsigned long size) free_pfn_range(paddr, size); } -/* - * untrack_pfn is called while unmapping a pfnmap for a region. - * untrack can be called for a specific region indicated by pfn and size or - * can be for the entire vma (in which case pfn, size are zero). - */ -void untrack_pfn(struct vm_area_struct *vma, unsigned long pfn, - unsigned long size, bool mm_wr_locked) -{ - resource_size_t paddr; - - if (vma && !(vma->vm_flags & VM_PAT)) - return; - - /* free the chunk starting from pfn or the whole chunk */ - paddr = (resource_size_t)pfn << PAGE_SHIFT; - if (!paddr && !size) { - if (get_pat_info(vma, &paddr, NULL)) - return; - size = vma->vm_end - vma->vm_start; - } - free_pfn_range(paddr, size); - if (vma) { - if (mm_wr_locked) - vm_flags_clear(vma, VM_PAT); - else - __vm_flags_mod(vma, 0, VM_PAT); - } -} - -void untrack_pfn_clear(struct vm_area_struct *vma) -{ - vm_flags_clear(vma, VM_PAT); -} - pgprot_t pgprot_writecombine(pgprot_t prot) { pgprot_set_cachemode(&prot, _PAGE_CACHE_MODE_WC); diff --git a/include/linux/pgtable.h b/include/linux/pgtable.h index 90f72cd358390..0b6e1f781d86d 100644 --- a/include/linux/pgtable.h +++ b/include/linux/pgtable.h @@ -1485,17 +1485,6 @@ static inline pmd_t pmd_swp_clear_soft_dirty(pmd_t pmd) * vmf_insert_pfn. */ -/* - * track_pfn_remap is called when a _new_ pfn mapping is being established - * by remap_pfn_range() for physical range indicated by pfn and size. - */ -static inline int track_pfn_remap(struct vm_area_struct *vma, pgprot_t *prot, - unsigned long pfn, unsigned long addr, - unsigned long size) -{ - return 0; -} - static inline int pfnmap_setup_cachemode(unsigned long pfn, unsigned long size, pgprot_t *prot) { @@ -1511,55 +1500,7 @@ static inline int pfnmap_track(unsigned long pfn, unsigned long size, static inline void pfnmap_untrack(unsigned long pfn, unsigned long size) { } - -/* - * track_pfn_copy is called when a VM_PFNMAP VMA is about to get the page - * tables copied during copy_page_range(). Will store the pfn to be - * passed to untrack_pfn_copy() only if there is something to be untracked. - * Callers should initialize the pfn to 0. - */ -static inline int track_pfn_copy(struct vm_area_struct *dst_vma, - struct vm_area_struct *src_vma, unsigned long *pfn) -{ - return 0; -} - -/* - * untrack_pfn_copy is called when a VM_PFNMAP VMA failed to copy during - * copy_page_range(), but after track_pfn_copy() was already called. Can - * be called even if track_pfn_copy() did not actually track anything: - * handled internally. - */ -static inline void untrack_pfn_copy(struct vm_area_struct *dst_vma, - unsigned long pfn) -{ -} - -/* - * untrack_pfn is called while unmapping a pfnmap for a region. - * untrack can be called for a specific region indicated by pfn and size or - * can be for the entire vma (in which case pfn, size are zero). - */ -static inline void untrack_pfn(struct vm_area_struct *vma, - unsigned long pfn, unsigned long size, - bool mm_wr_locked) -{ -} - -/* - * untrack_pfn_clear is called in the following cases on a VM_PFNMAP VMA: - * - * 1) During mremap() on the src VMA after the page tables were moved. - * 2) During fork() on the dst VMA, immediately after duplicating the src VMA. - */ -static inline void untrack_pfn_clear(struct vm_area_struct *vma) -{ -} #else -extern int track_pfn_remap(struct vm_area_struct *vma, pgprot_t *prot, - unsigned long pfn, unsigned long addr, - unsigned long size); - /** * pfnmap_setup_cachemode - setup the cachemode in the pgprot for a pfn range * @pfn: the start of the pfn range @@ -1614,13 +1555,6 @@ int pfnmap_track(unsigned long pfn, unsigned long size, pgprot_t *prot); * Untrack a pfn range previously tracked through pfnmap_track(). */ void pfnmap_untrack(unsigned long pfn, unsigned long size); -extern int track_pfn_copy(struct vm_area_struct *dst_vma, - struct vm_area_struct *src_vma, unsigned long *pfn); -extern void untrack_pfn_copy(struct vm_area_struct *dst_vma, - unsigned long pfn); -extern void untrack_pfn(struct vm_area_struct *vma, unsigned long pfn, - unsigned long size, bool mm_wr_locked); -extern void untrack_pfn_clear(struct vm_area_struct *vma); #endif /** -- 2.49.0