From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 921BBC369C2 for ; Fri, 25 Apr 2025 08:17:39 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 50E956B0026; Fri, 25 Apr 2025 04:17:37 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 495776B0025; Fri, 25 Apr 2025 04:17:37 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 299686B0028; Fri, 25 Apr 2025 04:17:37 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 0310F6B0025 for ; Fri, 25 Apr 2025 04:17:36 -0400 (EDT) Received: from smtpin27.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 00BBE81701 for ; Fri, 25 Apr 2025 08:17:37 +0000 (UTC) X-FDA: 83371862196.27.9DAF343 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by imf24.hostedemail.com (Postfix) with ESMTP id CC383180007 for ; Fri, 25 Apr 2025 08:17:35 +0000 (UTC) Authentication-Results: imf24.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=Wqdzsfy9; dmarc=pass (policy=quarantine) header.from=redhat.com; spf=pass (imf24.hostedemail.com: domain of dhildenb@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=dhildenb@redhat.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1745569055; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=evDGoI+/XQeXjHcfAaTzbc2xRRT2bYWbObPQgXY7yUk=; b=ssFOAXM44gt2KzjTfDfgcWtpeacdb/oM5NBIcQEFdug42Vt/N0R7et9xDsZkU5mzwGU9J3 42SkTP8ON3EZ/khgou2Z9K0xsL7uc509RgDC1GIgMB7m7nTfhD32xkwzuUan5LeR+iWIQd FEJpDkLoBTwQKoDhiCRvvT00GW8g0qY= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1745569055; a=rsa-sha256; cv=none; b=qgXe36Y82Gd00J8IkfWvIBhIyXrUAZt5uNbMPtUFObHWUrr3SSIiaSje/MGET73k4j67Xn Z7dRWdiZwYZmzJXJ9XM1NFmZd62QQUNtDmBXNlIj24aznQbrBwAggNvSJ78rUH46/QyUVm PEfxsmz/JGZ4BzLdLjxkEyLHSsW6T/A= ARC-Authentication-Results: i=1; imf24.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=Wqdzsfy9; dmarc=pass (policy=quarantine) header.from=redhat.com; spf=pass (imf24.hostedemail.com: domain of dhildenb@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=dhildenb@redhat.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1745569055; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=evDGoI+/XQeXjHcfAaTzbc2xRRT2bYWbObPQgXY7yUk=; b=Wqdzsfy94N5W6yof0UFHONS+iQoSu8tAMz28nUhlZEm+ECS5KsQV6PQg3/TP1Hj1grngfu ftku7Lba/txPYVGMqb0NZzCsDmYlArTd/3nI0Lcyrzd4faFJNFvP8wv9xKmDjjoeg4w2CX evMwzvfB0xCZssbY8/g7fRlU5DyxUXY= Received: from mail-wm1-f72.google.com (mail-wm1-f72.google.com [209.85.128.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-641-rjod4_X2PA-7pQwsLveZNw-1; Fri, 25 Apr 2025 04:17:33 -0400 X-MC-Unique: rjod4_X2PA-7pQwsLveZNw-1 X-Mimecast-MFC-AGG-ID: rjod4_X2PA-7pQwsLveZNw_1745569053 Received: by mail-wm1-f72.google.com with SMTP id 5b1f17b1804b1-43d08915f61so9969325e9.2 for ; Fri, 25 Apr 2025 01:17:33 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1745569053; x=1746173853; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=evDGoI+/XQeXjHcfAaTzbc2xRRT2bYWbObPQgXY7yUk=; b=IFhZ6rodk6DUpU0feAj/8oeuLj3lvN31KJUirq3rjG0ZWNBzAhT6TR9C4eG6GWQQLI EG1YyodMVmO4lVpGC3M3wUidOAWZv+ar8HE8kK/D3YO8B9s+i+W8JIFHwCRaHjqnj1Ee 3I3rC81nSzIyeYPCU24CASlI2AurB9640gMowo4Vtj8Je+m4bJdtQBtUEkTqpL41KB2U 4pDoap/xI8LlJiVf4jHXHF5Zw6alovhC2kho+hOhQ9QDp9Ubm2u2Vy6BuQLTg/h4mn15 W+rCL7G6IKIEG2iJ3S9mnhPaWojU17p7Tkg6nlwy1eb7YA3He/J1EDJXg0TDpcdrGvl5 UiCQ== X-Gm-Message-State: AOJu0YzMbg0IBpx75RbA1jpPdEQYsifcCQcVHfrAxMe4kTBQt5yuoAiy kmhqfsqi/INcqhgycLZNohKUYCflY5kZzH0qEZC9jcsyiDvFkaeYaypUdpR7YULgH/QgSJTxIxT FrJcOLTeU7PRA88Q9AWJV+u8tsU+ShetJIoGbjISaRKnfqm7l X-Gm-Gg: ASbGnctTCpevi57AxZDnMlYZ2YRDZy75azfotQPLNrSlePQG3uJTD4LMf29fXu7Ry8t WWVUMTgbZ77iK0TuTitIRC0NsO7d3dP6E46eQu/f5QCFZDd5yTnnyprV9YmSgamrykFzCw0/p8v D2Sm89slAoAMV3lMs4lMJ2EkyZkznKY4fFDJziZSCNQ6WF5HLadtMZkg//qJSwdbyu/IWpnHVKd ifaSi5vU2tsuCI6CAwbvBbNmmrnCGGp8L8kdNrtxJ2OuTTpBVpV/B2Cd7O6BflE7OcOLDKhxron qhui73sQ8Ssvug4A3jyIZvUbB79d1DziPaKnZbVYRj51Xeu6Fn+eUb7fF/sxX2+O2KC3YXI= X-Received: by 2002:a05:600c:198f:b0:43d:160:cd97 with SMTP id 5b1f17b1804b1-440a669ae6dmr9331315e9.25.1745569052599; Fri, 25 Apr 2025 01:17:32 -0700 (PDT) X-Google-Smtp-Source: AGHT+IFLU3fxIlqe9QX0QeLDRedHwb9sZfQbAe1nE7pImM0iT/BFkLTcKeXBBqkMmeCWWs62lN1KYQ== X-Received: by 2002:a05:600c:198f:b0:43d:160:cd97 with SMTP id 5b1f17b1804b1-440a669ae6dmr9330695e9.25.1745569051957; Fri, 25 Apr 2025 01:17:31 -0700 (PDT) Received: from localhost (p200300cbc70f69006c5680f80c146d2a.dip0.t-ipconnect.de. [2003:cb:c70f:6900:6c56:80f8:c14:6d2a]) by smtp.gmail.com with UTF8SMTPSA id 5b1f17b1804b1-4409d29b990sm51033025e9.4.2025.04.25.01.17.30 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 25 Apr 2025 01:17:31 -0700 (PDT) From: David Hildenbrand To: linux-kernel@vger.kernel.org Cc: linux-mm@kvack.org, x86@kernel.org, intel-gfx@lists.freedesktop.org, dri-devel@lists.freedesktop.org, linux-trace-kernel@vger.kernel.org, David Hildenbrand , Dave Hansen , Andy Lutomirski , Peter Zijlstra , Thomas Gleixner , Ingo Molnar , Borislav Petkov , "H. Peter Anvin" , Jani Nikula , Joonas Lahtinen , Rodrigo Vivi , Tvrtko Ursulin , David Airlie , Simona Vetter , Andrew Morton , Steven Rostedt , Masami Hiramatsu , Mathieu Desnoyers , "Liam R. Howlett" , Lorenzo Stoakes , Vlastimil Babka , Jann Horn , Pedro Falcato , Peter Xu Subject: [PATCH v1 06/11] x86/mm/pat: remove old pfnmap tracking interface Date: Fri, 25 Apr 2025 10:17:10 +0200 Message-ID: <20250425081715.1341199-7-david@redhat.com> X-Mailer: git-send-email 2.49.0 In-Reply-To: <20250425081715.1341199-1-david@redhat.com> References: <20250425081715.1341199-1-david@redhat.com> MIME-Version: 1.0 X-Mimecast-Spam-Score: 0 X-Mimecast-MFC-PROC-ID: msj0COwob8WMXQkzXrYe4LW4OVemH6YaWa7KGqoUzI0_1745569053 X-Mimecast-Originator: redhat.com Content-Transfer-Encoding: 8bit content-type: text/plain; charset="US-ASCII"; x-default=true X-Rspamd-Server: rspam12 X-Rspamd-Queue-Id: CC383180007 X-Rspam-User: X-Stat-Signature: brg7zi9b5p8y1qt3wz35nnfzrqrim78s X-HE-Tag: 1745569055-921785 X-HE-Meta: U2FsdGVkX1/bm8u3P0uBYzxYnKtM1F71SEHp4F+HM+TTDms2vPsPRWv38YPncaFtd3h3D0o3KBqJBEicANeyWyT+hjIC7R+qIpQfmDONCjjAVptpV0yXzbpTuY7N/FrSALO2tbI4RBaOuppR/nY7jotoU2UJvhdv7QTqC/gDtWFub+ho7pNJ36ciABGLrCSoBERoWj9bpRcbjeUAxI2KIf6HcJDx4mDnv4ZMDU09xeLXH7LAu+nLfIbfpcNSAPUMUZSdWJsk0JTcFcD8lsMC8aJ4v8m1aJADJhetRgPrBp0GfONSx4RmWE6YbWqRwgDcrkoh5y+ZlQvdPH3Wyj9snNe23wjsCgQ+oNLHURNEMKDyTWjH/BcL9idxPpN84dgL1gy2SbBEhPIxU52DxnAlXfV3evSDp+mOUplYWHbZR7TUz1lnJWb1sf78XB9skSiSoCImnxyZlyx9nHBiAlZiRMP2LqLs5n5cPtrcaaPv9wtJrsUnK0fFeXgA+MTFTU6t19bzytgsgm8fGRwDMKo3O4aDCgRcea8I4wrqT1k7j3CT7oAeryeoYC/k6v9fXCDhySk3IfbRxtr+/q3kGMXTTc0W+aQdNEW3+sgEvBb/H2cjkIO8l4JpamckNFxHVGJPApFRTPzw0ABzDdtRMPTPxcihIxn8/3maIHsO3yh6DgYhvpVeWTb6FN8bRQYn+LBS2qZFgxdu0Tz1LNbdF+VYJ6ra3C504O75dsWTcijI+yUQIkBdbFMBEV+vXrziw7Sw/Y60dRimGIt/NKQnIRMO17JhGpidTSPGJRPln0IBLvpeQGsWAv2fpSAwjujqrt61kAOO8S1J58dLq0lu1RpNeoYkz6FFBC/Bw6bQ060//meRgmgykGqZCSvZzyXpifjMTuv2qdX663kOUGMHFW9US9eIosSj0hQc17eH2OPBN1MPAaV7E2AyD+pGzKOq2AvRddasSHB+N5q3IHe2Wxh /X+ORzpE /60xxkwIiPsSFPjL2BhTKhKK6qiMt3cIjdiZYAKcFowT0Z/dfK61L3KX+VWBTYZI/pUyPxEhZ5dYeufuq5Le37NnAOXXNjGOXez8wbAOC6MZEPw0TGPOpsFJqesBe9qOUKzVH/nISFDfcQ5tT5CMFDAqFc9AFL46LMDvyCYQWFzZGCyabp7c/cCV83B9q8EUevyEwnWEYwyjuVDnW/M6v499STZn7tHfgvCpQBjSJt3DswZOrsJVt/WC0khC+sy6imbu31EE9WiPw9X6JnO5DGdZ8vYg+i5nlrr6QCHgnkYhX3dDdN3E4X31FaEhEkJW5iWcqhjpkOEzypz1PszKV8m0DFAixXZSStXqRMdKYRd5LaboPbTfvRgKOxyjO3hBpa524r6FTz5+gKRdpnleMU1UEyx7uJ/Kq/y37KI2G/RoNQwBzjZL1E8doTzfwqQ+gJYzOgXu5ZG65ssR8/ZR+zBz8c6O14r4KJrPyMtMFFUG4TG4= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: We can now get rid of the old interface along with get_pat_info() and follow_phys(). Signed-off-by: David Hildenbrand --- arch/x86/mm/pat/memtype.c | 147 -------------------------------------- include/linux/pgtable.h | 66 ----------------- 2 files changed, 213 deletions(-) diff --git a/arch/x86/mm/pat/memtype.c b/arch/x86/mm/pat/memtype.c index c011d8dd8f441..668ebf0065157 100644 --- a/arch/x86/mm/pat/memtype.c +++ b/arch/x86/mm/pat/memtype.c @@ -933,119 +933,6 @@ static void free_pfn_range(u64 paddr, unsigned long size) memtype_free(paddr, paddr + size); } -static int follow_phys(struct vm_area_struct *vma, unsigned long *prot, - resource_size_t *phys) -{ - struct follow_pfnmap_args args = { .vma = vma, .address = vma->vm_start }; - - if (follow_pfnmap_start(&args)) - return -EINVAL; - - /* Never return PFNs of anon folios in COW mappings. */ - if (!args.special) { - follow_pfnmap_end(&args); - return -EINVAL; - } - - *prot = pgprot_val(args.pgprot); - *phys = (resource_size_t)args.pfn << PAGE_SHIFT; - follow_pfnmap_end(&args); - return 0; -} - -static int get_pat_info(struct vm_area_struct *vma, resource_size_t *paddr, - pgprot_t *pgprot) -{ - unsigned long prot; - - VM_WARN_ON_ONCE(!(vma->vm_flags & VM_PAT)); - - /* - * We need the starting PFN and cachemode used for track_pfn_remap() - * that covered the whole VMA. For most mappings, we can obtain that - * information from the page tables. For COW mappings, we might now - * suddenly have anon folios mapped and follow_phys() will fail. - * - * Fallback to using vma->vm_pgoff, see remap_pfn_range_notrack(), to - * detect the PFN. If we need the cachemode as well, we're out of luck - * for now and have to fail fork(). - */ - if (!follow_phys(vma, &prot, paddr)) { - if (pgprot) - *pgprot = __pgprot(prot); - return 0; - } - if (is_cow_mapping(vma->vm_flags)) { - if (pgprot) - return -EINVAL; - *paddr = (resource_size_t)vma->vm_pgoff << PAGE_SHIFT; - return 0; - } - WARN_ON_ONCE(1); - return -EINVAL; -} - -int track_pfn_copy(struct vm_area_struct *dst_vma, - struct vm_area_struct *src_vma, unsigned long *pfn) -{ - const unsigned long vma_size = src_vma->vm_end - src_vma->vm_start; - resource_size_t paddr; - pgprot_t pgprot; - int rc; - - if (!(src_vma->vm_flags & VM_PAT)) - return 0; - - /* - * Duplicate the PAT information for the dst VMA based on the src - * VMA. - */ - if (get_pat_info(src_vma, &paddr, &pgprot)) - return -EINVAL; - rc = reserve_pfn_range(paddr, vma_size, &pgprot, 1); - if (rc) - return rc; - - /* Reservation for the destination VMA succeeded. */ - vm_flags_set(dst_vma, VM_PAT); - *pfn = PHYS_PFN(paddr); - return 0; -} - -void untrack_pfn_copy(struct vm_area_struct *dst_vma, unsigned long pfn) -{ - untrack_pfn(dst_vma, pfn, dst_vma->vm_end - dst_vma->vm_start, true); - /* - * Reservation was freed, any copied page tables will get cleaned - * up later, but without getting PAT involved again. - */ -} - -/* - * prot is passed in as a parameter for the new mapping. If the vma has - * a linear pfn mapping for the entire range, or no vma is provided, - * reserve the entire pfn + size range with single reserve_pfn_range - * call. - */ -int track_pfn_remap(struct vm_area_struct *vma, pgprot_t *prot, - unsigned long pfn, unsigned long addr, unsigned long size) -{ - resource_size_t paddr = (resource_size_t)pfn << PAGE_SHIFT; - - /* reserve the whole chunk starting from paddr */ - if (!vma || (addr == vma->vm_start - && size == (vma->vm_end - vma->vm_start))) { - int ret; - - ret = reserve_pfn_range(paddr, size, prot, 0); - if (ret == 0 && vma) - vm_flags_set(vma, VM_PAT); - return ret; - } - - return pfnmap_sanitize_pgprot(pfn, size, prot); -} - int pfnmap_sanitize_pgprot(unsigned long pfn, unsigned long size, pgprot_t *prot) { resource_size_t paddr = (resource_size_t)pfn << PAGE_SHIFT; @@ -1082,40 +969,6 @@ void pfnmap_untrack(unsigned long pfn, unsigned long size) free_pfn_range(paddr, size); } -/* - * untrack_pfn is called while unmapping a pfnmap for a region. - * untrack can be called for a specific region indicated by pfn and size or - * can be for the entire vma (in which case pfn, size are zero). - */ -void untrack_pfn(struct vm_area_struct *vma, unsigned long pfn, - unsigned long size, bool mm_wr_locked) -{ - resource_size_t paddr; - - if (vma && !(vma->vm_flags & VM_PAT)) - return; - - /* free the chunk starting from pfn or the whole chunk */ - paddr = (resource_size_t)pfn << PAGE_SHIFT; - if (!paddr && !size) { - if (get_pat_info(vma, &paddr, NULL)) - return; - size = vma->vm_end - vma->vm_start; - } - free_pfn_range(paddr, size); - if (vma) { - if (mm_wr_locked) - vm_flags_clear(vma, VM_PAT); - else - __vm_flags_mod(vma, 0, VM_PAT); - } -} - -void untrack_pfn_clear(struct vm_area_struct *vma) -{ - vm_flags_clear(vma, VM_PAT); -} - pgprot_t pgprot_writecombine(pgprot_t prot) { pgprot_set_cachemode(&prot, _PAGE_CACHE_MODE_WC); diff --git a/include/linux/pgtable.h b/include/linux/pgtable.h index 898a3ab195578..0ffc6b9339182 100644 --- a/include/linux/pgtable.h +++ b/include/linux/pgtable.h @@ -1489,17 +1489,6 @@ static inline pmd_t pmd_swp_clear_soft_dirty(pmd_t pmd) * vmf_insert_pfn. */ -/* - * track_pfn_remap is called when a _new_ pfn mapping is being established - * by remap_pfn_range() for physical range indicated by pfn and size. - */ -static inline int track_pfn_remap(struct vm_area_struct *vma, pgprot_t *prot, - unsigned long pfn, unsigned long addr, - unsigned long size) -{ - return 0; -} - static inline int pfnmap_sanitize_pgprot(unsigned long pfn, unsigned long size, pgprot_t *prot) { @@ -1515,55 +1504,7 @@ static inline int pfnmap_track(unsigned long pfn, unsigned long size, static inline void pfnmap_untrack(unsigned long pfn, unsigned long size) { } - -/* - * track_pfn_copy is called when a VM_PFNMAP VMA is about to get the page - * tables copied during copy_page_range(). Will store the pfn to be - * passed to untrack_pfn_copy() only if there is something to be untracked. - * Callers should initialize the pfn to 0. - */ -static inline int track_pfn_copy(struct vm_area_struct *dst_vma, - struct vm_area_struct *src_vma, unsigned long *pfn) -{ - return 0; -} - -/* - * untrack_pfn_copy is called when a VM_PFNMAP VMA failed to copy during - * copy_page_range(), but after track_pfn_copy() was already called. Can - * be called even if track_pfn_copy() did not actually track anything: - * handled internally. - */ -static inline void untrack_pfn_copy(struct vm_area_struct *dst_vma, - unsigned long pfn) -{ -} - -/* - * untrack_pfn is called while unmapping a pfnmap for a region. - * untrack can be called for a specific region indicated by pfn and size or - * can be for the entire vma (in which case pfn, size are zero). - */ -static inline void untrack_pfn(struct vm_area_struct *vma, - unsigned long pfn, unsigned long size, - bool mm_wr_locked) -{ -} - -/* - * untrack_pfn_clear is called in the following cases on a VM_PFNMAP VMA: - * - * 1) During mremap() on the src VMA after the page tables were moved. - * 2) During fork() on the dst VMA, immediately after duplicating the src VMA. - */ -static inline void untrack_pfn_clear(struct vm_area_struct *vma) -{ -} #else -extern int track_pfn_remap(struct vm_area_struct *vma, pgprot_t *prot, - unsigned long pfn, unsigned long addr, - unsigned long size); - /** * pfnmap_sanitize_pgprot - sanitize the pgprot for a pfn range * @pfn: the start of the pfn range @@ -1603,13 +1544,6 @@ int pfnmap_track(unsigned long pfn, unsigned long size, pgprot_t *prot); * un-doing any reservation. */ void pfnmap_untrack(unsigned long pfn, unsigned long size); -extern int track_pfn_copy(struct vm_area_struct *dst_vma, - struct vm_area_struct *src_vma, unsigned long *pfn); -extern void untrack_pfn_copy(struct vm_area_struct *dst_vma, - unsigned long pfn); -extern void untrack_pfn(struct vm_area_struct *vma, unsigned long pfn, - unsigned long size, bool mm_wr_locked); -extern void untrack_pfn_clear(struct vm_area_struct *vma); #endif #ifdef CONFIG_MMU -- 2.49.0