From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id DD35ED37E33 for ; Wed, 14 Jan 2026 13:45:47 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 38E476B0096; Wed, 14 Jan 2026 08:45:47 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 36ED96B0099; Wed, 14 Jan 2026 08:45:47 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 23AA86B009D; Wed, 14 Jan 2026 08:45:47 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 11FFD6B0096 for ; Wed, 14 Jan 2026 08:45:47 -0500 (EST) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id AD26B1A050C for ; Wed, 14 Jan 2026 13:45:46 +0000 (UTC) X-FDA: 84330692292.11.7B0B297 Received: from fra-out-001.esa.eu-central-1.outbound.mail-perimeter.amazon.com (fra-out-001.esa.eu-central-1.outbound.mail-perimeter.amazon.com [18.156.205.64]) by imf21.hostedemail.com (Postfix) with ESMTP id 10AB61C0006 for ; Wed, 14 Jan 2026 13:45:43 +0000 (UTC) Authentication-Results: imf21.hostedemail.com; dkim=pass header.d=amazon.co.uk header.s=amazoncorp2 header.b=OkEHKgf+; spf=pass (imf21.hostedemail.com: domain of "prvs=4674f03ca=kalyazin@amazon.co.uk" designates 18.156.205.64 as permitted sender) smtp.mailfrom="prvs=4674f03ca=kalyazin@amazon.co.uk"; dmarc=pass (policy=quarantine) header.from=amazon.co.uk ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1768398344; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=DwK9FSlwBQuU4XKtXrxQXwU9sl3B3N2UH+rK7uUp150=; b=1GA2KFkqAktJR3dXvcjmvPVfw/Q+BILpSImT7LnhFo/6fhV1MfqvojtIA/wiXOHU3FoSDl J68VID65zxGtPPQhO4EcZiM89xmRRXEoDjW3+ihULclP7+I1OS/YPjo7+XvlgVx/O8BswQ WgytcwabtLtbcVV0EhU2ZzZIJMbdAE4= ARC-Authentication-Results: i=1; imf21.hostedemail.com; dkim=pass header.d=amazon.co.uk header.s=amazoncorp2 header.b=OkEHKgf+; spf=pass (imf21.hostedemail.com: domain of "prvs=4674f03ca=kalyazin@amazon.co.uk" designates 18.156.205.64 as permitted sender) smtp.mailfrom="prvs=4674f03ca=kalyazin@amazon.co.uk"; dmarc=pass (policy=quarantine) header.from=amazon.co.uk ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1768398344; a=rsa-sha256; cv=none; b=u6I6/VOr+UtyqJH8h527LFHBNzPyBf2MRSJmSxq36U4Ubt9rtolKeN74Bt0HWAjolXAGgH F0oZ+0anLsNZ+U0lkx39dBx6cbNc6y+Y963kYe/vIXQBD5Lu6LBUwxlNRY1Jtbd0qeCJR/ qW9VGItLTypDD7atGtupjGJupG+GklY= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.co.uk; i=@amazon.co.uk; q=dns/txt; s=amazoncorp2; t=1768398344; x=1799934344; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=DwK9FSlwBQuU4XKtXrxQXwU9sl3B3N2UH+rK7uUp150=; b=OkEHKgf+pYTCJ36ILEWb6LfGyiDI7IQZVmWAjy2XYcKYVNvhzfHqbzQv RIOlePkmwfChfWpsIskfC4aXwnUhXG6KrNrzQWJXT4VO7FaNfi2vTjNtt nVcH0z3/dXKg7dFJCvkGb+maNdAq+S8o/Ph0OhubUH7Rx0srpBGegymHg vdNx+Qmc9bmOQBboBsq0ueDpHo5K8E24Xj1kn+hV6g2EkPOysrBXhkJvB Q5P+hBEHGFmeHI4f6nwtDW89h3XjrJnrQ5yV7ao/cIcfMn6UjiH0XIvt5 PrsI7AjLUJspz/9s0l3yhTDeJUgIIA+IQGQ4CR1mg/iOTAb+gzhGB60AB Q==; X-CSE-ConnectionGUID: ADRkyAvURkCXCw3a2Bdf2g== X-CSE-MsgGUID: EjV5CGptQgi+UwaC8hUurA== X-IronPort-AV: E=Sophos;i="6.21,225,1763424000"; d="scan'208";a="7586296" Received: from ip-10-6-11-83.eu-central-1.compute.internal (HELO smtpout.naws.eu-central-1.prod.farcaster.email.amazon.dev) ([10.6.11.83]) by internal-fra-out-001.esa.eu-central-1.outbound.mail-perimeter.amazon.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 14 Jan 2026 13:45:25 +0000 Received: from EX19MTAEUB002.ant.amazon.com [54.240.197.232:28749] by smtpin.naws.eu-central-1.prod.farcaster.email.amazon.dev [10.0.28.56:2525] with esmtp (Farcaster) id 5afb6478-7936-4852-84d5-bdcc3b7d5c5a; Wed, 14 Jan 2026 13:45:25 +0000 (UTC) X-Farcaster-Flow-ID: 5afb6478-7936-4852-84d5-bdcc3b7d5c5a Received: from EX19D005EUB001.ant.amazon.com (10.252.51.12) by EX19MTAEUB002.ant.amazon.com (10.252.51.59) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA) id 15.2.2562.35; Wed, 14 Jan 2026 13:45:24 +0000 Received: from EX19D005EUB003.ant.amazon.com (10.252.51.31) by EX19D005EUB001.ant.amazon.com (10.252.51.12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA) id 15.2.2562.35; Wed, 14 Jan 2026 13:45:23 +0000 Received: from EX19D005EUB003.ant.amazon.com ([fe80::b825:becb:4b38:da0c]) by EX19D005EUB003.ant.amazon.com ([fe80::b825:becb:4b38:da0c%3]) with mapi id 15.02.2562.035; Wed, 14 Jan 2026 13:45:23 +0000 From: "Kalyazin, Nikita" To: "kvm@vger.kernel.org" , "linux-doc@vger.kernel.org" , "linux-kernel@vger.kernel.org" , "linux-arm-kernel@lists.infradead.org" , "kvmarm@lists.linux.dev" , "linux-fsdevel@vger.kernel.org" , "linux-mm@kvack.org" , "bpf@vger.kernel.org" , "linux-kselftest@vger.kernel.org" , "kernel@xen0n.name" , "linux-riscv@lists.infradead.org" , "linux-s390@vger.kernel.org" , "loongarch@lists.linux.dev" CC: "pbonzini@redhat.com" , "corbet@lwn.net" , "maz@kernel.org" , "oupton@kernel.org" , "joey.gouly@arm.com" , "suzuki.poulose@arm.com" , "yuzenghui@huawei.com" , "catalin.marinas@arm.com" , "will@kernel.org" , "seanjc@google.com" , "tglx@linutronix.de" , "mingo@redhat.com" , "bp@alien8.de" , "dave.hansen@linux.intel.com" , "x86@kernel.org" , "hpa@zytor.com" , "luto@kernel.org" , "peterz@infradead.org" , "willy@infradead.org" , "akpm@linux-foundation.org" , "david@kernel.org" , "lorenzo.stoakes@oracle.com" , "Liam.Howlett@oracle.com" , "vbabka@suse.cz" , "rppt@kernel.org" , "surenb@google.com" , "mhocko@suse.com" , "ast@kernel.org" , "daniel@iogearbox.net" , "andrii@kernel.org" , "martin.lau@linux.dev" , "eddyz87@gmail.com" , "song@kernel.org" , "yonghong.song@linux.dev" , "john.fastabend@gmail.com" , "kpsingh@kernel.org" , "sdf@fomichev.me" , "haoluo@google.com" , "jolsa@kernel.org" , "jgg@ziepe.ca" , "jhubbard@nvidia.com" , "peterx@redhat.com" , "jannh@google.com" , "pfalcato@suse.de" , "shuah@kernel.org" , "riel@surriel.com" , "ryan.roberts@arm.com" , "jgross@suse.com" , "yu-cheng.yu@intel.com" , "kas@kernel.org" , "coxu@redhat.com" , "kevin.brodsky@arm.com" , "ackerleytng@google.com" , "maobibo@loongson.cn" , "prsampat@amd.com" , "mlevitsk@redhat.com" , "jmattson@google.com" , "jthoughton@google.com" , "agordeev@linux.ibm.com" , "alex@ghiti.fr" , "aou@eecs.berkeley.edu" , "borntraeger@linux.ibm.com" , "chenhuacai@kernel.org" , "dev.jain@arm.com" , "gor@linux.ibm.com" , "hca@linux.ibm.com" , "Jonathan.Cameron@huawei.com" , "palmer@dabbelt.com" , "pjw@kernel.org" , "shijie@os.amperecomputing.com" , "svens@linux.ibm.com" , "thuth@redhat.com" , "wyihan@google.com" , "yang@os.amperecomputing.com" , "vannapurve@google.com" , "jackmanb@google.com" , "aneesh.kumar@kernel.org" , "patrick.roy@linux.dev" , "Thomson, Jack" , "Itazuri, Takahiro" , "Manwaring, Derek" , "Cali, Marco" , "Kalyazin, Nikita" Subject: [PATCH v9 01/13] set_memory: add folio_{zap,restore}_direct_map helpers Thread-Topic: [PATCH v9 01/13] set_memory: add folio_{zap,restore}_direct_map helpers Thread-Index: AQHchVwI418o+7jue0CuccMT4sV6lg== Date: Wed, 14 Jan 2026 13:45:23 +0000 Message-ID: <20260114134510.1835-2-kalyazin@amazon.com> References: <20260114134510.1835-1-kalyazin@amazon.com> In-Reply-To: <20260114134510.1835-1-kalyazin@amazon.com> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.19.103.116] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Rspamd-Queue-Id: 10AB61C0006 X-Stat-Signature: 3tgoscenfexjqdzjeimhy8qwntpwurg3 X-Rspam-User: X-Rspamd-Server: rspam05 X-HE-Tag: 1768398343-858940 X-HE-Meta: U2FsdGVkX1/gba8XHjmFidyvONziYINaldiS/g5E7n/s+saaIlkKRO0xrqFZU8EglOVNKtIUNvQlaylgwySwXHeVlNUmFK2WQlGVqLFh6zrK0htR4oGDfwfp0qrtKtvP1Ei22uPNfXvRdWP9wvLvgWq+c8ppPl1RwQS6yJkR4fdBwoBDqOk7uCTH2hsElAgpaidq9HbvkIGi+qZ5d8hP5p+qOGd/u9TRuwVn3NhpS1yBnlz6wb3Yho98jpA+jAJ8XNjOaVjPNcVM4LtDAlDlVPx0fPprpeJutZzaF2Dxd1IVT9WqTrkkQuQwv7Qwwvz+ngVrkDUIDx3bmSBcY+UKtr+3fXv5yk3DI4lBcEFSFNghtlXSZBcjSCm+dcxyCiOcWW+U50nNF5VJOSegoTLYIKJNAQV2K2exdT4y8917Ove4x+fWXz6o5Vq64wyqTZus3JbULe8HXE0H1kAeyyLtA6Mvovra0keG/SEkPZVBf28dRfnOnPiZJKEdOkrKI5X5wWQo36EB23aKsbmQ+WfTp2KaycCIwRtuiaWo0MycJW0pdnYcTVVGmNlxzYfzAbaHv6pd+vqx2vEhTIdocirG3AYyENpcz04wj9pvQ91ETOA/vo8s2n+9bRGkrt9RQaPNyE50gQSEz33hTuIr2LnFWw86mpJvmoc5Hjs0pELxAPc6L6QfjkzWCFqvYEZrsCn3fZTjtKPThDRoC2z2CrHEFYW5Qg50D9MhI7ZYeJwDphbbk9iCYsgWzzFK0dbgyUTMAF1Lb0qCIsDexX/j7bCgXLWMVecmRHrvlYjrRJtyB6t21TM6gFcYlEgtCuT6YkpYr5i/GiqorAAm2MyWZB1Q6BXmBmaVM+P9yJNBEceQx2huVVDlZo6ag5ny2Hm5hm32xYzBJfMjeK7VYh/VHOWb/LU79DKNtBSwzB4ZwQH2hB2MG8hqj3gtisFC3MsOphi4SciUg4Fo7YLKcm0JbcQ 8AtpE0Wj nouLXoLUyVre+TuZEpnT97lP8g+A6u6e0HvunAZGj74p1juttqpZ1IOh/SZFIw+iDv2HAvu4XxcluWmBV48EU9kNd63YXIopyFHABQg4Ctv35DGe6N3Ll5Ga36sX6BYD1pvABNL1hcZYl15xoHk7zJL79XDzy2/wYmticsID6/5s9Rsp6xXVmjRbgugEWzoS450En+yioF/hfMbU6JNC7kPTRh43HhY3281xvZPFR3lRZX2B8L6bcIA4qU8fhlAPXFJkV6+nP6obDajqiGVXpizBsmczKxLWMCulxWdNCcE5CqjCyjlh8iyKSiJTk6uGivDTIx/qWclZpDqQ3BgJ3+ryf3fOwNLMO+eZwUV//WETuHUivBlPtQu5AkJkda+AQlmUuY3CYhZiRXX03WqTxwfTALr+FKvLz0PybPFYiyPVJMzyAVhT7DFauTY4xI28aaOi360AjKA9Zy+dxyv/R25jV7nakyuqOgU4EABxwsoLYzw5uJlXxbIiVzz0yB46IOUsC9yoas7ZBx9skzoOtsU4o6J5hABCTVwsma+pJ6LK+cpUgxtQu9GNKabpTscfqm0XRx4eA0e9xE4+bbBA0YTmkbd32jbCU+0tZZDWNR+mmtWtsEOeb9heNLAsLtoSi0BIXE6j2FtY8WkZ/ggt2FaELhF0hsDqTYbaPCyxK8uFEpdgGaSxnt74azTxIjc3gJA7MBDupsuDkGh4SP/6k3ogO+bLUrhBBWMCYDC14u9ij8QgDBj1PkmH6u+Ln9GKfAwmufdK3lQzZGdQ= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Nikita Kalyazin =0A= =0A= These allow guest_memfd to remove its memory from the direct map.=0A= Only implement them for architectures that have direct map.=0A= In folio_zap_direct_map(), flush TLB on architectures where=0A= set_direct_map_valid_noflush() does not flush it internally.=0A= =0A= The new helpers need to be accessible to KVM on architectures that=0A= support guest_memfd (x86 and arm64). Since arm64 does not support=0A= building KVM as a module, only export them on x86.=0A= =0A= Direct map removal gives guest_memfd the same protection that=0A= memfd_secret does, such as hardening against Spectre-like attacks=0A= through in-kernel gadgets.=0A= =0A= Signed-off-by: Nikita Kalyazin =0A= ---=0A= arch/arm64/include/asm/set_memory.h | 2 ++=0A= arch/arm64/mm/pageattr.c | 12 ++++++++++++=0A= arch/loongarch/include/asm/set_memory.h | 2 ++=0A= arch/loongarch/mm/pageattr.c | 16 ++++++++++++++++=0A= arch/riscv/include/asm/set_memory.h | 2 ++=0A= arch/riscv/mm/pageattr.c | 16 ++++++++++++++++=0A= arch/s390/include/asm/set_memory.h | 2 ++=0A= arch/s390/mm/pageattr.c | 18 ++++++++++++++++++=0A= arch/x86/include/asm/set_memory.h | 2 ++=0A= arch/x86/mm/pat/set_memory.c | 20 ++++++++++++++++++++=0A= include/linux/set_memory.h | 10 ++++++++++=0A= 11 files changed, 102 insertions(+)=0A= =0A= diff --git a/arch/arm64/include/asm/set_memory.h b/arch/arm64/include/asm/s= et_memory.h=0A= index 90f61b17275e..d949f1deb701 100644=0A= --- a/arch/arm64/include/asm/set_memory.h=0A= +++ b/arch/arm64/include/asm/set_memory.h=0A= @@ -14,6 +14,8 @@ int set_memory_valid(unsigned long addr, int numpages, in= t enable);=0A= int set_direct_map_invalid_noflush(struct page *page);=0A= int set_direct_map_default_noflush(struct page *page);=0A= int set_direct_map_valid_noflush(struct page *page, unsigned nr, bool vali= d);=0A= +int folio_zap_direct_map(struct folio *folio);=0A= +int folio_restore_direct_map(struct folio *folio);=0A= bool kernel_page_present(struct page *page);=0A= =0A= int set_memory_encrypted(unsigned long addr, int numpages);=0A= diff --git a/arch/arm64/mm/pageattr.c b/arch/arm64/mm/pageattr.c=0A= index f0e784b963e6..a94eff324dda 100644=0A= --- a/arch/arm64/mm/pageattr.c=0A= +++ b/arch/arm64/mm/pageattr.c=0A= @@ -357,6 +357,18 @@ int set_direct_map_valid_noflush(struct page *page, un= signed nr, bool valid)=0A= return set_memory_valid(addr, nr, valid);=0A= }=0A= =0A= +int folio_zap_direct_map(struct folio *folio)=0A= +{=0A= + return set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), false);=0A= +}=0A= +=0A= +int folio_restore_direct_map(struct folio *folio)=0A= +{=0A= + return set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), true);=0A= +}=0A= +=0A= #ifdef CONFIG_DEBUG_PAGEALLOC=0A= /*=0A= * This is - apart from the return value - doing the same=0A= diff --git a/arch/loongarch/include/asm/set_memory.h b/arch/loongarch/inclu= de/asm/set_memory.h=0A= index 55dfaefd02c8..9bc80ac420a9 100644=0A= --- a/arch/loongarch/include/asm/set_memory.h=0A= +++ b/arch/loongarch/include/asm/set_memory.h=0A= @@ -18,5 +18,7 @@ bool kernel_page_present(struct page *page);=0A= int set_direct_map_default_noflush(struct page *page);=0A= int set_direct_map_invalid_noflush(struct page *page);=0A= int set_direct_map_valid_noflush(struct page *page, unsigned nr, bool vali= d);=0A= +int folio_zap_direct_map(struct folio *folio);=0A= +int folio_restore_direct_map(struct folio *folio);=0A= =0A= #endif /* _ASM_LOONGARCH_SET_MEMORY_H */=0A= diff --git a/arch/loongarch/mm/pageattr.c b/arch/loongarch/mm/pageattr.c=0A= index f5e910b68229..14bd322dd112 100644=0A= --- a/arch/loongarch/mm/pageattr.c=0A= +++ b/arch/loongarch/mm/pageattr.c=0A= @@ -236,3 +236,19 @@ int set_direct_map_valid_noflush(struct page *page, un= signed nr, bool valid)=0A= =0A= return __set_memory(addr, 1, set, clear);=0A= }=0A= +=0A= +int folio_zap_direct_map(struct folio *folio)=0A= +{=0A= + int ret;=0A= +=0A= + ret =3D set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), false);=0A= +=0A= + return ret;=0A= +}=0A= +=0A= +int folio_restore_direct_map(struct folio *folio)=0A= +{=0A= + return set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), true);=0A= +}=0A= diff --git a/arch/riscv/include/asm/set_memory.h b/arch/riscv/include/asm/s= et_memory.h=0A= index 87389e93325a..16557b70c830 100644=0A= --- a/arch/riscv/include/asm/set_memory.h=0A= +++ b/arch/riscv/include/asm/set_memory.h=0A= @@ -43,6 +43,8 @@ static inline int set_kernel_memory(char *startp, char *e= ndp,=0A= int set_direct_map_invalid_noflush(struct page *page);=0A= int set_direct_map_default_noflush(struct page *page);=0A= int set_direct_map_valid_noflush(struct page *page, unsigned nr, bool vali= d);=0A= +int folio_zap_direct_map(struct folio *folio);=0A= +int folio_restore_direct_map(struct folio *folio);=0A= bool kernel_page_present(struct page *page);=0A= =0A= #endif /* __ASSEMBLER__ */=0A= diff --git a/arch/riscv/mm/pageattr.c b/arch/riscv/mm/pageattr.c=0A= index 3f76db3d2769..2c218868114b 100644=0A= --- a/arch/riscv/mm/pageattr.c=0A= +++ b/arch/riscv/mm/pageattr.c=0A= @@ -401,6 +401,22 @@ int set_direct_map_valid_noflush(struct page *page, un= signed nr, bool valid)=0A= return __set_memory((unsigned long)page_address(page), nr, set, clear);= =0A= }=0A= =0A= +int folio_zap_direct_map(struct folio *folio)=0A= +{=0A= + int ret;=0A= +=0A= + ret =3D set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), false);=0A= +=0A= + return ret;=0A= +}=0A= +=0A= +int folio_restore_direct_map(struct folio *folio)=0A= +{=0A= + return set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), true);=0A= +}=0A= +=0A= #ifdef CONFIG_DEBUG_PAGEALLOC=0A= static int debug_pagealloc_set_page(pte_t *pte, unsigned long addr, void *= data)=0A= {=0A= diff --git a/arch/s390/include/asm/set_memory.h b/arch/s390/include/asm/set= _memory.h=0A= index 94092f4ae764..fc73652e5715 100644=0A= --- a/arch/s390/include/asm/set_memory.h=0A= +++ b/arch/s390/include/asm/set_memory.h=0A= @@ -63,6 +63,8 @@ __SET_MEMORY_FUNC(set_memory_4k, SET_MEMORY_4K)=0A= int set_direct_map_invalid_noflush(struct page *page);=0A= int set_direct_map_default_noflush(struct page *page);=0A= int set_direct_map_valid_noflush(struct page *page, unsigned nr, bool vali= d);=0A= +int folio_zap_direct_map(struct folio *folio);=0A= +int folio_restore_direct_map(struct folio *folio);=0A= bool kernel_page_present(struct page *page);=0A= =0A= #endif=0A= diff --git a/arch/s390/mm/pageattr.c b/arch/s390/mm/pageattr.c=0A= index d3ce04a4b248..df4a487b484d 100644=0A= --- a/arch/s390/mm/pageattr.c=0A= +++ b/arch/s390/mm/pageattr.c=0A= @@ -412,6 +412,24 @@ int set_direct_map_valid_noflush(struct page *page, un= signed nr, bool valid)=0A= return __set_memory((unsigned long)page_to_virt(page), nr, flags);=0A= }=0A= =0A= +int folio_zap_direct_map(struct folio *folio)=0A= +{=0A= + unsigned long addr =3D (unsigned long)folio_address(folio);=0A= + int ret;=0A= +=0A= + ret =3D set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), false);=0A= + flush_tlb_kernel_range(addr, addr + folio_size(folio));=0A= +=0A= + return ret;=0A= +}=0A= +=0A= +int folio_restore_direct_map(struct folio *folio)=0A= +{=0A= + return set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), true);=0A= +}=0A= +=0A= bool kernel_page_present(struct page *page)=0A= {=0A= unsigned long addr;=0A= diff --git a/arch/x86/include/asm/set_memory.h b/arch/x86/include/asm/set_m= emory.h=0A= index 61f56cdaccb5..7208af609121 100644=0A= --- a/arch/x86/include/asm/set_memory.h=0A= +++ b/arch/x86/include/asm/set_memory.h=0A= @@ -90,6 +90,8 @@ int set_pages_rw(struct page *page, int numpages);=0A= int set_direct_map_invalid_noflush(struct page *page);=0A= int set_direct_map_default_noflush(struct page *page);=0A= int set_direct_map_valid_noflush(struct page *page, unsigned nr, bool vali= d);=0A= +int folio_zap_direct_map(struct folio *folio);=0A= +int folio_restore_direct_map(struct folio *folio);=0A= bool kernel_page_present(struct page *page);=0A= =0A= extern int kernel_set_to_readonly;=0A= diff --git a/arch/x86/mm/pat/set_memory.c b/arch/x86/mm/pat/set_memory.c=0A= index 6c6eb486f7a6..3f0fc30eb320 100644=0A= --- a/arch/x86/mm/pat/set_memory.c=0A= +++ b/arch/x86/mm/pat/set_memory.c=0A= @@ -2656,6 +2656,26 @@ int set_direct_map_valid_noflush(struct page *page, = unsigned nr, bool valid)=0A= return __set_pages_np(page, nr);=0A= }=0A= =0A= +int folio_zap_direct_map(struct folio *folio)=0A= +{=0A= + unsigned long addr =3D (unsigned long)folio_address(folio);=0A= + int ret;=0A= +=0A= + ret =3D set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), false);=0A= + flush_tlb_kernel_range(addr, addr + folio_size(folio));=0A= +=0A= + return ret;=0A= +}=0A= +EXPORT_SYMBOL_FOR_MODULES(folio_zap_direct_map, "kvm");=0A= +=0A= +int folio_restore_direct_map(struct folio *folio)=0A= +{=0A= + return set_direct_map_valid_noflush(folio_page(folio, 0),=0A= + folio_nr_pages(folio), true);=0A= +}=0A= +EXPORT_SYMBOL_FOR_MODULES(folio_restore_direct_map, "kvm");=0A= +=0A= #ifdef CONFIG_DEBUG_PAGEALLOC=0A= void __kernel_map_pages(struct page *page, int numpages, int enable)=0A= {=0A= diff --git a/include/linux/set_memory.h b/include/linux/set_memory.h=0A= index 3030d9245f5a..8d1c8a7f7d79 100644=0A= --- a/include/linux/set_memory.h=0A= +++ b/include/linux/set_memory.h=0A= @@ -40,6 +40,16 @@ static inline int set_direct_map_valid_noflush(struct pa= ge *page,=0A= return 0;=0A= }=0A= =0A= +static inline int folio_zap_direct_map(struct folio *folio)=0A= +{=0A= + return 0;=0A= +}=0A= +=0A= +static inline int folio_restore_direct_map(struct folio *folio)=0A= +{=0A= + return 0;=0A= +}=0A= +=0A= static inline bool kernel_page_present(struct page *page)=0A= {=0A= return true;=0A= -- =0A= 2.50.1=0A= =0A=