From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3ADBAC4167B for ; Thu, 14 Dec 2023 05:56:53 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 8CFF86B0472; Thu, 14 Dec 2023 00:56:50 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 7D1076B0551; Thu, 14 Dec 2023 00:56:50 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3DC646B0473; Thu, 14 Dec 2023 00:56:50 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 077C66B0471 for ; Thu, 14 Dec 2023 00:56:50 -0500 (EST) Received: from smtpin07.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id C981F40492 for ; Thu, 14 Dec 2023 05:56:49 +0000 (UTC) X-FDA: 81564364938.07.871B433 Received: from mx0b-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by imf08.hostedemail.com (Postfix) with ESMTP id 8D20D160006 for ; Thu, 14 Dec 2023 05:56:47 +0000 (UTC) Authentication-Results: imf08.hostedemail.com; dkim=pass header.d=ibm.com header.s=pp1 header.b=jPBCCJIq; dmarc=pass (policy=none) header.from=ibm.com; spf=pass (imf08.hostedemail.com: domain of nicholas@linux.ibm.com designates 148.163.158.5 as permitted sender) smtp.mailfrom=nicholas@linux.ibm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1702533407; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=Or+ER3iSwLY+2GcnBysJHFAbWg54QnxrivHZZRWSUlo=; b=kehc7yH3N1AXUj0oZBJQ+zZBdVBt/+aVj6/halXFtSgG4w06EcFyipCRNuu3sggo1h+kHd ksUeDStle8voslk/80u7lQkKbKFmQNV8VcA0ztdufU5dMlyJusyYOz768STSFth7s5KRd/ TDnox5CntPs+Cj7IXDXLPmDdWGaVUhM= ARC-Authentication-Results: i=1; imf08.hostedemail.com; dkim=pass header.d=ibm.com header.s=pp1 header.b=jPBCCJIq; dmarc=pass (policy=none) header.from=ibm.com; spf=pass (imf08.hostedemail.com: domain of nicholas@linux.ibm.com designates 148.163.158.5 as permitted sender) smtp.mailfrom=nicholas@linux.ibm.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1702533407; a=rsa-sha256; cv=none; b=TmkxMMsxNq65K7mMHfGxFSg27KprLLCXJKAOYiUChth/NlNZbtRisi29TYW06kLJEnuvTO yUum51rmWbeRzWj08NVxeSg0HQwsBEpH5EHpV3mM7G7Cmnq200dSgwH0DMHAp2dfiu0uxg Kb5QVpoTqr7RnTQaaoNhnKvm8cooNnk= Received: from pps.filterd (m0353725.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 3BE5bkhT003442; Thu, 14 Dec 2023 05:56:41 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-transfer-encoding; s=pp1; bh=Or+ER3iSwLY+2GcnBysJHFAbWg54QnxrivHZZRWSUlo=; b=jPBCCJIq3GKGrIuMP1yn436SePKJpby26k22ilj2Zem4QVli3eQCXD+/wL1bjAOD1iuJ /FZtdWsm7ipjuytRcepQOR1cQXIRTw3R6XshoDZQbbrMErpEkwAwJybCndj1K544Yg25 hq1zYmXU2FZ70rTaisY9r79SKKj32xliME3keJfd4RILx2JlFn6DWkOnvsx4oqAnlI3Z FLh87rcb7Y5C9OUm5eFP+TfQRbo+BTby94YosokRO49Hij6k/J8r461vUgCrpGWYxL/9 rIyYoy6VBsqO1l7ojZyS8F+AiRjyaA6xdhYF+9W+WdGUwSwls8UJ4ltppIgHzDPjmNV9 1A== Received: from pps.reinject (localhost [127.0.0.1]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3uyuqp0av5-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 14 Dec 2023 05:56:40 +0000 Received: from m0353725.ppops.net (m0353725.ppops.net [127.0.0.1]) by pps.reinject (8.17.1.5/8.17.1.5) with ESMTP id 3BE5rRSq022695; Thu, 14 Dec 2023 05:56:39 GMT Received: from ppma12.dal12v.mail.ibm.com (dc.9e.1632.ip4.static.sl-reverse.com [50.22.158.220]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3uyuqp0asc-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 14 Dec 2023 05:56:39 +0000 Received: from pps.filterd (ppma12.dal12v.mail.ibm.com [127.0.0.1]) by ppma12.dal12v.mail.ibm.com (8.17.1.19/8.17.1.19) with ESMTP id 3BE3jVip008467; Thu, 14 Dec 2023 05:56:26 GMT Received: from smtprelay04.fra02v.mail.ibm.com ([9.218.2.228]) by ppma12.dal12v.mail.ibm.com (PPS) with ESMTPS id 3uw2jtpnfx-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 14 Dec 2023 05:56:26 +0000 Received: from smtpav06.fra02v.mail.ibm.com (smtpav06.fra02v.mail.ibm.com [10.20.54.105]) by smtprelay04.fra02v.mail.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 3BE5uO5O46727664 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 14 Dec 2023 05:56:25 GMT Received: from smtpav06.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id D30272004D; Thu, 14 Dec 2023 05:56:24 +0000 (GMT) Received: from smtpav06.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id E42AE20040; Thu, 14 Dec 2023 05:56:23 +0000 (GMT) Received: from ozlabs.au.ibm.com (unknown [9.192.253.14]) by smtpav06.fra02v.mail.ibm.com (Postfix) with ESMTP; Thu, 14 Dec 2023 05:56:23 +0000 (GMT) Received: from nicholasmvm.. (haven.au.ibm.com [9.192.254.114]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ozlabs.au.ibm.com (Postfix) with ESMTPSA id 98F37606F0; Thu, 14 Dec 2023 16:56:19 +1100 (AEDT) From: Nicholas Miehlbradt To: glider@google.com, elver@google.com, dvyukov@google.com, akpm@linux-foundation.org, mpe@ellerman.id.au, npiggin@gmail.com, christophe.leroy@csgroup.eu Cc: linux-mm@kvack.org, kasan-dev@googlegroups.com, iii@linux.ibm.com, linuxppc-dev@lists.ozlabs.org, linux-kernel@vger.kernel.org, Nicholas Miehlbradt Subject: [PATCH 10/13] powerpc: Define KMSAN metadata address ranges for vmalloc and ioremap Date: Thu, 14 Dec 2023 05:55:36 +0000 Message-Id: <20231214055539.9420-11-nicholas@linux.ibm.com> X-Mailer: git-send-email 2.40.1 In-Reply-To: <20231214055539.9420-1-nicholas@linux.ibm.com> References: <20231214055539.9420-1-nicholas@linux.ibm.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-TM-AS-GCONF: 00 X-Proofpoint-ORIG-GUID: BSRtrog9VNVw4H1y8EPLE2_PMzM43F4_ X-Proofpoint-GUID: z-dPmrvTGG-i94A2fIfwubmwfRHh6Qb7 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.272,Aquarius:18.0.997,Hydra:6.0.619,FMLib:17.11.176.26 definitions=2023-12-14_02,2023-12-13_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 clxscore=1015 adultscore=0 mlxlogscore=999 impostorscore=0 phishscore=0 priorityscore=1501 mlxscore=0 lowpriorityscore=0 spamscore=0 suspectscore=0 bulkscore=0 malwarescore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2311290000 definitions=main-2312140035 X-Rspamd-Queue-Id: 8D20D160006 X-Rspam-User: X-Rspamd-Server: rspam04 X-Stat-Signature: zdkhypuppy1ky4ooqn4mk3q5hqorzf5h X-HE-Tag: 1702533407-316136 X-HE-Meta: U2FsdGVkX1/4AGRgST8gKvpdqlB+KdOsHaFAYb91gpPB05Y7EsqoIN+PrhdqvnNUHFe3nQuXOibDIMOPfEJFI7UJzn/wHyOLFxwH71dULBvT/IC/kuMz4r3kFFZ1YBzh2V+BfJjSvb6FLMSoFIED2TZzDAn/BlkjmcqBzb0MnbPNDU1LAn5+xabV6uT4kvnd7TwVi1Xzd6pqG0h5BBJDLtvnUSRLkDK+gshl6OPj2hGdKNfK+9KPjspT+L0Bj0ofrD3+xKU3kT8DSJalD0u7VGngDdSiMLViSgywANDib5SCEsmrPbOOfjmns7jlIYFKhWjQuOoKur3YFFFrFltumF4DBH9n5uGl4aMuO/5P1AYgzN1F/8hM6f9XA0yTHVg9E0NoVSZ4s9LRa+7rXNQDH/dlV8UFhkOgxJG3RhfbRo9/sJ0m0sRs4fqlWxDnsRxb/YAPxYNI6Vov3oB/rj1iYH5ILPG3cmnJpOChxk/8Lut0n0P0vmrsEr+qf+TcKycdfWvEz+eNY1iu9pRRwJGXMbnJFN/x28CGq4aEYE4W7/G5b53spvieuTxyw2TLFrJVDEoLhoi7IFhrcO/ulcEAgSNYtA5lni1ndpU5Sz+jYfO622pzu3Oh8V7liMjWqDmgjOdQ2mxa9NxkJaAfkf5r9qDHTE6DJWJ8StQxVm0uchJp3Z66CuDxY2/gQi5XYRluy3Py1vmAdUzJUFUzXY1gZuz75ui3LZ2uWWd9hA2cn5EAnaTKuAYmURmRJWiUHZKy24IxEGvv7Fg/1YQZGxNi8d7PhXC9qHyLujCMTg3khEMtC5utMkH9AjuVdXrXDmV9wpPiOx4PcMBjGIrO1jnQ9QmZAb6OSlk53lsBDFUwObu1O0X2Mf3ny8K5l4HoPq23HhJT3jWQl+zKkLS9s/ACtF8s9Yp8QyR8SofoLPXIhOZo4uZSaPjC5yDR8hZV7tzeyOsZKekHqXOs5nFJgNG NadxURuw ElXeAMJdhMchGvoCERIJgPiFU9VTxuWGRc+qFCvyLrhBgVyqbFRnjF3G87DrEScXBsHYDGMVPHMqte7bOZ4tsvNfCQ96gHvGUQAzMOEEcrmLHi508o2l4KMs9Neetgd+MugiB81c1UvAUQBgiXYDkHHCxjadxQLI4rEBjxlEWKrI4YSQltBwcVXg0MidhtQYUZpMoPwG2s7lnoCo0Ai3y8LmED/il/t1f1T+BJ3E1A3RzvtuHCyHGwWFMGi8TzYHcZzKSxaR9DN+CvcixML21EftxOw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Splits the vmalloc region into four. The first quarter is the new vmalloc region, the second is used to store shadow metadata and the third is used to store origin metadata. The fourth quarter is unused. Do the same for the ioremap region. Module data is stored in the vmalloc region so alias the modules metadata addresses to the respective vmalloc metadata addresses. Define MODULES_VADDR and MODULES_END to the start and end of the vmalloc region. Since MODULES_VADDR was previously only defined on ppc32 targets checks for if this macro is defined need to be updated to include defined(CONFIG_PPC32). Signed-off-by: Nicholas Miehlbradt --- arch/powerpc/include/asm/book3s/64/pgtable.h | 42 ++++++++++++++++++++ arch/powerpc/kernel/module.c | 2 +- 2 files changed, 43 insertions(+), 1 deletion(-) diff --git a/arch/powerpc/include/asm/book3s/64/pgtable.h b/arch/powerpc/include/asm/book3s/64/pgtable.h index cb77eddca54b..b3a02b8d96e3 100644 --- a/arch/powerpc/include/asm/book3s/64/pgtable.h +++ b/arch/powerpc/include/asm/book3s/64/pgtable.h @@ -249,7 +249,38 @@ enum pgtable_index { extern unsigned long __vmalloc_start; extern unsigned long __vmalloc_end; #define VMALLOC_START __vmalloc_start + +#ifndef CONFIG_KMSAN #define VMALLOC_END __vmalloc_end +#else +/* + * In KMSAN builds vmalloc area is four times smaller, and the remaining 3/4 + * are used to keep the metadata for virtual pages. The memory formerly + * belonging to vmalloc area is now laid out as follows: + * + * 1st quarter: VMALLOC_START to VMALLOC_END - new vmalloc area + * 2nd quarter: KMSAN_VMALLOC_SHADOW_START to + * KMSAN_VMALLOC_SHADOW_START+VMALLOC_LEN - vmalloc area shadow + * 3rd quarter: KMSAN_VMALLOC_ORIGIN_START to + * KMSAN_VMALLOC_ORIGIN_START+VMALLOC_LEN - vmalloc area origins + * 4th quarter: unused + */ +#define VMALLOC_LEN ((__vmalloc_end - __vmalloc_start) >> 2) +#define VMALLOC_END (VMALLOC_START + VMALLOC_LEN) + +#define KMSAN_VMALLOC_SHADOW_START VMALLOC_END +#define KMSAN_VMALLOC_ORIGIN_START (VMALLOC_END + VMALLOC_LEN) + +/* + * Module metadata is stored in the corresponding vmalloc metadata regions + */ +#define KMSAN_MODULES_SHADOW_START KMSAN_VMALLOC_SHADOW_START +#define KMSAN_MODULES_ORIGIN_START KMSAN_VMALLOC_ORIGIN_START +#endif /* CONFIG_KMSAN */ + +#define MODULES_VADDR VMALLOC_START +#define MODULES_END VMALLOC_END +#define MODULES_LEN (MODULES_END - MODULES_VADDR) static inline unsigned int ioremap_max_order(void) { @@ -264,7 +295,18 @@ extern unsigned long __kernel_io_start; extern unsigned long __kernel_io_end; #define KERN_VIRT_START __kernel_virt_start #define KERN_IO_START __kernel_io_start +#ifndef CONFIG_KMSAN #define KERN_IO_END __kernel_io_end +#else +/* + * In KMSAN builds IO space is 4 times smaller, the remaining space is used to + * store metadata. See comment for vmalloc regions above. + */ +#define KERN_IO_LEN ((__kernel_io_end - __kernel_io_start) >> 2) +#define KERN_IO_END (KERN_IO_START + KERN_IO_LEN) +#define KERN_IO_SHADOW_START KERN_IO_END +#define KERN_IO_ORIGIN_START (KERN_IO_SHADOW_START + KERN_IO_LEN) +#endif /* !CONFIG_KMSAN */ extern struct page *vmemmap; extern unsigned long pci_io_base; diff --git a/arch/powerpc/kernel/module.c b/arch/powerpc/kernel/module.c index f6d6ae0a1692..5043b959ad4d 100644 --- a/arch/powerpc/kernel/module.c +++ b/arch/powerpc/kernel/module.c @@ -107,7 +107,7 @@ __module_alloc(unsigned long size, unsigned long start, unsigned long end, bool void *module_alloc(unsigned long size) { -#ifdef MODULES_VADDR +#if defined(MODULES_VADDR) && defined(CONFIG_PPC32) unsigned long limit = (unsigned long)_etext - SZ_32M; void *ptr = NULL; -- 2.40.1