From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 14033E77188 for ; Mon, 30 Dec 2024 17:57:44 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 7D3116B00A7; Mon, 30 Dec 2024 12:57:35 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 77DA86B00AC; Mon, 30 Dec 2024 12:57:35 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 4A01C6B00A9; Mon, 30 Dec 2024 12:57:35 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 1890F6B009C for ; Mon, 30 Dec 2024 12:57:35 -0500 (EST) Received: from smtpin09.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id C160B807FF for ; Mon, 30 Dec 2024 17:57:34 +0000 (UTC) X-FDA: 82952380056.09.12E69D7 Received: from shelob.surriel.com (shelob.surriel.com [96.67.55.147]) by imf10.hostedemail.com (Postfix) with ESMTP id BC448C0006 for ; Mon, 30 Dec 2024 17:57:12 +0000 (UTC) Authentication-Results: imf10.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf10.hostedemail.com: domain of riel@shelob.surriel.com designates 96.67.55.147 as permitted sender) smtp.mailfrom=riel@shelob.surriel.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1735581409; a=rsa-sha256; cv=none; b=yJpezt/Vpkp1e4uPW9mb2gBdGAnCTQFcHW4neGdZFOIpsjxo0pO55py3DA8XTRjWLwS7Kq EIiVjt9k1A/BTx/QKP3WEJInWToHTwRmuIv2MxOYUdRf1ea6vh/pLfrY4CT/wL3hOhlRlT TbmxWGeSr+CFMgXiZ/tTQLtb3QqaF2A= ARC-Authentication-Results: i=1; imf10.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf10.hostedemail.com: domain of riel@shelob.surriel.com designates 96.67.55.147 as permitted sender) smtp.mailfrom=riel@shelob.surriel.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1735581409; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=K5kAnA/uvhfX97xxy6j+hAoMn5CiM7bebUnd0IunxME=; b=rDFEVrcnxfJHw8dviK5cjxlln5xrrvxMUC0Tkm8wV/csvnoL9xKWVxvMEO1nMe4hN2+C2y OOLpeCJjLbXUz0kZibyQTgGUI3B9zb2sys3mi8fCeJlmwcZn+P25FVPB1jKguab06lUQDh f0qyzIkR9da1xiM8TBNi1pCkfBjXTfo= Received: from fangorn.home.surriel.com ([10.0.13.7]) by shelob.surriel.com with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.97.1) (envelope-from ) id 1tSJzd-000000008Lf-0g30; Mon, 30 Dec 2024 12:55:53 -0500 From: Rik van Riel To: x86@kernel.org Cc: linux-kernel@vger.kernel.org, kernel-team@meta.com, dave.hansen@linux.intel.com, luto@kernel.org, peterz@infradead.org, tglx@linutronix.de, mingo@redhat.com, bp@alien8.de, hpa@zytor.com, akpm@linux-foundation.org, nadav.amit@gmail.com, zhengqi.arch@bytedance.com, linux-mm@kvack.org, Rik van Riel Subject: [PATCH 04/12] x86/mm: get INVLPGB count max from CPUID Date: Mon, 30 Dec 2024 12:53:05 -0500 Message-ID: <20241230175550.4046587-5-riel@surriel.com> X-Mailer: git-send-email 2.47.1 In-Reply-To: <20241230175550.4046587-1-riel@surriel.com> References: <20241230175550.4046587-1-riel@surriel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Stat-Signature: 6oeufewo3zzyjgykdzjk9f1hbfmzce8j X-Rspam-User: X-Rspamd-Queue-Id: BC448C0006 X-Rspamd-Server: rspam08 X-HE-Tag: 1735581432-319027 X-HE-Meta: U2FsdGVkX1+GbDmlJ3kKHV6dl/VeomorhQ/patzqi9ofMeVtQ81VvEbFIA3gnoksd2EnJyWryNENdbbPmKmyNDJ4Okct//E+omcr++xHb4bXD6s3ehWFhNiP4oFMB9kvxECiSnJZiXpYuJvpVYbgUsXoZE6JO4nZKNQ8RDEhjYgFzCumTFxqnk3eFf9YxrmOyjBNXuMCvP1PwRmxVZWYeuszcx9GTaBxJxtZTkbPe3JUFADG/+FaBinvSQM0QnzgpZjs3Y7a1ydrTlg2ToCBLBf7BNRAh0/axiDQyeshQTS9zVGtQBh7W0NnZ7yfHro0EU1HxK0kOvyAq4/r+lb9Kxs30UD4qEXoRPi4/1LnWloFHolhCzI+s0R8IOaRyeZ3FZ17LIX5HeYqALLoVLqdes30a165vW4iiO7ajna8m+kbCmG4Zp59GwyqQJYXVo77CKt2Lu4504mCryrU4IrXjKw4vbL2uLZOAkLskUlg+K5RAQ85JqWe6ACDFfOKlzWCFsaw34duEkHRBWxvk+OkiCtUF9DHfJ3F14e0d5ooPWj/rKjm5gyEKNEXadamLhPXfb4R9lZriibnMV13lSYo84HnjltXBJXYDJNDXzCNPql/hfL/jNjcLNo2APMhiMnPiM9+PNBJdMyAq4a9Iy1wNUF80C7l0cp8S03+DB2osHigHDp5dGUT+6JreagcsCvTAJ/U/O3t11j35tJCGj7F5NvJCmYIj//L4sEKtSXDWCF0kzwdhk4BRjX1z3XAX7nlFHd36QQmGN/3USu7CxOvKFLC0NcXtuynLq5HbB+N+9fXZ+vi2n2Cjv3T79Rz48HhDzLtJF07hUtf5xCtNeLjw0tv0gfUGTZd+Y/StU4Ap7rGGSZIHgsUdkhu5bYqWbYSf3SGoh/+W+9E62j6dB1HCA+MiDH4e0W3zqFLlnaQHNkUfAXXCVed9yXCWokYtBRmSmLAgkLUitQRkGmcFFl OEms3gEJ rmPoIXbT8yq8DW1+CIaBOsPFDiSJ23fDVrVfTk7fl/Se2duGLAGabo8xrDFhCHKIcpdwUbfJQLudpddtT8OZo7gvobhuhGFdWPNSHR06xjv6MdgOikWa1MNbzCqx0bsdC7GtMWDIE6d4IUwm2wsdH0c01iFzg4TVaAom4pqLCK6J/Mc/+s7vbpMNbL4rD4rOqHXSdE6e3sUsX4IayQdW/+X67cF+GjLlmM+XcLv4XbGJz/WGWIXUBaV9VrltiliVStvjdVYiiyZKx8RN05K+62q4zbVN/Wmlk69/8cSO9CnxhVxj9s0ryOcDvDafW8pcEo93birXMpTE7pDgf1Y3xXLcOwqhflaIy3YzbIuVzy/8lKsx9bpFfdlxebKR52l7xdSrd X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: The CPU advertises the maximum number of pages that can be shot down with one INVLPGB instruction in the CPUID data. Save that information for later use. Signed-off-by: Rik van Riel --- arch/x86/include/asm/tlbflush.h | 1 + arch/x86/kernel/cpu/amd.c | 8 ++++++++ arch/x86/kernel/setup.c | 4 ++++ 3 files changed, 13 insertions(+) diff --git a/arch/x86/include/asm/tlbflush.h b/arch/x86/include/asm/tlbflush.h index 02fc2aa06e9e..7d1468a3967b 100644 --- a/arch/x86/include/asm/tlbflush.h +++ b/arch/x86/include/asm/tlbflush.h @@ -182,6 +182,7 @@ static inline void cr4_init_shadow(void) extern unsigned long mmu_cr4_features; extern u32 *trampoline_cr4_features; +extern u16 invlpgb_count_max; extern void initialize_tlbstate_and_flush(void); diff --git a/arch/x86/kernel/cpu/amd.c b/arch/x86/kernel/cpu/amd.c index 79d2e17f6582..226b8fc64bfc 100644 --- a/arch/x86/kernel/cpu/amd.c +++ b/arch/x86/kernel/cpu/amd.c @@ -1135,6 +1135,14 @@ static void cpu_detect_tlb_amd(struct cpuinfo_x86 *c) tlb_lli_2m[ENTRIES] = eax & mask; tlb_lli_4m[ENTRIES] = tlb_lli_2m[ENTRIES] >> 1; + + if (c->extended_cpuid_level < 0x80000008) + return; + + cpuid(0x80000008, &eax, &ebx, &ecx, &edx); + + /* Max number of pages INVLPGB can invalidate in one shot */ + invlpgb_count_max = (edx & 0xffff) + 1; } static const struct cpu_dev amd_cpu_dev = { diff --git a/arch/x86/kernel/setup.c b/arch/x86/kernel/setup.c index f1fea506e20f..6c4d08f8f7b1 100644 --- a/arch/x86/kernel/setup.c +++ b/arch/x86/kernel/setup.c @@ -138,6 +138,10 @@ __visible unsigned long mmu_cr4_features __ro_after_init; __visible unsigned long mmu_cr4_features __ro_after_init = X86_CR4_PAE; #endif +#ifdef CONFIG_CPU_SUP_AMD +u16 invlpgb_count_max __ro_after_init; +#endif + #ifdef CONFIG_IMA static phys_addr_t ima_kexec_buffer_phys; static size_t ima_kexec_buffer_size; -- 2.47.1