From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 07D2EC77B7C for ; Tue, 24 Jun 2025 15:48:43 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 9959D6B00A1; Tue, 24 Jun 2025 11:48:42 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 96DD56B00A7; Tue, 24 Jun 2025 11:48:42 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 8AAFD6B00AF; Tue, 24 Jun 2025 11:48:42 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 7445A6B00A1 for ; Tue, 24 Jun 2025 11:48:42 -0400 (EDT) Received: from smtpin26.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id 45DAD590B7 for ; Tue, 24 Jun 2025 15:48:42 +0000 (UTC) X-FDA: 83590726884.26.A836831 Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) by imf22.hostedemail.com (Postfix) with ESMTP id 6DECFC000F for ; Tue, 24 Jun 2025 15:48:40 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=none; spf=pass (imf22.hostedemail.com: domain of jonathan.cameron@huawei.com designates 185.176.79.56 as permitted sender) smtp.mailfrom=jonathan.cameron@huawei.com; dmarc=pass (policy=quarantine) header.from=huawei.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1750780120; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7VdJsNFrla8jF+nWT+6I6+vor4A3ZQlYDm2IiapyjTI=; b=BSZ6is4ETc6f+4cmif9TMHOWtO+lsLAIMWgixHEDeeYEaSwQYE/WGB1yl83ZQBPjACHZF1 ZrZb8jqcCrNAZkQqvT6ydPma4uPsb1HcZSQOcSPlDK4eUsgGjrvZSdSSOXVWXiMMPfXUVn MKNc6lf0MSEWnKYZ9Wb5RYiGE+rrd6c= ARC-Authentication-Results: i=1; imf22.hostedemail.com; dkim=none; spf=pass (imf22.hostedemail.com: domain of jonathan.cameron@huawei.com designates 185.176.79.56 as permitted sender) smtp.mailfrom=jonathan.cameron@huawei.com; dmarc=pass (policy=quarantine) header.from=huawei.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1750780120; a=rsa-sha256; cv=none; b=HWLnPmHskx5GAh7wzCKitu2WgGNovg9G4kHfNLMk2x+d8RCmmxvyIjTpvyVEiybNjQpDLf iCW0bKBdCuZRjUY1JW85fIcAGGO2Piy2nn+x7RCi0uku+oWtJus13Y+qTG0Wsu+c2ITDYG 8p2fCMP9WHC2m52gf/A9KAR7NnTRF6U= Received: from mail.maildlp.com (unknown [172.18.186.231]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4bRTqZ0CdXz6GDts; Tue, 24 Jun 2025 23:47:54 +0800 (CST) Received: from frapeml500008.china.huawei.com (unknown [7.182.85.71]) by mail.maildlp.com (Postfix) with ESMTPS id 6251F1400CA; Tue, 24 Jun 2025 23:48:38 +0800 (CST) Received: from SecurePC-101-06.china.huawei.com (10.122.19.247) by frapeml500008.china.huawei.com (7.182.85.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.39; Tue, 24 Jun 2025 17:48:37 +0200 From: Jonathan Cameron To: Catalin Marinas , , , , , , , , Will Deacon , Dan Williams , Davidlohr Bueso CC: Yicong Yang , , Yushan Wang , Lorenzo Pieralisi , Mark Rutland , Dave Hansen , Thomas Gleixner , Ingo Molnar , Borislav Petkov , , H Peter Anvin , Andy Lutomirski , Peter Zijlstra Subject: [PATCH v2 1/8] memregion: Support fine grained invalidate by cpu_cache_invalidate_memregion() Date: Tue, 24 Jun 2025 16:47:57 +0100 Message-ID: <20250624154805.66985-2-Jonathan.Cameron@huawei.com> X-Mailer: git-send-email 2.48.1 In-Reply-To: <20250624154805.66985-1-Jonathan.Cameron@huawei.com> References: <20250624154805.66985-1-Jonathan.Cameron@huawei.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-Originating-IP: [10.122.19.247] X-ClientProxiedBy: lhrpeml500004.china.huawei.com (7.191.163.9) To frapeml500008.china.huawei.com (7.182.85.71) X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: 6DECFC000F X-Stat-Signature: coxgm45apwwfmp79wwz8jo46qjpdy1rg X-Rspam-User: X-HE-Tag: 1750780120-354797 X-HE-Meta: U2FsdGVkX19QnJutfO7qetjTj69atFhWFqR5MBuiKir2IaXT4tGoRk7vf6LyrnTBiLeFXsVIuWUAYwUWx6i+fHLU8Jdbj2BwAenGqUs3riybANkGdgDvHoeVtLkxiBNQ+x2a9VItLEcNgjHh5JvPbrlIK1JB/xYqRRl3K3it8c32TIhJRA2SgsGDN8SF0clPDTWYjlY1DH27+8edT9BwW2UB9iikq/VPkgsJFGVZl4qLo7a1iVbTanr7FM+n4TNqCVqaODcjdXjcizLc/OLqTZjBdAdmFqIXOxAJv2CUtpsMizTmexDiqquXDi6bZCSlRQFWw6P2sH/IEJd5LKKOF9wWBD9sgOHTV5aKaancHMtD45qT3xNabqf0JZsokDuaPLjvVWmKbZ7JUXYcsXluE3WqrQo3nxnMjyzqWqrw5nvl4J26rRzRUP6vFh1RuqufMKa/TlCKTS7AJ/noJGlZ6O9s9k55Cpp9XcFYbSsRPezxTgGdFDvIf2jZchEatGTWEtQA8MLRQJhp+7eCtHRSYVt+Jp7ZpaaWRtwrLT3wBeP3mWLHf2mhFYGIybSADxd24R91cwkq4msws4ESIJxDM3+gVYK4moawJKw+oasxUYaAP40XtFWIz7ihPUAZnv579m+gHKGvlTd+v3B88A+rk4n+WdyrASE1kVNoBxuh5i/56YITnrXfVYLChz0d1VeV46TQNhBhJ31KYDfCHd5K+TK1grhpWl7Xk/Gmobqah8s3BijoGsTyFYbwn/kxfK/VdVDQ9oIpZsaLy9ai2MwfAp9o9Idpi2T8ziX+Ufd6kMNdpdk46P6F/518KzjUFZvF8gM8/cvlPo3bix1dbAhCHJAriYuzZ2Xxso49rG3wSYqY/f9ipbcT2dUKeLgR8CAiCpLyYfS5fafnPlvXd1Ra4w== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Yicong Yang Extend cpu_cache_invalidate_memregion() to support invalidate certain range of memory. Control of types of invlidation is left for when usecases turn up. For now everything is Clean and Invalidate. Signed-off-by: Yicong Yang Signed-off-by: Jonathan Cameron --- arch/x86/mm/pat/set_memory.c | 2 +- drivers/cxl/core/region.c | 6 +++++- drivers/nvdimm/region.c | 3 ++- drivers/nvdimm/region_devs.c | 3 ++- include/linux/memregion.h | 8 ++++++-- 5 files changed, 16 insertions(+), 6 deletions(-) diff --git a/arch/x86/mm/pat/set_memory.c b/arch/x86/mm/pat/set_memory.c index 46edc11726b7..8b39aad22458 100644 --- a/arch/x86/mm/pat/set_memory.c +++ b/arch/x86/mm/pat/set_memory.c @@ -368,7 +368,7 @@ bool cpu_cache_has_invalidate_memregion(void) } EXPORT_SYMBOL_NS_GPL(cpu_cache_has_invalidate_memregion, "DEVMEM"); -int cpu_cache_invalidate_memregion(int res_desc) +int cpu_cache_invalidate_memregion(int res_desc, phys_addr_t start, size_t len) { if (WARN_ON_ONCE(!cpu_cache_has_invalidate_memregion())) return -ENXIO; diff --git a/drivers/cxl/core/region.c b/drivers/cxl/core/region.c index 6e5e1460068d..6e6e8ace0897 100644 --- a/drivers/cxl/core/region.c +++ b/drivers/cxl/core/region.c @@ -237,7 +237,11 @@ static int cxl_region_invalidate_memregion(struct cxl_region *cxlr) return -ENXIO; } - cpu_cache_invalidate_memregion(IORES_DESC_CXL); + if (!cxlr->params.res) + return -ENXIO; + cpu_cache_invalidate_memregion(IORES_DESC_CXL, + cxlr->params.res->start, + resource_size(cxlr->params.res)); return 0; } diff --git a/drivers/nvdimm/region.c b/drivers/nvdimm/region.c index 88dc062af5f8..033e40f4dc52 100644 --- a/drivers/nvdimm/region.c +++ b/drivers/nvdimm/region.c @@ -110,7 +110,8 @@ static void nd_region_remove(struct device *dev) * here is ok. */ if (cpu_cache_has_invalidate_memregion()) - cpu_cache_invalidate_memregion(IORES_DESC_PERSISTENT_MEMORY); + cpu_cache_invalidate_memregion(IORES_DESC_PERSISTENT_MEMORY, + 0, -1); } static int child_notify(struct device *dev, void *data) diff --git a/drivers/nvdimm/region_devs.c b/drivers/nvdimm/region_devs.c index de1ee5ebc851..7e93766065d1 100644 --- a/drivers/nvdimm/region_devs.c +++ b/drivers/nvdimm/region_devs.c @@ -90,7 +90,8 @@ static int nd_region_invalidate_memregion(struct nd_region *nd_region) } } - cpu_cache_invalidate_memregion(IORES_DESC_PERSISTENT_MEMORY); + cpu_cache_invalidate_memregion(IORES_DESC_PERSISTENT_MEMORY, + 0, -1); out: for (i = 0; i < nd_region->ndr_mappings; i++) { struct nd_mapping *nd_mapping = &nd_region->mapping[i]; diff --git a/include/linux/memregion.h b/include/linux/memregion.h index c01321467789..91d088ee3695 100644 --- a/include/linux/memregion.h +++ b/include/linux/memregion.h @@ -28,6 +28,9 @@ static inline void memregion_free(int id) * cpu_cache_invalidate_memregion - drop any CPU cached data for * memregions described by @res_desc * @res_desc: one of the IORES_DESC_* types + * @start: start physical address of the target memory region. + * @len: length of the target memory region. -1 for all the regions of + * the target type. * * Perform cache maintenance after a memory event / operation that * changes the contents of physical memory in a cache-incoherent manner. @@ -46,7 +49,7 @@ static inline void memregion_free(int id) * the cache maintenance. */ #ifdef CONFIG_ARCH_HAS_CPU_CACHE_INVALIDATE_MEMREGION -int cpu_cache_invalidate_memregion(int res_desc); +int cpu_cache_invalidate_memregion(int res_desc, phys_addr_t start, size_t len); bool cpu_cache_has_invalidate_memregion(void); #else static inline bool cpu_cache_has_invalidate_memregion(void) @@ -54,7 +57,8 @@ static inline bool cpu_cache_has_invalidate_memregion(void) return false; } -static inline int cpu_cache_invalidate_memregion(int res_desc) +static inline int cpu_cache_invalidate_memregion(int res_desc, + phys_addr_t start, size_t len) { WARN_ON_ONCE("CPU cache invalidation required"); return -ENXIO; -- 2.48.1