From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.5 required=3.0 tests=INCLUDES_PATCH, MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D8D30C282DD for ; Wed, 8 Jan 2020 12:42:42 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 861722067D for ; Wed, 8 Jan 2020 12:42:42 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 861722067D Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 224248E000C; Wed, 8 Jan 2020 07:42:42 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 1AE6D8E0001; Wed, 8 Jan 2020 07:42:42 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 09C2B8E000C; Wed, 8 Jan 2020 07:42:42 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0139.hostedemail.com [216.40.44.139]) by kanga.kvack.org (Postfix) with ESMTP id E399F8E0001 for ; Wed, 8 Jan 2020 07:42:41 -0500 (EST) Received: from smtpin21.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with SMTP id A920A483C for ; Wed, 8 Jan 2020 12:42:41 +0000 (UTC) X-FDA: 76354430922.21.honey26_348508716560c X-HE-Tag: honey26_348508716560c X-Filterd-Recvd-Size: 10904 Received: from mail-wm1-f67.google.com (mail-wm1-f67.google.com [209.85.128.67]) by imf26.hostedemail.com (Postfix) with ESMTP for ; Wed, 8 Jan 2020 12:42:40 +0000 (UTC) Received: by mail-wm1-f67.google.com with SMTP id p17so2369317wmb.0 for ; Wed, 08 Jan 2020 04:42:40 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=oL7AiyezFSaPUSQINsQX9lIy1KtBrah03q1c+vdGl70=; b=J86kRTdK5vuULusbgfWsIy3jODFHg0d3CJgaLIZYIeSeMiPHJTWaGezedMUZlLkoN0 8qdWC0bducpMDLGPgpc2jyMM+/HySRu4bMZ1H3LKkG6yo872A1xt706KLoY0snFChAXO r0aZK+yE1uCJpxDGRwfZuJjhAe1U7QHrFquWZZoP215Zdk1eL4CFjxGQJ3GHaAR3OH2D BOrOjD1U03f3xfI92G/pewj7jAiwsapCH8b4dkKaC+gAq2W2oPR4cukxwPCP+Cn63LN6 GyVR1Wlh2M80bmEdf6axJnXZh5ASCAPpELv6JEgdbNkb9jOwI+8nTDUMT7xm8lCRaB3Y R3fw== X-Gm-Message-State: APjAAAUpfua1JFvGyl07nrxtBPlqRmlU8ST0aPPWvlwNuguCRArqhHAJ FfEcARUZLzQ7lRFGVHs4iys= X-Google-Smtp-Source: APXvYqwKFA4+cgBJREYNaAxy2zZsIKi5z4WvcBbaIX9+DBXR03grpLlZ4iuekK3XvVeBMtqSIy9dvg== X-Received: by 2002:a05:600c:290f:: with SMTP id i15mr3768023wmd.115.1578487359562; Wed, 08 Jan 2020 04:42:39 -0800 (PST) Received: from localhost (prg-ext-pat.suse.com. [213.151.95.130]) by smtp.gmail.com with ESMTPSA id o7sm3546994wmh.11.2020.01.08.04.42.38 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 08 Jan 2020 04:42:38 -0800 (PST) Date: Wed, 8 Jan 2020 13:42:38 +0100 From: Michal Hocko To: Logan Gunthorpe Cc: linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-ia64@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-s390@vger.kernel.org, linux-sh@vger.kernel.org, platform-driver-x86@vger.kernel.org, linux-mm@kvack.org, Dan Williams , David Hildenbrand , Andrew Morton , Christoph Hellwig , Catalin Marinas , Will Deacon , Benjamin Herrenschmidt , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , Andy Lutomirski , Peter Zijlstra , Eric Badger Subject: Re: [PATCH v2 7/8] mm/memory_hotplug: Add pgprot_t to mhp_modifiers Message-ID: <20200108124238.GS32178@dhcp22.suse.cz> References: <20200107205959.7575-1-logang@deltatee.com> <20200107205959.7575-8-logang@deltatee.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200107205959.7575-8-logang@deltatee.com> User-Agent: Mutt/1.12.2 (2019-09-21) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Tue 07-01-20 13:59:58, Logan Gunthorpe wrote: > devm_memremap_pages() is currently used by the PCI P2PDMA code to create > struct page mappings for IO memory. At present, these mappings are created > with PAGE_KERNEL which implies setting the PAT bits to be WB. However, on > x86, an mtrr register will typically override this and force the cache > type to be UC-. In the case firmware doesn't set this register it is > effectively WB and will typically result in a machine check exception > when it's accessed. > > Other arches are not currently likely to function correctly seeing they > don't have any MTRR registers to fall back on. > > To solve this, add an argument to arch_add_memory() to explicitly > set the pgprot value to a specific value. > > Of the arches that support MEMORY_HOTPLUG: x86_64, s390 and arm64 is a > simple change to pass the pgprot_t down to their respective functions > which set up the page tables. For x86_32, set the page tables explicitly > using _set_memory_prot() (seeing they are already mapped). For sh, reject > anything but PAGE_KERNEL settings -- this should be fine, for now, seeing > sh doesn't support ZONE_DEVICE anyway. > > Cc: Dan Williams > Cc: David Hildenbrand > Cc: Michal Hocko > Signed-off-by: Logan Gunthorpe OK, this is less code churn than I expected. Having pgprot as an implcit parameter de-facto is a bit fragile though. Should we add a WARN_ON_ONCE (e.g. into the add_pages to catch all arches) for value 0? Other than that Acked-by: Michal Hocko > --- > arch/arm64/mm/mmu.c | 3 ++- > arch/ia64/mm/init.c | 4 ++++ > arch/powerpc/mm/mem.c | 3 ++- > arch/s390/mm/init.c | 2 +- > arch/sh/mm/init.c | 3 +++ > arch/x86/mm/init_32.c | 5 +++++ > arch/x86/mm/init_64.c | 2 +- > include/linux/memory_hotplug.h | 2 ++ > mm/memory_hotplug.c | 2 +- > mm/memremap.c | 6 +++--- > 10 files changed, 24 insertions(+), 8 deletions(-) > > diff --git a/arch/arm64/mm/mmu.c b/arch/arm64/mm/mmu.c > index 3320406579c3..9b214b0d268f 100644 > --- a/arch/arm64/mm/mmu.c > +++ b/arch/arm64/mm/mmu.c > @@ -1058,7 +1058,8 @@ int arch_add_memory(int nid, u64 start, u64 size, > flags = NO_BLOCK_MAPPINGS | NO_CONT_MAPPINGS; > > __create_pgd_mapping(swapper_pg_dir, start, __phys_to_virt(start), > - size, PAGE_KERNEL, __pgd_pgtable_alloc, flags); > + size, modifiers->pgprot, __pgd_pgtable_alloc, > + flags); > > memblock_clear_nomap(start, size); > > diff --git a/arch/ia64/mm/init.c b/arch/ia64/mm/init.c > index daf438e08b96..5fd6ae4929c9 100644 > --- a/arch/ia64/mm/init.c > +++ b/arch/ia64/mm/init.c > @@ -677,6 +677,10 @@ int arch_add_memory(int nid, u64 start, u64 size, > int ret; > > ret = __add_pages(nid, start_pfn, nr_pages, modifiers); > + if (modifiers->pgprot != PAGE_KERNEL) > + return -EINVAL; > + > + ret = __add_pages(nid, start_pfn, nr_pages, restrictions); > if (ret) > printk("%s: Problem encountered in __add_pages() as ret=%d\n", > __func__, ret); > diff --git a/arch/powerpc/mm/mem.c b/arch/powerpc/mm/mem.c > index 631ee684721f..fddeaee53198 100644 > --- a/arch/powerpc/mm/mem.c > +++ b/arch/powerpc/mm/mem.c > @@ -137,7 +137,8 @@ int __ref arch_add_memory(int nid, u64 start, u64 size, > resize_hpt_for_hotplug(memblock_phys_mem_size()); > > start = (unsigned long)__va(start); > - rc = create_section_mapping(start, start + size, nid, PAGE_KERNEL); > + rc = create_section_mapping(start, start + size, nid, > + modifiers->pgprot); > if (rc) { > pr_warn("Unable to create mapping for hot added memory 0x%llx..0x%llx: %d\n", > start, start + size, rc); > diff --git a/arch/s390/mm/init.c b/arch/s390/mm/init.c > index ef19522ddad2..c65fb33f6a89 100644 > --- a/arch/s390/mm/init.c > +++ b/arch/s390/mm/init.c > @@ -277,7 +277,7 @@ int arch_add_memory(int nid, u64 start, u64 size, > if (WARN_ON_ONCE(modifiers->altmap)) > return -EINVAL; > > - rc = vmem_add_mapping(start, size, PAGE_KERNEL); > + rc = vmem_add_mapping(start, size, modifiers->pgprot); > if (rc) > return rc; > > diff --git a/arch/sh/mm/init.c b/arch/sh/mm/init.c > index 7e64f42fb570..7071dc5bd2e4 100644 > --- a/arch/sh/mm/init.c > +++ b/arch/sh/mm/init.c > @@ -412,6 +412,9 @@ int arch_add_memory(int nid, u64 start, u64 size, > unsigned long nr_pages = size >> PAGE_SHIFT; > int ret; > > + if (modifiers->pgprot != PAGE_KERNEL) > + return -EINVAL; > + > /* We only have ZONE_NORMAL, so this is easy.. */ > ret = __add_pages(nid, start_pfn, nr_pages, modifiers); > if (unlikely(ret)) > diff --git a/arch/x86/mm/init_32.c b/arch/x86/mm/init_32.c > index 630d8a36fcd7..737da0dbc0d5 100644 > --- a/arch/x86/mm/init_32.c > +++ b/arch/x86/mm/init_32.c > @@ -857,6 +857,11 @@ int arch_add_memory(int nid, u64 start, u64 size, > { > unsigned long start_pfn = start >> PAGE_SHIFT; > unsigned long nr_pages = size >> PAGE_SHIFT; > + int ret; > + > + ret = _set_memory_prot(start, nr_pages, modifiers->pgprot); > + if (ret) > + return ret; > > return __add_pages(nid, start_pfn, nr_pages, modifiers); > } > diff --git a/arch/x86/mm/init_64.c b/arch/x86/mm/init_64.c > index 17ea0bfc0b83..cc9eb45ad120 100644 > --- a/arch/x86/mm/init_64.c > +++ b/arch/x86/mm/init_64.c > @@ -868,7 +868,7 @@ int arch_add_memory(int nid, u64 start, u64 size, > unsigned long start_pfn = start >> PAGE_SHIFT; > unsigned long nr_pages = size >> PAGE_SHIFT; > > - init_memory_mapping(start, start + size, PAGE_KERNEL); > + init_memory_mapping(start, start + size, modifiers->pgprot); > > return add_pages(nid, start_pfn, nr_pages, modifiers); > } > diff --git a/include/linux/memory_hotplug.h b/include/linux/memory_hotplug.h > index 2152efae2f4b..00dfb2016737 100644 > --- a/include/linux/memory_hotplug.h > +++ b/include/linux/memory_hotplug.h > @@ -56,9 +56,11 @@ enum { > /* > * Restrictions for the memory hotplug: > * altmap: alternative allocator for memmap array > + * pgprot: page protection flags to apply to newly added page tables > */ > struct mhp_modifiers { > struct vmem_altmap *altmap; > + pgprot_t pgprot; > }; > > /* > diff --git a/mm/memory_hotplug.c b/mm/memory_hotplug.c > index 1bb3f92e087d..0888f821af06 100644 > --- a/mm/memory_hotplug.c > +++ b/mm/memory_hotplug.c > @@ -1027,7 +1027,7 @@ static int online_memory_block(struct memory_block *mem, void *arg) > */ > int __ref add_memory_resource(int nid, struct resource *res) > { > - struct mhp_modifiers modifiers = {}; > + struct mhp_modifiers modifiers = {.pgprot = PAGE_KERNEL}; > u64 start, size; > bool new_node = false; > int ret; > diff --git a/mm/memremap.c b/mm/memremap.c > index e30be8ba706b..45ab4ef0643d 100644 > --- a/mm/memremap.c > +++ b/mm/memremap.c > @@ -163,8 +163,8 @@ void *memremap_pages(struct dev_pagemap *pgmap, int nid) > * We do not want any optional features only our own memmap > */ > .altmap = pgmap_altmap(pgmap), > + .pgprot = PAGE_KERNEL, > }; > - pgprot_t pgprot = PAGE_KERNEL; > int error, is_ram; > bool need_devmap_managed = true; > > @@ -252,8 +252,8 @@ void *memremap_pages(struct dev_pagemap *pgmap, int nid) > if (nid < 0) > nid = numa_mem_id(); > > - error = track_pfn_remap(NULL, &pgprot, PHYS_PFN(res->start), 0, > - resource_size(res)); > + error = track_pfn_remap(NULL, &modifiers.pgprot, PHYS_PFN(res->start), > + 0, resource_size(res)); > if (error) > goto err_pfn_remap; > > -- > 2.20.1 > -- Michal Hocko SUSE Labs