From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ig0-f173.google.com (mail-ig0-f173.google.com [209.85.213.173]) by kanga.kvack.org (Postfix) with ESMTP id 2DA876B0035 for ; Fri, 23 May 2014 16:51:16 -0400 (EDT) Received: by mail-ig0-f173.google.com with SMTP id hn18so1141075igb.12 for ; Fri, 23 May 2014 13:51:15 -0700 (PDT) Received: from mail-ie0-x235.google.com (mail-ie0-x235.google.com [2607:f8b0:4001:c03::235]) by mx.google.com with ESMTPS id j8si5079849igx.3.2014.05.23.13.51.15 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 23 May 2014 13:51:15 -0700 (PDT) Received: by mail-ie0-f181.google.com with SMTP id rp18so4052545iec.12 for ; Fri, 23 May 2014 13:51:15 -0700 (PDT) Date: Fri, 23 May 2014 13:51:12 -0700 (PDT) From: David Rientjes Subject: Re: [PATCH] page_alloc: skip cpuset enforcement for lower zone allocations In-Reply-To: <20140523193706.GA22854@amt.cnet> Message-ID: References: <20140523193706.GA22854@amt.cnet> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-linux-mm@kvack.org List-ID: To: Marcelo Tosatti Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, Lai Jiangshan , Mel Gorman , Tejun Heo , Christoph Lameter , Li Zefan , Andrew Morton , cgroups@vger.kernel.org On Fri, 23 May 2014, Marcelo Tosatti wrote: > Zone specific allocations, such as GFP_DMA32, should not be restricted > to cpusets allowed node list: the zones which such allocations demand > might be contained in particular nodes outside the cpuset node list. > > The alternative would be to not perform such allocations from > applications which are cpuset restricted, which is unrealistic. > Or ensure applications that allocate from lowmem are allowed to do so, but I understand that might be hard to make sure always happens. > Fixes KVM's alloc_page(gfp_mask=GFP_DMA32) with cpuset as explained. > > Signed-off-by: Marcelo Tosatti > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > index 5dba293..f228039 100644 > --- a/mm/page_alloc.c > +++ b/mm/page_alloc.c > @@ -2698,6 +2698,7 @@ __alloc_pages_nodemask(gfp_t gfp_mask, unsigned int order, > unsigned int cpuset_mems_cookie; > int alloc_flags = ALLOC_WMARK_LOW|ALLOC_CPUSET|ALLOC_FAIR; > struct mem_cgroup *memcg = NULL; > + nodemask_t *cpuset_mems_allowed = &cpuset_current_mems_allowed; > > gfp_mask &= gfp_allowed_mask; > > @@ -2726,9 +2727,14 @@ __alloc_pages_nodemask(gfp_t gfp_mask, unsigned int order, > retry_cpuset: > cpuset_mems_cookie = read_mems_allowed_begin(); > > +#ifdef CONFIG_NUMA > + if (gfp_zone(gfp_mask) < policy_zone) > + cpuset_mems_allowed = NULL; > +#endif > + > /* The preferred zone is used for statistics later */ > first_zones_zonelist(zonelist, high_zoneidx, > - nodemask ? : &cpuset_current_mems_allowed, > + nodemask ? : cpuset_mems_allowed, > &preferred_zone); > if (!preferred_zone) > goto out; > I think this is incomplete. Correct me if I'm wrong on how this is working: preferred_zone, today, is NULL because first_zones_zonelist() is restricted to a cpuset.mems that does not include lowmem and your patch fixes that. But if the fastpath allocation with mandatory ALLOC_CPUSET fails and we go to the slowpath, which may or may not have showed up in your testing, there's still issues, particularly if __GFP_WAIT and lots of allocators do GFP_KERNEL | __GFP_DMA32. This requires ALLOC_CPUSET on all allocations and you haven't updated __cpuset_node_allowed_softwall() with this exception nor zlc_setup(). After that's done, I think all of this is really convoluted and deserves a comment to describe the ALLOC_CPUSET and __GFP_DMA32 behavior. Adding Li, the cpusets maintainer, to this as well. -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org