From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 59521C433F5 for ; Thu, 12 May 2022 03:35:10 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 8C4B86B0074; Wed, 11 May 2022 23:35:09 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 84ED86B0075; Wed, 11 May 2022 23:35:09 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6EE866B0078; Wed, 11 May 2022 23:35:09 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 596326B0074 for ; Wed, 11 May 2022 23:35:09 -0400 (EDT) Received: from smtpin17.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 2B97720B18 for ; Thu, 12 May 2022 03:35:09 +0000 (UTC) X-FDA: 79455675138.17.DDE882E Received: from mail-pf1-f174.google.com (mail-pf1-f174.google.com [209.85.210.174]) by imf21.hostedemail.com (Postfix) with ESMTP id 462211C00AD for ; Thu, 12 May 2022 03:35:00 +0000 (UTC) Received: by mail-pf1-f174.google.com with SMTP id p12so3692347pfn.0 for ; Wed, 11 May 2022 20:35:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance-com.20210112.gappssmtp.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=X1EWtaAUcC9nY4ecdIj3gv8AzSUp1nD6lxQDDkHzRhM=; b=cskRuPyshApD9fUcRR98UoK/tm6N0nS7PLFObGyO2zx1ZhP2UoucAEef0yxRbm0Gzy j6WCarlZMSxwc2u0ely+oDNFqEJcB4VEPSOrjQc2CaOEY40BHmEwfLxs+hl//QUPyEOh 4W2lw9IXlxKZVV3EdwWUadzrs9UXzcGUd7JEM4xZXh1/BYWgJq/5gWmJcMs634aSNknq B9BlEkl9wgU5U19jCUnjQvOup0NqOs6EJFxXXz6f+jbVPSMZaBOqalzCztC0Dwme8/Yg Aw0UPBApMUu56/J2ETl5mZeDwTVmeVR2oMjgP+rZD1PcpmrPIJ5CysQxjpC48Quw+opf eefQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=X1EWtaAUcC9nY4ecdIj3gv8AzSUp1nD6lxQDDkHzRhM=; b=c3jdsH5cd/07urzw49W/raM1bCXzKbz73A5LQr691Sy5+yI7B0c/vmfYgL5Oe80u4l Ds3J+zBI0Zgiy6d4sCa+N6rcSwhZTIXbMc4xR+GcpSznHWYtw6oht3NWpPFeUI6zdvbu dRnJMpeluYcI18m456u+9ARpEunFsVnJQJGlQuKhhfSE02/7lBdyEnjY5fJdraXGg0gh k2t9hmPm4A5gyJ6rWTC9P5ZNgsefVsPVFND192VymTEmMliodijMCnX1FRCAqdHWcM73 RhhIUdzMHdGsYfKhN5pb7ouMgOQZz3i02ozY6MuLUeGIkvCN4PyEePcrZu/cFre32hs+ /h7w== X-Gm-Message-State: AOAM533wDRBSptyAMJWDdG4oQHb9nhm7UJXvPDinoeHU5dlQGkLWyIJT lc5MtISoCQF8+FWnvLkTxOkLyw== X-Google-Smtp-Source: ABdhPJwvazLxYDzsIGa1KMrB5vzmREoXsmZdW0ImzlKi2JBBm3AHvRmqeR1wDZD2sT5xyV/vgQ28UA== X-Received: by 2002:a63:6a45:0:b0:3c1:47b7:edce with SMTP id f66-20020a636a45000000b003c147b7edcemr23175244pgc.207.1652326506731; Wed, 11 May 2022 20:35:06 -0700 (PDT) Received: from localhost ([139.177.225.250]) by smtp.gmail.com with ESMTPSA id cp23-20020a17090afb9700b001cd4989fee1sm658198pjb.45.2022.05.11.20.35.05 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 11 May 2022 20:35:06 -0700 (PDT) Date: Thu, 12 May 2022 11:34:54 +0800 From: Muchun Song To: Mike Kravetz Cc: corbet@lwn.net, akpm@linux-foundation.org, mcgrof@kernel.org, keescook@chromium.org, yzaikin@google.com, osalvador@suse.de, david@redhat.com, masahiroy@kernel.org, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, duanxiongchun@bytedance.com, smuchun@gmail.com Subject: Re: [PATCH v10 4/4] mm: hugetlb_vmemmap: add hugetlb_optimize_vmemmap sysctl Message-ID: References: <20220509062703.64249-1-songmuchun@bytedance.com> <20220509062703.64249-5-songmuchun@bytedance.com> <970166e0-f70e-dd2a-c764-af23a8425f87@oracle.com> <9d64809f-db8c-0a3e-1ae9-d4a8ab79041e@oracle.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 462211C00AD X-Stat-Signature: 9qaczfsnbqwshoxcgfb6zw93gtm44y19 X-Rspam-User: Authentication-Results: imf21.hostedemail.com; dkim=pass header.d=bytedance-com.20210112.gappssmtp.com header.s=20210112 header.b=cskRuPys; spf=pass (imf21.hostedemail.com: domain of songmuchun@bytedance.com designates 209.85.210.174 as permitted sender) smtp.mailfrom=songmuchun@bytedance.com; dmarc=pass (policy=none) header.from=bytedance.com X-Rspamd-Server: rspam09 X-HE-Tag: 1652326500-395343 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed, May 11, 2022 at 10:53:07AM -0700, Mike Kravetz wrote: > On 5/11/22 03:57, Muchun Song wrote: > > On Wed, May 11, 2022 at 05:45:57PM +0800, Muchun Song wrote: > >> On Tue, May 10, 2022 at 05:39:40PM -0700, Mike Kravetz wrote: > >>> On 5/10/22 14:30, Mike Kravetz wrote: > >>>> On 5/8/22 23:27, Muchun Song wrote: > >>>>> diff --git a/include/linux/memory_hotplug.h b/include/linux/memory_hotplug.h > >>>>> index 029fb7e26504..917112661b5c 100644 > >>>>> --- a/include/linux/memory_hotplug.h > >>>>> +++ b/include/linux/memory_hotplug.h > >>>>> @@ -351,4 +351,13 @@ void arch_remove_linear_mapping(u64 start, u64 size); > >>>>> extern bool mhp_supports_memmap_on_memory(unsigned long size); > >>>>> #endif /* CONFIG_MEMORY_HOTPLUG */ > >>>>> > >>>>> +#ifdef CONFIG_MHP_MEMMAP_ON_MEMORY > >>>>> +bool mhp_memmap_on_memory(void); > >>>>> +#else > >>>>> +static inline bool mhp_memmap_on_memory(void) > >>>>> +{ > >>>>> + return false; > >>>>> +} > >>>>> +#endif > >>>>> + > >>>>> #endif /* __LINUX_MEMORY_HOTPLUG_H */ > >>>>> diff --git a/mm/hugetlb.c b/mm/hugetlb.c > >>>>> index 8605d7eb7f5c..86158eb9da70 100644 > >>>>> --- a/mm/hugetlb.c > >>>>> +++ b/mm/hugetlb.c > >>>>> @@ -1617,6 +1617,9 @@ static DECLARE_WORK(free_hpage_work, free_hpage_workfn); > >>>>> > >>>>> static inline void flush_free_hpage_work(struct hstate *h) > >>>>> { > >>>>> + if (!hugetlb_optimize_vmemmap_enabled()) > >>>>> + return; > >>>>> + > >>>> > >>>> Hi Muchun, > >>>> > >>>> In v9 I was suggesting that we may be able to eliminate the static_branch_inc/dec from the vmemmap free/alloc paths. With this patch > >>>> I believe hugetlb_optimize_vmemmap_enabled() is really checking > >>>> 'has hugetlb vmemmap optimization been enabled' OR 'are there still vmemmap > >>>> optimized hugetlb pages in the system'. That may be confusing. > >>>> > >>> > >>> Sorry, I forgot about the use of hugetlb_optimize_vmemmap_enabled in > >>> page_fixed_fake_head. We need to know if there are any vmemmap optimized > >>> hugetlb pages in the system in this performance sensitive path. So, > >>> static_branch_inc/dec is indeed a good idea. > >>> > >> > >> Agree. > >> > >>> Please disregard my attempt below at removing static_branch_inc/dec. > >>> > >>> I still find the name hugetlb_optimize_vmemmap_enabled a bit confusing as > >>> it tests two conditions (enabled and pages in use). > >>> > >> > >> Right. It tests two conditions. > >> > >>> You have already 'open coded' just the check for enabled in the routine > >>> hugetlb_vmemmap_free with: > >>> > >>> READ_ONCE(vmemmap_optimize_mode) == VMEMMAP_OPTIMIZE_OFF > >>> > >>> How about having hugetlb_optimize_vmemmap_enabled() just check > >>> vmemmap_optimize_mode in a manner like above? Then rename > >> > >> I'm wondering is it necessary to do this? vmemmap_optimize_mode > >> is a internal state in hugetlb_vmemmap.c, at leaset now there is > >> no outside users who care about this. Open-coding may be not > >> an issue (I guess)? If one day someone cares it, maybe it it > >> the time to do this and rename hugetlb_optimize_vmemmap_enabled()? > >> I'm not against doing this, just expressing some of my thoughts. > >> What do you think, Mike? > >> > >>> hugetlb_optimize_vmemmap_enabled to something like: > >>> hugetlb_optimized_vmemmap_possible(). Sorry, I can think if a great name. > >>> > >> > >> At least I cannot come up with an appropriate name. > >> hugetlb_optimize_vmemmap_may_enabled()? It's not easy to come > >> up with a good name. > >> > > > > Instead of renaming, how about remove hugetlb_optimize_vmemmap_enabled() > > directly? I found there are only two places (mm/memory_hotplug.c and > > arch/arm64/mm/flush.c) except include/linux/page-flags.h where use this > > helper. > > > > In arch/arm64/mm/flush.c, we could replace it with > > > > if (PageHuge(page) && HPageVmemmapOptimized(compound_head(page))) > > > > In mm/memory_hotplug.c, I have a plan to remove it as well (I'll > > post them out after this patch merged). > > > > Finally, there is no outside users of it, we could remove it and squash > > it into page_fixed_fake_head(). What do you think this, Mike? > > That sounds good. > > Sorry for all the questions/suggestions around > hugetlb_optimize_vmemmap_enabled. It just caused me a little confusion > as it is providing information on two conditions. I wanted to prevent it > from causing confusion for others reading the code in the future. > Sorry for the confusing. I'll post the subsequent patches ASAP. > This patch as written is fine with plans for a follow up to remove > hugetlb_optimize_vmemmap_enabled. > > Reviewed-by: Mike Kravetz Thanks Mike.