From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C9806C28D13 for ; Thu, 25 Aug 2022 12:30:40 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0D797940008; Thu, 25 Aug 2022 08:30:40 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 086A3940007; Thu, 25 Aug 2022 08:30:40 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id EB84E940008; Thu, 25 Aug 2022 08:30:39 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id DC430940007 for ; Thu, 25 Aug 2022 08:30:39 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id AD17C1C7541 for ; Thu, 25 Aug 2022 12:30:39 +0000 (UTC) X-FDA: 79838048598.19.30F7412 Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.220.29]) by imf06.hostedemail.com (Postfix) with ESMTP id 25FDC18000D for ; Thu, 25 Aug 2022 12:30:37 +0000 (UTC) Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id BD8C320532; Thu, 25 Aug 2022 12:30:36 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_rsa; t=1661430636; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fzn4fp0N5eWsHb65DqtqGlpmfzcl9UEV0GebO196Vs4=; b=aDqaqu7dAgtJ5xAfyfRrAZDl1QGfsWSbTc3FHcUxzX9q8/IfdGiUiI3Aq1zOO163X7AioO bLLuvvSFmU7D8wpLyx80/BhwudzK8FeuCG6Aui/F/apvrYzbSa+Ull3XCxql+rgvon58zN c3tkXpWrLOzRRDq5vv5RZWL9lo4l3BQ= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_ed25519; t=1661430636; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=fzn4fp0N5eWsHb65DqtqGlpmfzcl9UEV0GebO196Vs4=; b=ys1Rt9r1Ba9DHh1ojiVRC/EZQFO7NQrSrH8cJDGTi6i5TUIm67YfuIaw4d91RBWu028G0r BzThZTDQzRob5ECQ== Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by imap2.suse-dmz.suse.de (Postfix) with ESMTPS id 6881013A8E; Thu, 25 Aug 2022 12:30:36 +0000 (UTC) Received: from dovecot-director2.suse.de ([192.168.254.65]) by imap2.suse-dmz.suse.de with ESMTPSA id dHm0GGxrB2NoFgAAMHmgww (envelope-from ); Thu, 25 Aug 2022 12:30:36 +0000 Message-ID: <98f583c0-8b63-a377-f37f-421952329707@suse.cz> Date: Thu, 25 Aug 2022 14:30:36 +0200 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.1.2 Subject: Re: [PATCH v4] page_ext: introduce boot parameter 'early_page_ext' Content-Language: en-US To: lizhe.67@bytedance.com, akpm@linux-foundation.org, mhocko@suse.com, mhiramat@kernel.org, keescook@chromium.org, Jason@zx2c4.com, mark-pk.tsai@mediatek.com, rostedt@goodmis.org, corbet@lwn.net Cc: linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, lizefan.x@bytedance.com References: <20220825102714.669-1-lizhe.67@bytedance.com> From: Vlastimil Babka In-Reply-To: <20220825102714.669-1-lizhe.67@bytedance.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1661430638; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=fzn4fp0N5eWsHb65DqtqGlpmfzcl9UEV0GebO196Vs4=; b=jQMwtL0tmkUYU0NH+h5JZMwY8v4jHFwr16LwChFtQSQjHMpSd65Ql7IVw5kjKyEQyx+DoU EtsMaqMi4+11B2CGIRdLmxYpCtnRX3oRf5ptp7zx13vkxNb4tW5qpmDItYcAgP6ggtzthj ypI2ahNVE4WGYXkeG+BQ756CpnioWOI= ARC-Authentication-Results: i=1; imf06.hostedemail.com; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b=aDqaqu7d; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b=ys1Rt9r1; spf=pass (imf06.hostedemail.com: domain of vbabka@suse.cz designates 195.135.220.29 as permitted sender) smtp.mailfrom=vbabka@suse.cz; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1661430638; a=rsa-sha256; cv=none; b=s6Utj8KjS0Kh2NOaUrCm57rwthF+ykb9YTd99ovuAzsCP4nOi4kw7wP2OtKl2hl4MXad4k KfFwRPNgMLEWajn++PL2cGR/g2KlbQYDfqUBAE+x+Y5G4g93JTEUt4TC7rzeU8CINenNeB vwYiv3PIq1ZJU0ZfiRxJodfNghVrWA0= Authentication-Results: imf06.hostedemail.com; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b=aDqaqu7d; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b=ys1Rt9r1; spf=pass (imf06.hostedemail.com: domain of vbabka@suse.cz designates 195.135.220.29 as permitted sender) smtp.mailfrom=vbabka@suse.cz; dmarc=none X-Rspam-User: X-Stat-Signature: aotxiz4g3hprpjk9zc8pnh99a3u3hxjy X-Rspamd-Queue-Id: 25FDC18000D X-Rspamd-Server: rspam03 X-HE-Tag: 1661430637-498166 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 8/25/22 12:27, lizhe.67@bytedance.com wrote: > From: Li Zhe > > In 'commit 2f1ee0913ce5 ("Revert "mm: use early_pfn_to_nid in page_ext_init"")', > we call page_ext_init() after page_alloc_init_late() to avoid some panic > problem. It seems that we cannot track early page allocations in current > kernel even if page structure has been initialized early. > > This patch introduce a new boot parameter 'early_page_ext' to resolve this > problem. If we pass it to kernel, function page_ext_init() will be moved > up and feature 'deferred initialization of struct pages' will be disabled > to initialize the page allocator early and prevent from the panic problem > above. It can help us to catch early page allocations. This is useful > especially when we find that the free memory value is not the same right > after different kernel booting. > > Suggested-by: Michal Hocko > Signed-off-by: Li Zhe Acked-by: Vlastimil Babka > --- > Changelogs: > > v1->v2: > - use a cmd line parameter to move up function page_ext_init() instead of > using CONFIG_DEFERRED_STRUCT_PAGE_INIT > - fix oom problem[1] > > v2->v3: > - move the judgment out of page_ext_init() > > v3->v4: > - remove dependency on CONFIG_DEFERRED_STRUCT_PAGE_INIT > - modify descriptions in git log && kernel-parameters.txt > > v1 patch: https://lore.kernel.org/lkml/Yv3r6Y1vh+6AbY4+@dhcp22.suse.cz/T/ > v2 patch: https://lore.kernel.org/lkml/20220824065058.81051-1-lizhe.67@bytedance.com/T/ > v3 patch: https://lore.kernel.org/linux-mm/20220825063102.92307-1-lizhe.67@bytedance.com/T/ > > [1]: https://lore.kernel.org/linux-mm/YwHmXLu5txij+p35@xsang-OptiPlex-9020/ > > Documentation/admin-guide/kernel-parameters.txt | 8 ++++++++ > include/linux/page_ext.h | 11 +++++++++++ > init/main.c | 6 +++++- > mm/page_alloc.c | 2 ++ > mm/page_ext.c | 8 ++++++++ > 5 files changed, 34 insertions(+), 1 deletion(-) > > diff --git a/Documentation/admin-guide/kernel-parameters.txt b/Documentation/admin-guide/kernel-parameters.txt > index d7f30902fda0..4f43fd5b324d 100644 > --- a/Documentation/admin-guide/kernel-parameters.txt > +++ b/Documentation/admin-guide/kernel-parameters.txt > @@ -1471,6 +1471,14 @@ > Permit 'security.evm' to be updated regardless of > current integrity status. > > + early_page_ext [KNL] Enforces page_ext initialization to earlier > + stages so cover more early boot allocations. > + Please note that as side effect some optimizations > + might be disabled to achieve that (e.g. parallelized > + memory initialization is disabled) so the boot process > + might take longer, especially on systems with a lot of > + memory. Available with CONFIG_PAGE_EXTENSION=y. > + > failslab= > fail_usercopy= > fail_page_alloc= > diff --git a/include/linux/page_ext.h b/include/linux/page_ext.h > index fabb2e1e087f..884282a7f03a 100644 > --- a/include/linux/page_ext.h > +++ b/include/linux/page_ext.h > @@ -36,9 +36,15 @@ struct page_ext { > unsigned long flags; > }; > > +extern bool early_page_ext; > extern unsigned long page_ext_size; > extern void pgdat_page_ext_init(struct pglist_data *pgdat); > > +static inline bool early_page_ext_enabled(void) > +{ > + return early_page_ext; > +} > + > #ifdef CONFIG_SPARSEMEM > static inline void page_ext_init_flatmem(void) > { > @@ -67,6 +73,11 @@ static inline struct page_ext *page_ext_next(struct page_ext *curr) > #else /* !CONFIG_PAGE_EXTENSION */ > struct page_ext; > > +static inline bool early_page_ext_enabled(void) > +{ > + return false; > +} > + > static inline void pgdat_page_ext_init(struct pglist_data *pgdat) > { > } > diff --git a/init/main.c b/init/main.c > index 91642a4e69be..b5e75f3288d7 100644 > --- a/init/main.c > +++ b/init/main.c > @@ -849,6 +849,9 @@ static void __init mm_init(void) > pgtable_init(); > debug_objects_mem_init(); > vmalloc_init(); > + /* Should be run after vmap initialization */ > + if (early_page_ext_enabled()) > + page_ext_init(); > /* Should be run before the first non-init thread is created */ > init_espfix_bsp(); > /* Should be run after espfix64 is set up. */ > @@ -1606,7 +1609,8 @@ static noinline void __init kernel_init_freeable(void) > padata_init(); > page_alloc_init_late(); > /* Initialize page ext after all struct pages are initialized. */ > - page_ext_init(); > + if (!early_page_ext_enabled()) > + page_ext_init(); > > do_basic_setup(); > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > index e5486d47406e..e2faa52cd05d 100644 > --- a/mm/page_alloc.c > +++ b/mm/page_alloc.c > @@ -482,6 +482,8 @@ defer_init(int nid, unsigned long pfn, unsigned long end_pfn) > { > static unsigned long prev_end_pfn, nr_initialised; > > + if (early_page_ext_enabled()) > + return false; > /* > * prev_end_pfn static that contains the end of previous zone > * No need to protect because called very early in boot before smp_init. > diff --git a/mm/page_ext.c b/mm/page_ext.c > index 3dc715d7ac29..6c28d623d951 100644 > --- a/mm/page_ext.c > +++ b/mm/page_ext.c > @@ -85,6 +85,14 @@ unsigned long page_ext_size = sizeof(struct page_ext); > > static unsigned long total_usage; > > +bool early_page_ext __meminitdata; > +static int __init setup_early_page_ext(char *str) > +{ > + early_page_ext = true; > + return 0; > +} > +early_param("early_page_ext", setup_early_page_ext); > + > static bool __init invoke_need_callbacks(void) > { > int i;