From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.5 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 14F4CC11F67 for ; Wed, 14 Jul 2021 03:10:06 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id AB0D06138C for ; Wed, 14 Jul 2021 03:10:05 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org AB0D06138C Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=chromium.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id BBA776B0092; Tue, 13 Jul 2021 23:10:05 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id B6B956B0095; Tue, 13 Jul 2021 23:10:05 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id A0A806B0096; Tue, 13 Jul 2021 23:10:05 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0084.hostedemail.com [216.40.44.84]) by kanga.kvack.org (Postfix) with ESMTP id 7EC076B0092 for ; Tue, 13 Jul 2021 23:10:05 -0400 (EDT) Received: from smtpin04.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with ESMTP id 74BF11855DEEA for ; Wed, 14 Jul 2021 03:10:04 +0000 (UTC) X-FDA: 78359714328.04.938D007 Received: from mail-pg1-f171.google.com (mail-pg1-f171.google.com [209.85.215.171]) by imf10.hostedemail.com (Postfix) with ESMTP id 1F7DA60019A5 for ; Wed, 14 Jul 2021 03:10:03 +0000 (UTC) Received: by mail-pg1-f171.google.com with SMTP id y17so845635pgf.12 for ; Tue, 13 Jul 2021 20:10:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chromium.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=0Jd8IZTQd2Xo6YcQuTq7axTVaDs+ebyxKHsj9sYi5wk=; b=TAcm7bx0cV65HGTmGl9RI4K8frOjQp3vH6tMqdpPabG1i5GqiK71GSHaEFQQvSjyYK s1EAPWrcypdEuKekGs3TwuS0GVWwZ3mBYVOF7p1JeLR5NKXtgtFLJg/NgL58bHIolLhH 5wmP22T5MPZ+lMRoN3boZeFBeuWFnVpHYPSjc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=0Jd8IZTQd2Xo6YcQuTq7axTVaDs+ebyxKHsj9sYi5wk=; b=qJe9Wugv+JSLT5Wlh3PvgnXvuVIUnhgMP68PSXVQE48EnTsHwxJ3BZmZ9Ks3OFkOGA ryPmiBMUhttnlJWlkwvQM2C5qNtJDw/6iFmRXurPZw54vdeM90hAl34zkG84nxwsl2rZ /CcB1OWYzavh9DzocIF8hTT9D+Q3LzUgK/QvK0wStnVzIrL0uWY0VRk7PJFghFPYFi2O lxxDZvJj53t3lhMlT0OsqlTqlnLPtjX//NQRxGxrx0+kVih3z7ZRvyaDlrOac6mElLJD SmeBv6g1EPyKa67NLaR0NhZ5PlbEwBOUzEstdpBbuAWss8Z20YO8vlsBPspV51XuMEIe 90DA== X-Gm-Message-State: AOAM53258lK1MeebPqctJUWyAMjoLyjkD0ynDlzCImM7MQbg1RcplsQr JahXTaLi3B5GpNV3ZpF6oY3DWA== X-Google-Smtp-Source: ABdhPJwXDrW9T0QbuKSZNzx6cpmaP+iYIbNR7ehR2k2xKhMmc5Oz0c7TnNyO/o5N/PpmJO+Ha6yVvw== X-Received: by 2002:a63:405:: with SMTP id 5mr7300613pge.132.1626232203008; Tue, 13 Jul 2021 20:10:03 -0700 (PDT) Received: from www.outflux.net (smtp.outflux.net. [198.145.64.163]) by smtp.gmail.com with ESMTPSA id cx4sm4258976pjb.53.2021.07.13.20.10.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 13 Jul 2021 20:10:02 -0700 (PDT) Date: Tue, 13 Jul 2021 20:10:01 -0700 From: Kees Cook To: Sergei Trofimovich Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, Andrew Morton , Alexander Potapenko , Thomas Gleixner , Vlastimil Babka , bowsingbetee@pm.me Subject: Re: [PATCH] mm: page_alloc: fix page_poison=1 / INIT_ON_ALLOC_DEFAULT_ON interaction Message-ID: <202107131953.BB3627156@keescook> References: <20210712005732.4f9bfa78@zn3> <20210712215816.1512739-1-slyfox@gentoo.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210712215816.1512739-1-slyfox@gentoo.org> Authentication-Results: imf10.hostedemail.com; dkim=pass header.d=chromium.org header.s=google header.b=TAcm7bx0; spf=pass (imf10.hostedemail.com: domain of keescook@chromium.org designates 209.85.215.171 as permitted sender) smtp.mailfrom=keescook@chromium.org; dmarc=pass (policy=none) header.from=chromium.org X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: 1F7DA60019A5 X-Stat-Signature: wugqjyjbq1hobqtpoe7fyn44yhng77cw X-HE-Tag: 1626232203-340328 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Mon, Jul 12, 2021 at 10:58:16PM +0100, Sergei Trofimovich wrote: > To reproduce the failure we need the following system: > - kernel command: page_poison=1 init_on_free=0 init_on_alloc=0 > - kernel config: > * CONFIG_INIT_ON_ALLOC_DEFAULT_ON=y > * CONFIG_INIT_ON_FREE_DEFAULT_ON=y > * CONFIG_PAGE_POISONING=y > > 0000000085629bdd: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ > 0000000022861832: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ > 00000000c597f5b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ > CPU: 11 PID: 15195 Comm: bash Kdump: loaded Tainted: G U O 5.13.1-gentoo-x86_64 #1 > Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 2801 01/13/2021 > Call Trace: > dump_stack+0x64/0x7c > __kernel_unpoison_pages.cold+0x48/0x84 > post_alloc_hook+0x60/0xa0 > get_page_from_freelist+0xdb8/0x1000 > __alloc_pages+0x163/0x2b0 > __get_free_pages+0xc/0x30 > pgd_alloc+0x2e/0x1a0 > ? dup_mm+0x37/0x4f0 > mm_init+0x185/0x270 > dup_mm+0x6b/0x4f0 > ? __lock_task_sighand+0x35/0x70 > copy_process+0x190d/0x1b10 > kernel_clone+0xba/0x3b0 > __do_sys_clone+0x8f/0xb0 > do_syscall_64+0x68/0x80 > ? do_syscall_64+0x11/0x80 > entry_SYSCALL_64_after_hwframe+0x44/0xae > > Before the 51cba1eb ("init_on_alloc: Optimize static branches") > init_on_alloc never enabled static branch by default. It could > only be enabed explicitly by init_mem_debugging_and_hardening(). But init_mem_debugging_and_hardening() is always called (by mm_init()). > But after the 51cba1eb static branch could already be enabled > by default. There was no code to ever disable it. That caused > page_poison=1 / init_on_free=1 conflict. > > This change extends init_mem_debugging_and_hardening() to also > disable static branch disabling. > > CC: Andrew Morton > CC: Kees Cook > CC: Alexander Potapenko > CC: Thomas Gleixner > CC: Vlastimil Babka > CC: linux-mm@kvack.org > Reported-by: bowsingbetee@pm.me > Reported-by: Mikhail Morfikov > Fixes: 51cba1eb ("init_on_alloc: Optimize static branches") > Signed-off-by: Sergei Trofimovich > --- > mm/page_alloc.c | 16 ++++++++++------ > 1 file changed, 10 insertions(+), 6 deletions(-) > > diff --git a/mm/page_alloc.c b/mm/page_alloc.c > index 3b97e17806be..46cb4a9c2b50 100644 > --- a/mm/page_alloc.c > +++ b/mm/page_alloc.c > @@ -840,18 +840,22 @@ void init_mem_debugging_and_hardening(void) > } > #endif > > - if (_init_on_alloc_enabled_early) { > - if (page_poisoning_requested) > + if (_init_on_alloc_enabled_early || > + IS_ENABLED(CONFIG_INIT_ON_ALLOC_DEFAULT_ON)) { This doesn't look right. _init_on_alloc_enabled_early already has the same value: static bool _init_on_alloc_enabled_early __read_mostly = IS_ENABLED(CONFIG_INIT_ON_ALLOC_DEFAULT_ON); So checking this is just a side-effect of how static_branch_maybe() happens to be behaving. > + if (page_poisoning_requested) { > pr_info("mem auto-init: CONFIG_PAGE_POISONING is on, " > "will take precedence over init_on_alloc\n"); > - else > + static_branch_disable(&init_on_alloc); > + } else > static_branch_enable(&init_on_alloc); > } > - if (_init_on_free_enabled_early) { > - if (page_poisoning_requested) > + if (_init_on_free_enabled_early || > + IS_ENABLED(CONFIG_INIT_ON_FREE_DEFAULT_ON)) { > + if (page_poisoning_requested) { > pr_info("mem auto-init: CONFIG_PAGE_POISONING is on, " > "will take precedence over init_on_free\n"); > - else > + static_branch_disable(&init_on_free); > + } else > static_branch_enable(&init_on_free); > } I think it would be better to clean this up without additional confusion involving the CONFIGs: diff --git a/mm/page_alloc.c b/mm/page_alloc.c index 3b97e17806be..1f19365bc158 100644 --- a/mm/page_alloc.c +++ b/mm/page_alloc.c @@ -840,21 +840,24 @@ void init_mem_debugging_and_hardening(void) } #endif - if (_init_on_alloc_enabled_early) { - if (page_poisoning_requested) - pr_info("mem auto-init: CONFIG_PAGE_POISONING is on, " - "will take precedence over init_on_alloc\n"); - else - static_branch_enable(&init_on_alloc); - } - if (_init_on_free_enabled_early) { - if (page_poisoning_requested) - pr_info("mem auto-init: CONFIG_PAGE_POISONING is on, " - "will take precedence over init_on_free\n"); - else - static_branch_enable(&init_on_free); + if ((_init_on_alloc_enabled_early || _init_on_free_enabled_early) && + page_poisoning_requested) { + pr_info("mem auto-init: CONFIG_PAGE_POISONING is on, " + "will take precedence over init_on_alloc and init_on_free\n"); + _init_on_alloc_enabled_early = false; + _init_on_free_enabled_early = false; } + if (_init_on_alloc_enabled_early) + static_branch_enable(&init_on_alloc); + else + static_branch_disable(&init_on_alloc); + + if (_init_on_free_enabled_early) + static_branch_enable(&init_on_free); + else + static_branch_disable(&init_on_free); + #ifdef CONFIG_DEBUG_PAGEALLOC if (!debug_pagealloc_enabled()) return; -- Kees Cook