From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0B0B1C433E0 for ; Mon, 8 Mar 2021 10:30:48 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 5C7646512F for ; Mon, 8 Mar 2021 10:30:47 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5C7646512F Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=bytedance.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id DD9188D0012; Mon, 8 Mar 2021 05:30:46 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id D884E8D000F; Mon, 8 Mar 2021 05:30:46 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BB42B8D0012; Mon, 8 Mar 2021 05:30:46 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0070.hostedemail.com [216.40.44.70]) by kanga.kvack.org (Postfix) with ESMTP id 9D92C8D000F for ; Mon, 8 Mar 2021 05:30:46 -0500 (EST) Received: from smtpin15.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with ESMTP id 5F26C8249980 for ; Mon, 8 Mar 2021 10:30:46 +0000 (UTC) X-FDA: 77896338492.15.EF91EE7 Received: from mail-pj1-f42.google.com (mail-pj1-f42.google.com [209.85.216.42]) by imf24.hostedemail.com (Postfix) with ESMTP id 1767FA0009DE for ; Mon, 8 Mar 2021 10:30:42 +0000 (UTC) Received: by mail-pj1-f42.google.com with SMTP id j14-20020a17090a588eb02900cefe2daa2cso1206461pji.0 for ; Mon, 08 Mar 2021 02:30:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=pi8muCvZVllAVCnyVEL0G4NWBwvpjkgAMqOjInVB5Rs=; b=m1DYIpUIdXYvOmeam2IaF1ERCJFhbpXPO7mFrO5AX+Qx6zGA/6W9GLTKH9yQAKqOqZ f7SQBMW4ko5ozaKJ7E47yNLdRhQhASjXntciReMid+QnzJ9JwaN0CxUYqS4dJibN5HOw k8TuYMLzOIgDB289mG7wSoADafEUmPPDeM+bq/REwrUV4BznVbKMAJ5EnlDu4ejKAsN9 joGV3VC2YR67izYXzEH1KWIb1Npn1+Ju9OD6kNWfstyX+HnTrfcLvTTgs37j++CXyHZk ZANspXfya0XiI2ip274nslHwgfDmtAd/tcecX86RR6B6FMN30pgHOG62RhGOczlZk58E LWBw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=pi8muCvZVllAVCnyVEL0G4NWBwvpjkgAMqOjInVB5Rs=; b=EmvUDpaak7lgQxViaj4DOfIu7LPiy3+jq/7dFTuyAlo3qf2ea0yd4mtgYwL7U6d4cY gkht9smlXVKPvIqGDX6a5GCNtS1WvIPaooHLJjzMxM2y5xKc3kXQ9ww+UNgzGnCUjVUk nR570zJbC4iY0SmMZJD7DUDhLa0hFRGxNLu9z7w4Tl+Tpnq7iYxACeLo0kPKt4OZns4h 2cRnBS2ZzXkc0o8poD7q6QoRRlPJGLgZMGQ+bTQZUw+qL83FjfdqRmKRJPQcfJL8ZpUV 5/X2eDXiTg3jH7zTdJhB41XdJag+t6U6G2vyRx2hZLMk2zuQZe3WtBx8bjFUtAwlsTcE zV7w== X-Gm-Message-State: AOAM532Ik1Vz0ZCh9wz0WBtxdrIkWJEZTKbK56VI65X0j4rNzbakRSyY arg/b5/CW/ACHrQ/qvhax3FZQw== X-Google-Smtp-Source: ABdhPJxj5tSQfanstZ9wIIAYIVMr4T8+owGM68HM35oumBr8VyX3BhDSWk8EQQyLKDEHuMMBnQco+A== X-Received: by 2002:a17:90a:8901:: with SMTP id u1mr23617449pjn.21.1615199445087; Mon, 08 Mar 2021 02:30:45 -0800 (PST) Received: from localhost.localdomain ([139.177.225.255]) by smtp.gmail.com with ESMTPSA id ge16sm10744705pjb.43.2021.03.08.02.30.32 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 08 Mar 2021 02:30:44 -0800 (PST) From: Muchun Song To: corbet@lwn.net, mike.kravetz@oracle.com, tglx@linutronix.de, mingo@redhat.com, bp@alien8.de, x86@kernel.org, hpa@zytor.com, dave.hansen@linux.intel.com, luto@kernel.org, peterz@infradead.org, viro@zeniv.linux.org.uk, akpm@linux-foundation.org, paulmck@kernel.org, mchehab+huawei@kernel.org, pawan.kumar.gupta@linux.intel.com, rdunlap@infradead.org, oneukum@suse.com, anshuman.khandual@arm.com, jroedel@suse.de, almasrymina@google.com, rientjes@google.com, willy@infradead.org, osalvador@suse.de, mhocko@suse.com, song.bao.hua@hisilicon.com, david@redhat.com, naoya.horiguchi@nec.com, joao.m.martins@oracle.com Cc: duanxiongchun@bytedance.com, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, Muchun Song , Miaohe Lin , Chen Huang , Bodeddula Balasubramaniam , Balbir Singh Subject: [PATCH v18 2/9] mm: hugetlb: introduce a new config HUGETLB_PAGE_FREE_VMEMMAP Date: Mon, 8 Mar 2021 18:28:00 +0800 Message-Id: <20210308102807.59745-3-songmuchun@bytedance.com> X-Mailer: git-send-email 2.21.0 (Apple Git-122) In-Reply-To: <20210308102807.59745-1-songmuchun@bytedance.com> References: <20210308102807.59745-1-songmuchun@bytedance.com> MIME-Version: 1.0 X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: 1767FA0009DE X-Stat-Signature: y3qg9u9sbbs8tmthnkzkmznf8p6dhxut Received-SPF: none (bytedance.com>: No applicable sender policy available) receiver=imf24; identity=mailfrom; envelope-from=""; helo=mail-pj1-f42.google.com; client-ip=209.85.216.42 X-HE-DKIM-Result: pass/pass X-HE-Tag: 1615199442-421429 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: The option HUGETLB_PAGE_FREE_VMEMMAP allows for the freeing of some vmemmap pages associated with pre-allocated HugeTLB pages. For example, on X86_64 6 vmemmap pages of size 4KB each can be saved for each 2MB HugeTLB page. 4094 vmemmap pages of size 4KB each can be saved for each 1GB HugeTLB page. When a HugeTLB page is allocated or freed, the vmemmap array representing the range associated with the page will need to be remapped. When a page is allocated, vmemmap pages are freed after remapping. When a page is freed, previously discarded vmemmap pages must be allocated before remapping. The config option is introduced early so that supporting code can be written to depend on the option. The initial version of the code only provides support for x86-64. Like other code which frees vmemmap, this config option depends on HAVE_BOOTMEM_INFO_NODE. The routine register_page_bootmem_info() is used to register bootmem info. Therefore, make sure register_page_bootmem_info is enabled if HUGETLB_PAGE_FREE_VMEMMAP is defined. Signed-off-by: Muchun Song Reviewed-by: Oscar Salvador Acked-by: Mike Kravetz Reviewed-by: Miaohe Lin Tested-by: Chen Huang Tested-by: Bodeddula Balasubramaniam Reviewed-by: Balbir Singh --- arch/x86/mm/init_64.c | 2 +- fs/Kconfig | 6 ++++++ 2 files changed, 7 insertions(+), 1 deletion(-) diff --git a/arch/x86/mm/init_64.c b/arch/x86/mm/init_64.c index 0a45f062826e..0435bee2e172 100644 --- a/arch/x86/mm/init_64.c +++ b/arch/x86/mm/init_64.c @@ -1225,7 +1225,7 @@ static struct kcore_list kcore_vsyscall; =20 static void __init register_page_bootmem_info(void) { -#ifdef CONFIG_NUMA +#if defined(CONFIG_NUMA) || defined(CONFIG_HUGETLB_PAGE_FREE_VMEMMAP) int i; =20 for_each_online_node(i) diff --git a/fs/Kconfig b/fs/Kconfig index eccbcf1e3f2e..b5dcc68aab25 100644 --- a/fs/Kconfig +++ b/fs/Kconfig @@ -237,6 +237,12 @@ config HUGETLBFS config HUGETLB_PAGE def_bool HUGETLBFS =20 +config HUGETLB_PAGE_FREE_VMEMMAP + def_bool HUGETLB_PAGE + depends on X86_64 + depends on SPARSEMEM_VMEMMAP + depends on HAVE_BOOTMEM_INFO_NODE + config MEMFD_CREATE def_bool TMPFS || HUGETLBFS =20 --=20 2.11.0