From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7C83AEB8FAF for ; Wed, 6 Sep 2023 11:26:23 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0521A280014; Wed, 6 Sep 2023 07:26:20 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 0023D280013; Wed, 6 Sep 2023 07:26:19 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id CD29E280015; Wed, 6 Sep 2023 07:26:19 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id AC7A4280013 for ; Wed, 6 Sep 2023 07:26:19 -0400 (EDT) Received: from smtpin03.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 6FE76C0D91 for ; Wed, 6 Sep 2023 11:26:19 +0000 (UTC) X-FDA: 81205944078.03.99805C5 Received: from mail-wm1-f52.google.com (mail-wm1-f52.google.com [209.85.128.52]) by imf15.hostedemail.com (Postfix) with ESMTP id 9D171A001F for ; Wed, 6 Sep 2023 11:26:17 +0000 (UTC) Authentication-Results: imf15.hostedemail.com; dkim=pass header.d=bytedance.com header.s=google header.b=i5sMbBhp; spf=pass (imf15.hostedemail.com: domain of usama.arif@bytedance.com designates 209.85.128.52 as permitted sender) smtp.mailfrom=usama.arif@bytedance.com; dmarc=pass (policy=quarantine) header.from=bytedance.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1693999577; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=iQ+4wrvPpGZ5a1nklWsXWLvy3+iTY75RmIyUz7pfkEI=; b=b5yudYdxgRYXhwX+kPHeOKukjU/V+mrP2rSAUtJ4GzKru6ZYTZJ05W3ZqfLg7uFhIshpqY 5x9nb5B2L6ynf1hkTEz8KG4EBJFWQQgMuRLv811PUrGmv8umfAMK6DQxOAcfeOXY03wrOC RCOFgpfQdci+pUXggJoAurZ4cuhscDI= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1693999577; a=rsa-sha256; cv=none; b=kUmuglmmN+/lNCNBJ4lIGJHjqT+1QSOdb/mps8cWWbiScwZCYhq3nGeXZHni3fVhyfX8sb SKoB/Ud9FbZRZYeeRz/cDk+xa6j9rXSIqNS1HkoGPxaHllw4ziySaW0oD3llU9osibv/h2 CHTyDDtG0PD6sIrkFphJwLvp0utkBmw= ARC-Authentication-Results: i=1; imf15.hostedemail.com; dkim=pass header.d=bytedance.com header.s=google header.b=i5sMbBhp; spf=pass (imf15.hostedemail.com: domain of usama.arif@bytedance.com designates 209.85.128.52 as permitted sender) smtp.mailfrom=usama.arif@bytedance.com; dmarc=pass (policy=quarantine) header.from=bytedance.com Received: by mail-wm1-f52.google.com with SMTP id 5b1f17b1804b1-401ec23be82so36702575e9.0 for ; Wed, 06 Sep 2023 04:26:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance.com; s=google; t=1693999576; x=1694604376; darn=kvack.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=iQ+4wrvPpGZ5a1nklWsXWLvy3+iTY75RmIyUz7pfkEI=; b=i5sMbBhpWbSUl4PeFFX/CQJWeCKAIxQ2xTNhD1QmAXo5tTHJHCSRZzSk9SG+PPB+Ym Q7Ojxju5xpsW88JdngHi/QG06VVGPyw66nkB0a8SnkjMpKjrbns/ry6UEiJyGPS1qhz/ CU/fz0CTkt+DCU9CR0qFgzGB+lDoA1XVsYT5E6DMn4+v5YLfmgKsiW8ZAOjR/Lo2gv4W aY6c4xpBb9D4nMl1xPIhkO0rgnTeLQ+gEQTh/w0Xzo3nES1PAFYl+NBHPbCOOP1uksla fgxKtEDK3Lnti/IOCYm58j8LEWv3lvcIh81D0q5AmK1+TFwr5wDx50hcpOmXhZxLBQBE tRZA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693999576; x=1694604376; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=iQ+4wrvPpGZ5a1nklWsXWLvy3+iTY75RmIyUz7pfkEI=; b=Uw4dTsiZcb9PC4H+Zl4P9suP20XPiQuyKKyOBB8oV8E9DqPeOlXfOSrzjRQ5zfEK0l ZqC4cqi26Ia5m3jSpN3Ubdu6Ybb1+ZCFn2B4UUdT2N1XBtxuKirlHnBZbVwmMN295YvG YLAgB+ctuOxUyvGTiHo67EUFDjp3aN5UtQIqMKgzqAnLaeN212Ehrne3WjdJzn3rdK+N 9XaflQw5Cge+AxCdqFLG3EVRKZ+i0clX/i3N4KEw3pJ84F/ZHnVYf+MoRLPy+cErTPn1 pRQggBW1dLerPpX3mnNnct8YAurYF5SGaSgUV+Fmf86k4BeeqRqvldUleGl+NU2wqNVC F8zg== X-Gm-Message-State: AOJu0YwJlWwfG5X92NhYPNISKYXADGvWuVxyK1kWx/LdvIbYsXfkU/kl HxDNnaVlGOT1nU8w1N8Tm9kg3FGur7RwC+Rf9zo= X-Google-Smtp-Source: AGHT+IFKTigEzECohyKXcbSiG234lo0AYUo/LW5o7o0IXxyKMwkwe7Dz6DDQAswIExRg7WA4d/Alpg== X-Received: by 2002:a05:600c:ada:b0:3f9:b8df:26ae with SMTP id c26-20020a05600c0ada00b003f9b8df26aemr1895949wmr.34.1693999576050; Wed, 06 Sep 2023 04:26:16 -0700 (PDT) Received: from localhost.localdomain ([2a02:6b6a:b5c7:0:6dce:31d8:efb1:5d81]) by smtp.gmail.com with ESMTPSA id n9-20020a05600c294900b003feff926fc5sm19517038wmd.17.2023.09.06.04.26.15 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 06 Sep 2023 04:26:15 -0700 (PDT) From: Usama Arif To: linux-mm@kvack.org, muchun.song@linux.dev, mike.kravetz@oracle.com, rppt@kernel.org Cc: linux-kernel@vger.kernel.org, songmuchun@bytedance.com, fam.zheng@bytedance.com, liangma@liangbit.com, punit.agrawal@bytedance.com, Usama Arif Subject: [v4 3/4] memblock: introduce MEMBLOCK_RSRV_NOINIT flag Date: Wed, 6 Sep 2023 12:26:04 +0100 Message-Id: <20230906112605.2286994-4-usama.arif@bytedance.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20230906112605.2286994-1-usama.arif@bytedance.com> References: <20230906112605.2286994-1-usama.arif@bytedance.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Stat-Signature: ndi3j8ebn7oztgjtbnqei6wmrwub1twa X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: 9D171A001F X-Rspam-User: X-HE-Tag: 1693999577-401314 X-HE-Meta: U2FsdGVkX1/CtbYzoXs+kXKXvwPPkkaQ7w67xxtQMrE8lvSFdN1Kwrar0e0B+CUBDfiJ3BocXmkh0eLBXFmKS2kBQ0RoFMXc3mbaj9jF6vX0YmT7r+6/IUX7NucQ2gu88qYx2ldrpZXUwh1vnq5layLHxbBAJGmx1JEXAQsCHwgFf5AfjJjj3QlD9WVNCxgFxT0bebCmlC85aKEcOwhaZxLd6L0Jnz58gqp5eQagswlUeBBBfUR9KF8XMBKtft8yIz1xYzJ9fPGBm84PLIRRSbtjEFQXGzisOvT5edyAmnGu8RiiD+qKN4cCEyXSlIK/R8TieuJJyjg+UvE+9tzp1EuU3qqTbQjZrNyJPKhe8cp0pUS/6v81hUkzI3QpYFJDAxvBYDXPU6vBdiMZ1kRd3GaYmwCNAhGx7HzfFzJhq9L4OKRZdb1cnQzKSGOXrLJ6/JYP0CgfKwi1gst2+0m2pW+TwqNs2EueabOlsmGMXcQy41qnWwF6LS+6RiRdsNbVdx4Shv5cjaRhTwMCS5DN/TPiQOAW7L7csS+x7W8QP99NBGQMtk98gR7zjmv/y6WIUUgVE908uIoXt48c+iaKWDW3w72GKvrDR1h9X7soQzdG4O94td5kkQicXHzPhJL6++mI6f2hlwWgS4XHPiqBjqIyTZvVDq/Hvh/gApiwGQb1FKTWxsq65/+punrVnjchUjswL8d2nyUKfGw/cy5JhCttsQ+nom5eouNMcoVQFj5InR0RbqhMQJHUJ7/rmXbiiPLnwZy8ujBJpJ4R1OcYKVMv6h9EoO6Z3Ke9A5XDCPOVRBE58K4aqWX9MFMj9IuZRfRi1EyAVnNK3FiF4TiWwlPwad6BmCMCQ+S4wyOfQjK6CyW3UauttaIJA9ruv330Q/sUfryLmkQUpZyI7pRYSaF9r7UCfpqzBDgnoZyWQjGIlYi1ZyVs2Sv5nk5iamJvxwybctRQBP2rJayuYBA 0qroJ/6t ElJVag12zUCuxmjmR2dq3KjHihsFczVKmcWo4P8xl2IlT2OVvpoClyeno2SVzYXq80dL3n3LIOdJDQR0zGS2p+CW+pz7B2v3d1uLEV7NCpVWgHXYDtGDYrwYROH+Y6YvVCC37BEF8VG490h57P7tkcMPbaftnXfS8wfV5liBh1l1oF03gtx1lnhdGLDRLHG3LBGAt9Pahl2odi1eDv8QeGhqkESNMbEzNACq3GVycbNcNckrGqBAbwmnxSSVe7r7f9pQ7gAKdfrBIOt4MwRyRs0HD99ElDCd595orBAxVyGZ7eHkGN3aNAj3UPE97328gAY7hDbv6hFVHZSFclOB5J4PuZo4O/2wbBrJRtpUW/iDpPcrvv3ZajPYlDjZVkaK8DOB1Fs+ieaj9beN6VKuHmTyCcSFl6VxmzUryktCDSuxFhGG9sDIZhwBo9Q3RTnweJXHBPmfx45/FLrYjN47imk+ivQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: For reserved memory regions marked with this flag, reserve_bootmem_region is not called during memmap_init_reserved_pages. This can be used to avoid struct page initialization for regions which won't need them, for e.g. hugepages with HVO enabled. Signed-off-by: Usama Arif --- include/linux/memblock.h | 9 +++++++++ mm/memblock.c | 33 ++++++++++++++++++++++++++++----- 2 files changed, 37 insertions(+), 5 deletions(-) diff --git a/include/linux/memblock.h b/include/linux/memblock.h index 1c1072e3ca06..ae3bde302f70 100644 --- a/include/linux/memblock.h +++ b/include/linux/memblock.h @@ -40,6 +40,8 @@ extern unsigned long long max_possible_pfn; * via a driver, and never indicated in the firmware-provided memory map as * system RAM. This corresponds to IORESOURCE_SYSRAM_DRIVER_MANAGED in the * kernel resource tree. + * @MEMBLOCK_RSRV_NOINIT: memory region for which struct pages are + * not initialized (only for reserved regions). */ enum memblock_flags { MEMBLOCK_NONE = 0x0, /* No special request */ @@ -47,6 +49,7 @@ enum memblock_flags { MEMBLOCK_MIRROR = 0x2, /* mirrored region */ MEMBLOCK_NOMAP = 0x4, /* don't add to kernel direct mapping */ MEMBLOCK_DRIVER_MANAGED = 0x8, /* always detected via a driver */ + MEMBLOCK_RSRV_NOINIT = 0x10, /* don't initialize struct pages */ }; /** @@ -125,6 +128,7 @@ int memblock_clear_hotplug(phys_addr_t base, phys_addr_t size); int memblock_mark_mirror(phys_addr_t base, phys_addr_t size); int memblock_mark_nomap(phys_addr_t base, phys_addr_t size); int memblock_clear_nomap(phys_addr_t base, phys_addr_t size); +int memblock_reserved_mark_noinit(phys_addr_t base, phys_addr_t size); void memblock_free_all(void); void memblock_free(void *ptr, size_t size); @@ -259,6 +263,11 @@ static inline bool memblock_is_nomap(struct memblock_region *m) return m->flags & MEMBLOCK_NOMAP; } +static inline bool memblock_is_reserved_noinit(struct memblock_region *m) +{ + return m->flags & MEMBLOCK_RSRV_NOINIT; +} + static inline bool memblock_is_driver_managed(struct memblock_region *m) { return m->flags & MEMBLOCK_DRIVER_MANAGED; diff --git a/mm/memblock.c b/mm/memblock.c index a49efbaee7e0..8f7a0cb668d4 100644 --- a/mm/memblock.c +++ b/mm/memblock.c @@ -996,6 +996,24 @@ int __init_memblock memblock_clear_nomap(phys_addr_t base, phys_addr_t size) return memblock_setclr_flag(&memblock.memory, base, size, 0, MEMBLOCK_NOMAP); } +/** + * memblock_reserved_mark_noinit - Mark a reserved memory region with flag + * MEMBLOCK_RSRV_NOINIT which results in the struct pages not being initialized + * for this region. + * @base: the base phys addr of the region + * @size: the size of the region + * + * struct pages will not be initialized for reserved memory regions marked with + * %MEMBLOCK_RSRV_NOINIT. + * + * Return: 0 on success, -errno on failure. + */ +int __init_memblock memblock_reserved_mark_noinit(phys_addr_t base, phys_addr_t size) +{ + return memblock_setclr_flag(&memblock.reserved, base, size, 1, + MEMBLOCK_RSRV_NOINIT); +} + static bool should_skip_region(struct memblock_type *type, struct memblock_region *m, int nid, int flags) @@ -2112,13 +2130,18 @@ static void __init memmap_init_reserved_pages(void) memblock_set_node(start, end, &memblock.reserved, nid); } - /* initialize struct pages for the reserved regions */ + /* + * initialize struct pages for reserved regions that don't have + * the MEMBLOCK_RSRV_NOINIT flag set + */ for_each_reserved_mem_region(region) { - nid = memblock_get_region_node(region); - start = region->base; - end = start + region->size; + if (!memblock_is_reserved_noinit(region)) { + nid = memblock_get_region_node(region); + start = region->base; + end = start + region->size; - reserve_bootmem_region(start, end, nid); + reserve_bootmem_region(start, end, nid); + } } } -- 2.25.1