From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 61783C4167B for ; Tue, 28 Nov 2023 03:18:57 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D2DAD6B02B3; Mon, 27 Nov 2023 22:18:56 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id CDD896B02E9; Mon, 27 Nov 2023 22:18:56 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BA5636B02ED; Mon, 27 Nov 2023 22:18:56 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id AB6506B02B3 for ; Mon, 27 Nov 2023 22:18:56 -0500 (EST) Received: from smtpin29.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id 7EAF51C00A2 for ; Tue, 28 Nov 2023 03:18:56 +0000 (UTC) X-FDA: 81505906272.29.C003101 Received: from mail-pl1-f177.google.com (mail-pl1-f177.google.com [209.85.214.177]) by imf16.hostedemail.com (Postfix) with ESMTP id A0AA3180020 for ; Tue, 28 Nov 2023 03:18:53 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=pass header.d=bytedance.com header.s=google header.b=PxjBKyH7; spf=pass (imf16.hostedemail.com: domain of ligang.bdlg@bytedance.com designates 209.85.214.177 as permitted sender) smtp.mailfrom=ligang.bdlg@bytedance.com; dmarc=pass (policy=quarantine) header.from=bytedance.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1701141534; a=rsa-sha256; cv=none; b=jH/KBCDLBEEwbzIoiV76IGfpQfLncE2wY1VecRHN4jIQKI3LHSfcF2QiwApeKeNtwwzpdU 7EGiS4ALITYpAXMwL71Ye9niODHUa+4zhFjAHtIxY2VdoIw7HnKr4tWOoVs8hMHIVyAABi b7q2bALDH6f1kvrGJjqwnHR87kZ1McU= ARC-Authentication-Results: i=1; imf16.hostedemail.com; dkim=pass header.d=bytedance.com header.s=google header.b=PxjBKyH7; spf=pass (imf16.hostedemail.com: domain of ligang.bdlg@bytedance.com designates 209.85.214.177 as permitted sender) smtp.mailfrom=ligang.bdlg@bytedance.com; dmarc=pass (policy=quarantine) header.from=bytedance.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1701141534; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=aNAGTjDRK2uz3X+viYd2HPrnhIXsIDutv38NEyAwfLU=; b=UeahTigwpPrAea6SuNZ8lRFds8Vp3lotlgD0T3Ptw250vEhw3NjE+3TTMLE/RymOTDvEkt 8t1Ih597S/UIvGK8sfm0AS2t3KU+AUP7lBZcKolYuuQXFgoHvDV2XVwVrsS0zSSeRtF8rj PsZC2zlaE0xbtZcHLyt1odwNcaTSYZo= Received: by mail-pl1-f177.google.com with SMTP id d9443c01a7336-1ce28faa92dso38134535ad.2 for ; Mon, 27 Nov 2023 19:18:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance.com; s=google; t=1701141532; x=1701746332; darn=kvack.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=aNAGTjDRK2uz3X+viYd2HPrnhIXsIDutv38NEyAwfLU=; b=PxjBKyH7L7fpGhtlaoIMD/sAYB53Ewyz/y/TkvHgqyJM8UekQwQiaLNH57t9zpDygh 7UrY/4JS2zOhJKk5YzSLrq08ErhZZVRDWkudN2q7kcKoDo+Uch43uyesqp/6fLUYqPp8 MGoZr6RpCGdD299ceybsHrzCQrvZVjDnUS3wQH7OLuPTbgAgYVcNPoFT+seq8KYOZL2D VC41S38QBlg9TT0YnbXsK6j4lw4GqChnLtsBhn0YZzUNWVqr+wgrgkMZHrEsIm6UUafp /pXNR8nsSow4K2ywWZ7V3KzFFKOazAfaPLv7dCk0mKA2mxs062r7wf5AgRFjbZ1/D2Pt P7Xg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1701141532; x=1701746332; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=aNAGTjDRK2uz3X+viYd2HPrnhIXsIDutv38NEyAwfLU=; b=ii8dklzyoaJ/iqjQnuPNjpYZKLu2qCCXdxSHlXz/4ii8g3eu2oHUEolX11ygfaQK1y 7phxkBPN28o5AEGXgfezzhhFayb3lRLM8aCh4W9r6MVPGjDYZiTHlJ+i96p7TB9O6Kp2 +86gtT1p6R9cIIYygIra6FKoRTUb7ioU0cqP5RLB1kkNAjgSCRLgfzgjumKOs13LzQQB h0B1EayX0L5qY7DUR/1PiVAh070TTHgkHKIlAIcYGyIuJQeJ0HnYxaypdc1cB7p3aSxL VE2SAIJLxHOtSKwkpsC1miB99tYUnMDeNEjEfibt0zM4pada8iBJptGsE5uCcLRN4RWc kVaA== X-Gm-Message-State: AOJu0Yy/IJAcxqyBfRg9FhS+pFFEmzDfu0tQ2xOl0lrvVGAyqKOfr7HO QqicXRd2YIEry0/opCs8UC5MGw== X-Google-Smtp-Source: AGHT+IEU2v6RHw7nOwM2iEsqET1AbJ+q4/VVGdLzlV2v8RO/RggvDpt1YEjOrqGTGgVyw8E5nkDCXg== X-Received: by 2002:a17:903:2308:b0:1ce:6312:5373 with SMTP id d8-20020a170903230800b001ce63125373mr14356179plh.0.1701141532190; Mon, 27 Nov 2023 19:18:52 -0800 (PST) Received: from [10.4.104.221] ([139.177.225.238]) by smtp.gmail.com with ESMTPSA id h4-20020a170902f54400b001cfca674329sm3140094plf.90.2023.11.27.19.18.49 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 27 Nov 2023 19:18:51 -0800 (PST) Message-ID: Date: Tue, 28 Nov 2023 11:18:46 +0800 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [RFC PATCH v1 0/4] hugetlb: parallelize hugetlb page allocation on boot Content-Language: en-US To: David Rientjes , David Hildenbrand Cc: Gang Li , Mike Kravetz , Muchun Song , Andrew Morton , linux-mm@kvack.org, linux-kernel@vger.kernel.org References: <20231123133036.68540-1-gang.li@linux.dev> <5c0e27f2-5826-4537-a1ab-1debfab65b9a@redhat.com> <28e28c2a-e72d-a181-e87a-39cecc8c3c76@google.com> <9d5de524-28ee-4d71-9493-f77967ea213c@redhat.com> <783f8bac-55b8-5b95-eb6a-11a583675000@google.com> From: Gang Li In-Reply-To: <783f8bac-55b8-5b95-eb6a-11a583675000@google.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: A0AA3180020 X-Stat-Signature: dnjufpaseaxsimpukbzfhf9qa83adhqp X-Rspam-User: X-HE-Tag: 1701141533-932006 X-HE-Meta: U2FsdGVkX1/8g4Eq4C3joKst6gEDhYIfBAeBCOpV7N7y+4rn9XVL19TSXTIphobu3m7L0F+sTguxaycWQkt1y7XNfdba0rJFYacJQkKuVxhxrG/cTBLDySt3hwF+z7fssfBNP4vrbsLPz7UnCHVsEAveHeIBWNWA5HOHu/4YTLXQfQoyp33lcPfea0aAgfXy6vf/IuhQnfwp2Y+Nqp9+HIl/Sp/vuo19ZfPWDIgHAwROCkBtfW1ZQmWYKn/tkDTiWp4f+KulvJoMh+IcmeQUnZ8ImOKI89rQ3aqVJfhlet46xqEj73bdbXSRKNiF4L39U4O7VHlOkH8fHPdS0aUJf1X42Fwiz/Xe1haUqyERgdOUMvmJJSNcfZpjOPrrCEC/88nPhr+iUCusk7BqcSGc0nd+XUrbvxJqFV5hmdpEKqXk8WIRwOwThMMGhjmO4qMXzIPOCBSrn5VcJAOyb4k31HalFmHfnrkyItl/2ZZRJ8eVrxSLZtQfymmq9qPAk5oYijf7Wy85Vs3txBByHMRsTYKIWhRmR1P3p675XRapmH4szqUp5D3hq61KzaawlQjhOOqq6Zd1kUX+PuBOLUPwvhxQLU8XBIv32aBLO8zz+Rktxtgebi8L4saRCErxxPngwtxqTok2tIOjbF2ZSt3zVWfpOCi5ZhZztCFAROuYVfNsFcpvJ5EAwhSrhRzxJBUrkxSxGhWzr9AA9TjbFJXWqB50t80UkfW5TAhPO84jqT/+wVonUgUffrBRKDQufNLY3YAmup6gYDGP906xoqUkboSki4k1fyZCN0E4mfoBiU+7/v7ZqDcQ67tmZe63RpIHiVMdmPvFnTRuLB0Cy+D8njVIowB/iTKkXHOPnN6RRJV42ga/OHQf7JnSDymszr/Bj8SkFoy+vHvsxQyglO7x/ZdIExdS4vG1NeUfxUE6mn9xvf52cZmLR6s6Cgz94pmIvAiLmPGRYQkMOmCySf2 mVW84E/t hMKLJeT7QQZaKxe+u7+pqPwYZT604unZM3FdjVdD7hc91UDtsYdA89a8T9C4pg+tdbkFlMC9XfZmslX50guJbp+n3mCaVM7sMRygT58oLTMjWA3nXGP2i34FrRzkRSE320M3M1OE1ii48TRMAIHjmuvC5R7EjerKzYh66XvVzT+Bv5oKRPg2BXRgXRx296RKB6Gp6GL/7yC2AErghVXNQUakWh2KyRJdcTyj6IolOk3/Y5DkJ/YVX0mWk2dJX2iAaKGv82ka0nXFKubc4nI9MTXRVz86NHXQUASWF8w11H6uYAQbrGwDDkTuhXknHI+CDAlVIM7AvqgtDQy0Vu4DoKCpYtIFmeFGMfHLSBUrk67QJQeRDdvY6QVzI4O7F+WeR7dQxUts+fgoXFtkFDK/N6J4BNR/4HZ+kvO6XAJ4Kf2LdE2A= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 2023/11/25 04:00, David Rientjes wrote: > On Fri, 24 Nov 2023, David Hildenbrand wrote: > >> And there, the 65.2s won't be noise because that 12TB system is up by a snap >> of a finger? :) >> > > In this single boot test, total boot time was 373.78s, so 1GB hugetlb > allocation is 17.4% of that. Thank you for sharing these data. Currently, I don't have access to a machine of such large capacity, so the benefits in my tests are not as pronounced. I believe testing on a system of this scale would yield significant benefits. > > Would love to see what the numbers would look like if 1GB pages were > supported. > Support for 1GB hugetlb is not yet perfect, so it wasn't included in v1. But I'm happy to refine and introduce 1GB hugetlb support in future versions.