From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id E46D3C41513 for ; Mon, 16 Oct 2023 06:35:06 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 2A9526B011B; Mon, 16 Oct 2023 02:35:06 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 230516B011C; Mon, 16 Oct 2023 02:35:06 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 0D5756B011D; Mon, 16 Oct 2023 02:35:06 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id EA7DB6B011B for ; Mon, 16 Oct 2023 02:35:05 -0400 (EDT) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id B5B2340AE0 for ; Mon, 16 Oct 2023 06:35:05 +0000 (UTC) X-FDA: 81350362170.11.6A8D51A Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by imf18.hostedemail.com (Postfix) with ESMTP id 071FC1C0012 for ; Mon, 16 Oct 2023 06:35:03 +0000 (UTC) Authentication-Results: imf18.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=jstQ79TM; dmarc=pass (policy=none) header.from=kernel.org; spf=pass (imf18.hostedemail.com: domain of rppt@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=rppt@kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1697438104; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=G+n5geDoowj133AJ4mnGHi0Dfzf+JKR+JrW9lDJyDdQ=; b=p/H/bz7eeGqg9jCdzN++dQ44g6R4mYqwK6fGcEt6/yJVmRG9zP8QQR0AoNOs2gaIigFYQA oP0HcypPXgjItPOLXlH+vxmSKzNekFdyC6Iwr1tDPUz9QB/EBmJnl1zA0+gJzjKbdWQGcQ FGVhRKPgvkSVSYV04c08GXvkcLULH+4= ARC-Authentication-Results: i=1; imf18.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=jstQ79TM; dmarc=pass (policy=none) header.from=kernel.org; spf=pass (imf18.hostedemail.com: domain of rppt@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=rppt@kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1697438104; a=rsa-sha256; cv=none; b=Q60gaIuE0aNyq0yTPC0UASs4q1lD5fuGF0+5aYOxSTUbiBhCWam4Tq6k6jPVErdJjTIXJj kHrxfHOjQd0iBoBNDhQy7v8RksJmQ+t/90cuxdsM96z1hpPpACVtssAjilpuPZGu1jUzd4 AglIwNmLPFdBwvC/LxWdpZA6NtzWuzc= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id 1465760C5F; Mon, 16 Oct 2023 06:35:03 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id C9292C433C9; Mon, 16 Oct 2023 06:34:59 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1697438102; bh=h7+mxeWvHopjpfHs2M8yjcff71cFlFkVRyP3Nk6y5ug=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=jstQ79TMlhwJYum7iRHmZ3sYsFdhRBmZNHatoTTONDq4i2VQqXW4b1vYrdUg/4W4D tlcZBRLmwsoxhCxp2qZ1j72B+TV1FNXpWTD05OpkfF4MNLn1I3OjkCatEbRfabkrdw xmSZi6ogdkNHGS/Qoiahu87CmPpHSDzkUNceJ1o3/NlM2gpdleDNJrUK73R+snwRKt 37IBhXMSnmeXRRg+FfbxX5WojUbiHSneflTGBGzRToWbiQ2Qsr07mGm9CQMau4f7RK 16wgGzy6tVlgGlc6D3sxIERes1x6pjk9mh9x6XwGZLEMggjmILqnLoXBLsgbvC11f6 cr4DtyhYP+exA== Date: Mon, 16 Oct 2023 09:33:57 +0300 From: Mike Rapoport To: Yajun Deng Cc: David Hildenbrand , akpm@linux-foundation.org, mike.kravetz@oracle.com, muchun.song@linux.dev, willy@infradead.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH v4 2/2] mm: Init page count in reserve_bootmem_region when MEMINIT_EARLY Message-ID: <20231016063357.GU3303@kernel.org> References: <20230928083302.386202-1-yajun.deng@linux.dev> <20230928083302.386202-3-yajun.deng@linux.dev> <20230929083018.GU3303@kernel.org> <2f8c4741-5c7f-272d-9cef-9fda9fbc7ca6@linux.dev> <5382bf2d-5aa0-1498-8169-3248be4b5af3@linux.dev> <38cd0cb9-efe9-b98a-2768-ccb48da8b812@linux.dev> <20231013084827.GT3303@kernel.org> <1c91dd62-886d-bb05-8aee-22191a8a2d8e@linux.dev> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <1c91dd62-886d-bb05-8aee-22191a8a2d8e@linux.dev> X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: 071FC1C0012 X-Stat-Signature: h19zfwg8w7mf1yz77zcpggf41bphko8x X-Rspam-User: X-HE-Tag: 1697438103-163593 X-HE-Meta: U2FsdGVkX19GOMuOmz3ZbHhf5AZDgb+BHYDkHsPE56+7VpcK0CHDXzH5N7k0X5clVb/vJ/HIo9YV9NEnbyR6qS059KwgQdAEgGSBEJDzG1+/SNHBdMMPZw+nENcfgPsrB8EA2UqCqwjMTV8mdtaIloitAs7OctNoFVk/V4tTTy4VHvw+qL1PXIt8nBJuq1SUVp1YeRJr0RrLIkXVBEeMPOw0H7Ee2I6sb4kgD95Ini60VZeqE9gX8CqJHAwg9S0N1nCZjpHlpCF6lqXXqgeaX+/IcRnzMNnGs3uw+VRLXyzsk9O7D1jEjZo72/aK2qCsq3WaoCbX9ckJbKNZOpzG/dU0YFHomzCVg5FwHiVnhZfXGOgaub1Qm9T9YiPVBXS0aH8lW72GNvfofG5GDmX+ihR+Fb6YQlGzW5Fo4yrdtxW+3V6xT0vMqti2fis/i4fYzKiNFPX6n1RWiJzTQhrPsDZJ87HZY1Me4/diESVE1qqIPC1g4kCk5OXdC8WqsSXgS/qBZcvG/Gu84LVXMiIpB0w4eRpWJWVpjRO/KfverueMGRT/rTEbScyxrw3pKXOqDMG/cy6C3iIavZktzGSxiHuEnXybBTwqXd+7mIuJ5ZlfxVkeL4kFrzzrf5r9on3mbaIBOsBpU3Jwi6C5Kj99sBEH89xGeuyGnPA+wn8z6/cT9mHkPShTPUghnt9lSyuvETSSQSr5dAtZOj9HcvndtoLmakQxZg5WSnPEHP2/HwjH8WCXUfxFwVMFvIi3FSKUDPRh/vKtM8tmqa60X2hyFwRUf//RMpy2DE0GoAo6qdxyP4jx9p1uE/DpjL2YRlD1rfQRh7tv6ZKKpBu9AETq48tje8/5zTN4IUYd1nuiMUqFvPj3SGnOZKIkcR8D/JwkDPnAnz3Gn+PtDovwRPBV11UpBeujwR4YwPLmg99fZ2+NuzvD/pBWDxEefnTAssSvyDF8EQEmtaL3YpuL6eA /8GE7bri ouTcLTcjNsN0nxPQj5Bz1UIhp2HtZBMyhCLTXw03jUb4HWTAFDW0lFJ+uHNz9/PYsH/lodyQL0oRicTpv5Sj1CSrlA7vhyejaPc9AgQ8VkzBPMbvwfFummC2igtBUADMEH8p/3qjkkbi95F57mpvH3jyGveP0mLriH9NnUU83EK5boLQratm2YLqG8ckMXvlJihcQ0gf1xinqDRCed8+0C43u71jLG1HJuKgLCuhCEJ204MlbA48prH47abFLR/Wd6oZerefG7BrAzt9IkYKoICqwkmwTpCI1AqO1sne1jAyKabc= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, Oct 13, 2023 at 05:29:19PM +0800, Yajun Deng wrote: > > On 2023/10/13 16:48, Mike Rapoport wrote: > > On Thu, Oct 12, 2023 at 05:53:22PM +0800, Yajun Deng wrote: > > > On 2023/10/12 17:23, David Hildenbrand wrote: > > > > On 10.10.23 04:31, Yajun Deng wrote: > > > > > On 2023/10/8 16:57, Yajun Deng wrote: > > > > > > > That looks wrong. if the page count would by pure luck be 0 > > > > > > > already for hotplugged memory, you wouldn't clear the reserved > > > > > > > flag. > > > > > > > > > > > > > > These changes make me a bit nervous. > > > > > > Is 'if (page_count(page) || PageReserved(page))' be safer? Or do I > > > > > > need to do something else? > > > > > > > > > > > How about the following if statement? But it needs to add more patch > > > > > like v1 ([PATCH 2/4] mm: Introduce MEMINIT_LATE context). > > > > > > > > > > It'll be safer, but more complex. Please comment... > > > > > > > > > >     if (context != MEMINIT_EARLY || (page_count(page) || > > > > > PageReserved(page)) { > > > > > > > > > Ideally we could make initialization only depend on the context, and not > > > > check for count or the reserved flag. > > > > > > > This link is v1, > > > https://lore.kernel.org/all/20230922070923.355656-1-yajun.deng@linux.dev/ > > > > > > If we could make initialization only depend on the context, I'll modify it > > > based on v1. > > Although ~20% improvement looks impressive, this is only optimization of a > > fraction of the boot time, and realistically, how much 56 msec saves from > > the total boot time when you boot a machine with 190G of RAM? > > There are a lot of factors that can affect the total boot time. 56 msec > saves may be insignificant. > > But if we look at the boot log, we'll see there's a significant time jump. > > before: > > [    0.250334] ACPI: PM-Timer IO Port: 0x508 > [    0.618994] Memory: 173413056K/199884452K available (18440K kernel code, > > after: > > [    0.260229] software IO TLB: area num 32. > [    0.563497] Memory: 173413056K/199884452K available (18440K kernel code, > > Memory initialization is time consuming in the boot log. You just confirmed that 56 msec is insignificant and then you send again the improvement of ~60 msec in memory initialization. What does this improvement gain in percentage of total boot time? > > I still think the improvement does not justify the churn, added complexity > > and special casing of different code paths of initialization of struct pages. > > > Because there is a loop, if the order is MAX_ORDER, the loop will run 1024 > times. The following 'if' would be safer: > > 'if (context != MEMINIT_EARLY || (page_count(page) || >> PageReserved(page)) > {' No, it will not. As the matter of fact any condition here won't be 'safer' because it makes the code more complex and less maintainable. Any future change in __free_pages_core() or one of it's callers will have to reason what will happen with that condition after the change. -- Sincerely yours, Mike.