From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C3813C48260 for ; Fri, 16 Feb 2024 11:26:50 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 4A9648D0006; Fri, 16 Feb 2024 06:26:50 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 45A5C8D0001; Fri, 16 Feb 2024 06:26:50 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 321CA8D0006; Fri, 16 Feb 2024 06:26:50 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id 1F8888D0001 for ; Fri, 16 Feb 2024 06:26:50 -0500 (EST) Received: from smtpin04.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id DA3F31204F0 for ; Fri, 16 Feb 2024 11:26:49 +0000 (UTC) X-FDA: 81797439738.04.654EB55 Received: from invmail4.hynix.com (exvmail4.skhynix.com [166.125.252.92]) by imf22.hostedemail.com (Postfix) with ESMTP id 53B93C0005 for ; Fri, 16 Feb 2024 11:26:44 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=none; spf=pass (imf22.hostedemail.com: domain of byungchul@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=byungchul@sk.com; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1708082808; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=SnMUtf51vqqPNjEcZrGNS6TjBcXNU2spGBBI9UEPVNg=; b=ywjBJf+4psEBFhu9gCF31AyMk6DjqGe9VNsfMVXselINdY9kJU8Kx4m5TR2dYEXWWkntx5 Jbm7X89QSb459SOQ0DiibyPKukkzt8YstQdCb4OzPro2wlGXxixrjQVuiZuMLuheYoxOs8 5FAHoogva6rCSImLx5p9P27CzEUr3Rs= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1708082808; a=rsa-sha256; cv=none; b=bjFs1kUC0asEf/LS57BItok2jnSWDYQMQrRhPsRpfMsNCjKi9wOGL3x14yCFPQjQK5xvlB U0kbHnB67qa/oQO0oQvXPvItLn6SfqrinGLxVQhYTjca0v8UKG3bZ8k6cPAgFSc2G2+0De rtgl1MIG7KG3JoF80jBe078C++u2t2I= ARC-Authentication-Results: i=1; imf22.hostedemail.com; dkim=none; spf=pass (imf22.hostedemail.com: domain of byungchul@sk.com designates 166.125.252.92 as permitted sender) smtp.mailfrom=byungchul@sk.com; dmarc=none X-AuditID: a67dfc5b-d6dff70000001748-3c-65cf46719aab Date: Fri, 16 Feb 2024 20:26:36 +0900 From: Byungchul Park To: Oscar Salvador Cc: mingo@redhat.com, peterz@infradead.org, juri.lelli@redhat.com, vincent.guittot@linaro.org, dietmar.eggemann@arm.com, rostedt@goodmis.org, bsegall@google.com, mgorman@suse.de, bristot@redhat.com, vschneid@redhat.com, linux-kernel@vger.kernel.org, linux-mm@kvack.org, kernel_team@skhynix.com, akpm@linux-foundation.org Subject: Re: [PATCH] sched/numa, mm: do not promote folios to nodes not set N_MEMORY Message-ID: <20240216112636.GA4266@system.software.com> References: <20240214035355.18335-1-byungchul@sk.com> <20240216070754.GB32626@system.software.com> <20240216091139.GA75176@system.software.com> <20240216092305.GC75176@system.software.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20240216092305.GC75176@system.software.com> User-Agent: Mutt/1.9.4 (2018-02-28) X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFuphkeLIzCtJLcpLzFFi42LhesuzSLfQ7XyqQVOzusWc9WvYLC49vspm Mf1lI4vF0wlbmS3u9k9lsbi8aw6bxb01/1ktJr97xmhx6cACJosz04osjvceYLLY1/GAyaLj yDdmi61Hv7M78HmsmbeG0aNl3y12jwWbSj02r9Dy2PRpErvHnWt72DxOzPjN4vF+31U2j82n qz0+b5IL4IrisklJzcksSy3St0vgyji9Kb3gFF/FjlnXmBsYl3J3MXJySAiYSOxecI0Rxp5w 7xZzFyMHB4uAqsTZZVYgYTYBdYkbN34yg9giAmoS0141sncxcnEwC5xikpjw+QI7SL2wQJjE 3zcKIDW8AuYSHWd/MYPUCAnMYJL4sm41G0RCUOLkzCcsIDazgJbEjX8vmUB6mQWkJZb/4wAx OQUsJfZs0QapEBVQljiw7TgTyBgJgWZ2iblP5rJAnCkpcXDFDZYJjAKzkEydhWTqLISpCxiZ VzEKZeaV5SZm5pjoZVTmZVboJefnbmIExtGy2j/ROxg/XQg+xCjAwajEw3vgz9lUIdbEsuLK 3EOMEhzMSiK8k3rPpArxpiRWVqUW5ccXleakFh9ilOZgURLnNfpWniIkkJ5YkpqdmlqQWgST ZeLglGpgdEg+uvg8187zJ2d2yb5lKQ06vOWUpPI2a+2Zfqt55R25X77o3e5uHm52LvZ0mPwb jfSoB/v+y3ywmPYy72pWd2HI160/7xzf+dTgAu+rOgmGvGM7GBn3fIh/weV1db/MttC0BRcS XIXm9gZ6PL/r6lq/0C4sadtHFsVr2ze9j5FefOzLX/Y5oUosxRmJhlrMRcWJAMPftn+fAgAA X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFvrMLMWRmVeSWpSXmKPExsXC5WfdrFvodj7VYMpvCYs569ewWVx6fJXN YvrLRhaLpxO2Mlvc7Z/KYnF47klWi8u75rBZ3Fvzn9Vi8rtnjBaXDixgsjgzrcjieO8BJot9 HQ+YLDqOfGO22Hr0O7sDv8eaeWsYPVr23WL3WLCp1GPzCi2PTZ8msXvcubaHzePEjN8sHu/3 XWXzWPziA5PH5tPVHp83yQVwR3HZpKTmZJalFunbJXBlnN6UXnCKr2LHrGvMDYxLubsYOTkk BEwkJty7xdzFyMHBIqAqcXaZFUiYTUBd4saNn8wgtoiAmsS0V43sXYxcHMwCp5gkJny+wA5S LywQJvH3jQJIDa+AuUTH2V/MIDVCAjOYJL6sW80GkRCUODnzCQuIzSygJXHj30smkF5mAWmJ 5f84QExOAUuJPVu0QSpEBZQlDmw7zjSBkXcWkuZZSJpnITQvYGRexSiSmVeWm5iZY6pXnJ1R mZdZoZecn7uJERgVy2r/TNzB+OWy+yFGAQ5GJR7eA3/OpgqxJpYVV+YeYpTgYFYS4Z3UeyZV iDclsbIqtSg/vqg0J7X4EKM0B4uSOK9XeGqCkEB6YklqdmpqQWoRTJaJg1OqgbHMxZjp+r4f Rq+eu8Yk/zv2MLHa7TKrwIUyTaE9Sn9+d2Wb/eWPzZlmHLK9UEBp2gxec8bPbjdPGagtNmJ3 CjC/qaLVL9L3svpArFeRRp1Z9RK+IzZH1p/89mL9tmvzdFe0aJ33jbiZomgaqfNNPfX7zCnn A+oEvfnNriVYihUXBH+ssPNNUGIpzkg01GIuKk4EABR6UqKGAgAA X-CFilter-Loop: Reflected X-Stat-Signature: 7abwmhaojz8abjw4fet7geiq3mwsx6d7 X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: 53B93C0005 X-Rspam-User: X-HE-Tag: 1708082804-546036 X-HE-Meta: U2FsdGVkX19j9DAHQXwFFcgFqf3RGf+gSL7GXl97yvt6V7qblFTLIyuXweL9HnVXb1gLEAKZI1ZwnW8oIynrwigJPewXt3jtbhCWZGQBv3Ve62Ex2YamoqcHNFfKNfxTAEXIrt4FYOYkRpOKnXPG5m1joTuP5RMXFyULIlyvX00xlmbZstYwoY/3CKWU7GINqcVXaOa0jr9kWQksmRs6DgWO6V8V5gFKF3/LSjVWloTuGnsi7JpHB72gy7E75Sfjw54VDYpG+r5vcggZOR0i/Cihjmpl7g4zqrg9CnoxfRMrwTEHUhjrrkSM6Nb5SjgUiTtmpYvVUGEyu4k40mxiO0ZgfNAmnW5s1OmFKrcef2MIntLyuyxBJt3LANH6tHhF1V02sy3kQLXmJtiHEkoiTyiUBUXj3E6fdBqY693do8bw0QpZcLn5W9gFI/kYQo+5rY9QYXZzscPGksjCtbclJInsjfAby4b5ZzIanBP/G/tQ5qW+ugQORpe+iphAiMDNKSc+085LXGFsWz76dO/COJqbWWL07W1XhfQcnx62m5pCQXs1pa0vckHcmOQU0gymRt5i8qff/0Cu/QY7o/P2N5R2Fw2SyaHmqNnq75L6e2lDiTOcwwF98DNDfrYEEooSVwksEP1zHgWyMYxscjVjufbkkhMb6NH/aJl9t20gqKl1AVMVGX31NemXHNzqeKUZEC1Bz3YOgfxi7a48/zRYgg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Fri, Feb 16, 2024 at 06:23:05PM +0900, Byungchul Park wrote: > On Fri, Feb 16, 2024 at 06:11:40PM +0900, Byungchul Park wrote: > > On Fri, Feb 16, 2024 at 08:52:30AM +0100, Oscar Salvador wrote: > > > On Fri, Feb 16, 2024 at 04:07:54PM +0900, Byungchul Park wrote: > > > > For normal numa nodes, node_data[] is initialized at alloc_node_data(), > > > > but it's not for memoryless node. However, the node *gets onlined* at > > > > init_cpu_to_node(). > > > > > > > > Let's look at back free_area_init(). free_area_init_node() will be called > > > > with node_data[] not set yet, because it's already *onlined*. So > > > > ->zone_pgdat cannot be initialized properly in the path you mentioned. > > > > > > I am might be missing something., so bear with me. > > > > > > free_area_init() gets called before init_cpu_to_node() does. > > > free_area_init_node() gets called on every possible node. > > > > > > free_area_init_node then() does > > > > > > pg_data_t *pgdat = NODE_DATA(nid);, > > > > > > and then we call free_area_init_core(). > > > > > > free_area_init_core() does > > > > > > free_area_init_core() does > > > zone_init_internals() > > > > > > which ends up doing zone->zone_pgdat = NODE_DATA(nid); > > > > > > If node_data[] was not set at all, we would already blow up when doing > > > the first > > > > > > for_each_node() > > > pgdat = NODE_DATA(nid); > > > free_area_init_node(nid); > > > > > > back in free_area_init(). > > > > It seems that I got it wrong about the reason. Let me check it again and > > share the reason. I analyzed it wrong. Even though the issue was gone with the patch but it's not the fix. Sorry for making you confused. I submitted the fix with another patch: https://lore.kernel.org/lkml/20240216111502.79759-1-byungchul@sk.com/ Byungchul