From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B37A7C282D6 for ; Tue, 4 Mar 2025 16:29:53 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 184B86B0083; Tue, 4 Mar 2025 11:29:53 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 10CC06B0085; Tue, 4 Mar 2025 11:29:53 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id EC9D46B0088; Tue, 4 Mar 2025 11:29:52 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id CD55A6B0083 for ; Tue, 4 Mar 2025 11:29:52 -0500 (EST) Received: from smtpin29.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id 4BF161C6AC1 for ; Tue, 4 Mar 2025 16:29:52 +0000 (UTC) X-FDA: 83184405024.29.5DF5D8D Received: from mail-qv1-f48.google.com (mail-qv1-f48.google.com [209.85.219.48]) by imf27.hostedemail.com (Postfix) with ESMTP id 72BD54000E for ; Tue, 4 Mar 2025 16:29:50 +0000 (UTC) Authentication-Results: imf27.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b=KMut9CMH; spf=pass (imf27.hostedemail.com: domain of gourry@gourry.net designates 209.85.219.48 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1741105790; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=8UWPCN4uO5+hoNKPd6bzLCSnzU/reuMIMfkocTwKPZQ=; b=TgWQUV7EzkqIXdRKh4r7+G0Lx7fhy+9iqN43WFRUEUTeJ4cb0rJQqwhdJBGSzqZCxKVC+R yizqeG7Q4v8QWVtaahvR1/5gALCh19KDP0NDqmJ21SYJ5GDxXW4LoigQuguKS4hs39x/sE kIZRRJ1y/FKJww8Ls8g2wviC8YeyQhM= ARC-Authentication-Results: i=1; imf27.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b=KMut9CMH; spf=pass (imf27.hostedemail.com: domain of gourry@gourry.net designates 209.85.219.48 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1741105790; a=rsa-sha256; cv=none; b=Pl40TahPb7gRvpXAbbzvKVNHWPGLOdfGLDtAgeLcM/WkOnnNImAgOLjjtq2yjm7t3sC9Vm Uyr3Y0BK45X5npdlln2ma54nuIudH7/yJZ4k+bfMxMdrrW/zuzDpKzBwLL3pqzJPxkfzRg MaSVz2HRpV2WsDWkJu5tQHbu2OtqfPw= Received: by mail-qv1-f48.google.com with SMTP id 6a1803df08f44-6e41e18137bso46227846d6.1 for ; Tue, 04 Mar 2025 08:29:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gourry.net; s=google; t=1741105789; x=1741710589; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=8UWPCN4uO5+hoNKPd6bzLCSnzU/reuMIMfkocTwKPZQ=; b=KMut9CMHVt5VLUi4piHtkEbAYoAOEDc7LSSgC3iRTPEyNnPSQOMvPdNPWciTxZCyWf KsWRBfNpW1vU1NLn1tmh2fZK6LzMFh+ikbRJ7a54iSvtZzZoUYu/86ikoKDOuC45oehk D9n26Q1vlr34lGgjOmtgzv4W5KwF1bEeSZsTZBwcA6/DdnMN3e3s95rA7FuQpwTR7C71 wxl6wZ2fduA+b7k7kmiu5HNxx9Syjw14uGmJ7X0exyq5PGPe7m+fOwDr3dlrOksurmUj tp2IPKadm5dtWegDbq5ycq+p3jYITEmxUv9qyhQZZIDfuoJ6tO7yQmqV0I/SXS5M6na1 W4mg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741105789; x=1741710589; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=8UWPCN4uO5+hoNKPd6bzLCSnzU/reuMIMfkocTwKPZQ=; b=JQvPdaCgLMNnlNR8g2M0gzOPRRYDRpBNVreYkb4qK5Qri7WBNYjMrq7aDK6tvwBum9 jEE/uXbLQy0XbMLrKoAw4JLGSBJC5WmBJTsJg4m2hjkXmMQKN1wSbVL0W9+GO6Q4EGJI 8osKULQvIyJuXuycEqIvKqk/M6G9uBJqo/yvsRx0A3W8ciO2ulLPODB5NqQZFCP7QrLH sU09sQ5LoAKYPFAtL/lWgNDqdcj2ESv4sLIL+bf5ebO4e8q1CkA5Tj+e88M0ZiJMZnZD OljsTSUVDI04snE2vV2n2Yg8fcsE0bs6mWeHfuE5IzrafKmP9D/0do5nniYLLMcX9buB KGGA== X-Forwarded-Encrypted: i=1; AJvYcCXGWzlJQNM9PYwavw3UYKt+hVuDeChYKByDZuv478XjL0zBsc1qsK2I1OYG0yMYOhKh7OX235mWfg==@kvack.org X-Gm-Message-State: AOJu0YyLt7ULo5+BKUGMmk+GsqtfiBocBZH4dx1RI3d6+VCCSA3cldDw 0wduxlJ5cXkO4JlAXDlm12TF0zDrI6LkXvvPcX4Yerp99WSCVAjk4+H24MouABE= X-Gm-Gg: ASbGncubBapSpBhB7qxSIczEfJ4ZGsDV24jeXCliD/ovwKkTr0ouaLAn1hYIi3y9oDS 7h7lFz7dt35Ts1N/8Wsn6mQ+x5+SKvP5DXEhFHr2SzqOtGDO6Tm/Z/+3R8NyE9OUd08GEY7CThG cZhwZwDC4pxQODHScKAs3R+67/cuP98uhhcTd/iQYTGrPoJ+Rjckms/BLFp/N2OoXeLd7u2fY5x xw658qSfop58/S1UrT93VlDYCbRuLJ/BYkoJrBvW1L6AUB3LhA+IccAjUvvY9MeP01riFbO4M6b noPKqcrkowDqKe6k44zPTnoxk9rzO6t/ff1t9V31JodS1L0F2BoLUCNaebx4wvtLCDeIgsPp1MY Ja1PoN8haOTXUizzM+fC7E6isnx8= X-Google-Smtp-Source: AGHT+IG9pNkV8/om2bZpdkllwH5Qnrkj8fkgcns8KwfxMTIBktUTXJgujzar75xsqgH+g9ThSEfa3Q== X-Received: by 2002:a05:6214:19cd:b0:6d8:b371:6a0f with SMTP id 6a1803df08f44-6e8a0d8f94fmr290391966d6.31.1741105789533; Tue, 04 Mar 2025 08:29:49 -0800 (PST) Received: from gourry-fedora-PF4VCD3F (pool-173-79-56-208.washdc.fios.verizon.net. [173.79.56.208]) by smtp.gmail.com with ESMTPSA id 6a1803df08f44-6e8b0af29ebsm43033196d6.89.2025.03.04.08.29.48 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 04 Mar 2025 08:29:49 -0800 (PST) Date: Tue, 4 Mar 2025 11:29:47 -0500 From: Gregory Price To: Honggyu Kim Cc: Joshua Hahn , harry.yoo@oracle.com, ying.huang@linux.alibaba.com, kernel_team@skhynix.com, gregkh@linuxfoundation.org, rakie.kim@sk.com, akpm@linux-foundation.org, rafael@kernel.org, lenb@kernel.org, dan.j.williams@intel.com, Jonathan.Cameron@huawei.com, dave.jiang@intel.com, horen.chuang@linux.dev, hannes@cmpxchg.org, linux-kernel@vger.kernel.org, linux-acpi@vger.kernel.org, linux-mm@kvack.org, kernel-team@meta.com, yunjeong.mun@sk.com Subject: Re: [PATCH 2/2 v6] mm/mempolicy: Don't create weight sysfs for memoryless nodes Message-ID: References: <20250226213518.767670-1-joshua.hahnjy@gmail.com> <20250226213518.767670-2-joshua.hahnjy@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspam-User: X-Stat-Signature: 75we9abobq1brg185jrg545mu4zfkfg7 X-Rspamd-Queue-Id: 72BD54000E X-Rspamd-Server: rspam07 X-HE-Tag: 1741105790-705669 X-HE-Meta: U2FsdGVkX19eFc2L0I1WhYYc8GAuBnHFsCQvUhqARpnNZP3COwo33IoOAL5BsP95lvKPjHcgyAkkGC5FLKpJreeNnyjB7a6vnxVZumFwm3Er/807yaBoTbsv38kG3xv7NViERTLH5qz81nAXC8D3QjF4gzVsdgzq7G8GBRxCW7JRdKy4Eu1ExBZnZ0d8ylOGWjP6RORFdIBtRIKQT12m4IlEVjk9lOPwMMJUg9HtOLxcS6Y/3um1OQYg+HNOFCHx9mb48r9Q2wk0arhuOIvye3LZgbTNVfJVPqLvB+1CeTeLoLBj/RPCcyaGJZH6D/PbVLKnvAtH1YLP/AJ5XvHimIkwVxJpm+8jqEr3uTvcQLsC/Lov7EZX2Jvkhh4wRr2pDBzxDKUeB7Py8iWEnve66VR2Ehrw6rfMljywuDikUjQu7JsvhQnueI+GjWe4taHac+jV0OHWPTU1Hd79xQyAIFAmaPyTR36TcShDh8xjfTTehyYr2weoMyGButhPUY/FesSUK2noK5l3E4B87rfH8OpbWiH2ln0XJDr27ZHn4M4edg20phxHZbOADS8mTJFP1sT8QA/c5w4k6B6PrzuqHejp8hMz6/H16tLtyZMDmJebUg7I0ztw0Mkf27BaMgacIxw5BTtoAgz/qLg1XAiHKphoO6sGUWlxFO29iyUomEuF81EjXXj8ndbQIh7SZZaOUnToyN+LwPjFJw1vPtXhUguVPkCD3oP3MARbu3tPnul74LTn1R1YV2eUsTT+aLo4ILNwJ70Zsy2i+YJpBGQtFkY9F2bXPKnMCOrS/1/S/6TgVzRYK5jscJIC6MTHcfXWAg8vEcVak/5Bj7PSlftgXJ+3TeUECBE9A0EAZ79EJ5ZWs64v5ISayk1KWAXIqO5MHd+PsoYlPKIVBt55KndSDvdbmpkHqtV29Q506xy3533ZSmbP8UEc5FnyvHzzekR9lLOa76iyd7RBAAoUMQO wO39i6Tc an9DSpgq9Z+wIFoHJhooDBOMS/SzYWC+VEKzuJmJt+1gNfFnuVJ9bGFozte8lwgefinCxGaoLzPJymFJZcFSb7g/rCm3dbFzyAzZDpo83/F5Qf7re5ShyVfEDdXZaUECuhTeOXjn2iBVPo4x5Q9BBFB/55hebF69TD2JXXIxNlPjh1WJ+zGR5aSSJpjguTQvxfkuVwxkAPMg4PXFf7htbIHZR5gJtwvHJTJGu2KZ3g4RmzRZT9G3QD+GUGmbsXLG5cx665RnTrtX5Ywt9dko5d+GTgqdsoHF+555bfFjrh8JWYupqLX4Uwm/K/bze59fx7L1bQWlRgzgzS9qR3ZZDPH1gkDzScCx7BSHjcaQLwcRjfbChoEklOU0SvRuRzP1FTZCnNfMzYF50LSbZ4ivJBOx6IA== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Thu, Feb 27, 2025 at 11:32:26AM +0900, Honggyu Kim wrote: > Actually, we're aware of this issue and currently trying to fix this. > In our system, we've attached 4ch of CXL memory for each socket as > follows. > > node0 node1 > +-------+ UPI +-------+ > | CPU 0 |-+-----+-| CPU 1 | > +-------+ +-------+ > | DRAM0 | | DRAM1 | > +---+---+ +---+---+ > | | > +---+---+ +---+---+ > | CXL 0 | | CXL 4 | > +---+---+ +---+---+ > | CXL 1 | | CXL 5 | > +---+---+ +---+---+ > | CXL 2 | | CXL 6 | > +---+---+ +---+---+ > | CXL 3 | | CXL 7 | > +---+---+ +---+---+ > node2 node3 > > The 4ch of CXL memory are detected as a single NUMA node in each socket, > but it shows as follows with the current N_POSSIBLE loop. > > $ ls /sys/kernel/mm/mempolicy/weighted_interleave/ > node0 node1 node2 node3 node4 node5 > node6 node7 node8 node9 node10 node11 This is insufficient information for me to assess the correctness of the configuration. Can you please show the contents of your CEDT/CFMWS and SRAT/Memory Affinity structures? mkdir acpi_data && cd acpi_data acpidump -b iasl -d * cat cedt.dsl <- find all CFMWS entries cat srat.dsl <- find all Memory Affinity entries Basically I need to know: 1) Is each CXL device on a dedicated Host Bridge? 2) Is inter-host-bridge interleaving configured? 3) Is intra-host-bridge interleaving configured? 4) Do SRAT entries exist for all nodes? 5) Why are there 12 nodes but only 10 sources? Are there additional devices left out of your diagram? Are there 2 CFMWS but and 8 Memory Affinity records - resulting in 10 nodes? This is strange. By default, Linux creates a node for each proximity domain ("PXM") detected in the SRAT Memory Affinity tables. If SRAT entries for a memory region described in a CFMWS is absent, it will also create an node for that CFMWS. Your reported configuration and results lead me to believe you have a combination of CFMWS/SRAT configurations that are unexpected. ~Gregory