From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 41364C282EC for ; Tue, 18 Mar 2025 15:13:21 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 57881280002; Tue, 18 Mar 2025 11:13:20 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 52750280001; Tue, 18 Mar 2025 11:13:20 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3CA26280002; Tue, 18 Mar 2025 11:13:20 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 20604280001 for ; Tue, 18 Mar 2025 11:13:20 -0400 (EDT) Received: from smtpin18.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id E7922141351 for ; Tue, 18 Mar 2025 15:13:19 +0000 (UTC) X-FDA: 83235015318.18.3074EA7 Received: from mail-qk1-f178.google.com (mail-qk1-f178.google.com [209.85.222.178]) by imf18.hostedemail.com (Postfix) with ESMTP id AF4981C0012 for ; Tue, 18 Mar 2025 15:13:17 +0000 (UTC) Authentication-Results: imf18.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b=pu2E5NOm; spf=pass (imf18.hostedemail.com: domain of gourry@gourry.net designates 209.85.222.178 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1742310797; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=Fq4YIdfyvH3D38tBVB9O/pfTAXZmUQ3xOYQLXZJY38E=; b=59HAb2LwQjs+On1I0KufUIHx5Xhf2QZ6Ye1j+jA2RRctVSiv/s8DIdKgAY2bNZs6RA5Xbg E0UW1Trp09KxkTIzW/98h/O99P/7aucU+GQyDRUkmp7ySSUaHrmhkO3YNrS7kEzsmKgiZt zPL3vN8fT3QLn1T7A9KIC8/PKtNbSyM= ARC-Authentication-Results: i=1; imf18.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b=pu2E5NOm; spf=pass (imf18.hostedemail.com: domain of gourry@gourry.net designates 209.85.222.178 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1742310797; a=rsa-sha256; cv=none; b=j7RVZ3TU28GhyF/Jz1flNd0AUpwH6DAR3BupVH54vyVPjdbCrn+OaUhTH/DJbOFfA9v6NR jpCV2e5CEqufxmmz/Bg/mZmJFkgULCTRyLP3reQ5Heemh2h9xyZqt6Roltv8/iYlmcPmT7 qR+7shD9CHypV8+15ci98F0WV6h378A= Received: by mail-qk1-f178.google.com with SMTP id af79cd13be357-7c08f9d0ef3so315982485a.2 for ; Tue, 18 Mar 2025 08:13:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gourry.net; s=google; t=1742310796; x=1742915596; darn=kvack.org; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:from:to :cc:subject:date:message-id:reply-to; bh=Fq4YIdfyvH3D38tBVB9O/pfTAXZmUQ3xOYQLXZJY38E=; b=pu2E5NOm7yAigCY0suVYRGJh4js/fzDfQavvVIpbBsqS8uPcL6RUQfnraM1Wk5hBQD Spe0kS2C9/vru8has0oVZUcvf7bNogWAHJGhZI0lhT0wAHm1rLYY57KrM1RPCd/bhimf kIiver+aHovKDZ8VV9cFp6Abv4P655kI0dbyQsM81alWnXkGtOMHGhXriUyHfr+M8YIy FN/Wwc2OpgqFOLDmv5Q4VEBvu7NPv8rfvjq+Hw5yA+CsPQfbnFS3K1cU1qpABdl+ZzG6 MwVGGFsHe9ZNtnsnbLTInmqO12uONbhKOWvkTuUHBjX++ik6aKhTU6fs9uCm+sflgA1b jb2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1742310796; x=1742915596; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Fq4YIdfyvH3D38tBVB9O/pfTAXZmUQ3xOYQLXZJY38E=; b=jqhJVNI4sauaHyrHQP/RqXPlwy+IT0GxAS60nwFLXijw1rARIB70mNFLGxgA7fwHRz azlFaCaD8ogW6EfvnUpG4Z3fvIlXR02ba/aylizbbde/mBpEfwYJHdplHGuLROZ8HX5q yL1tA4dNwbLhJyL67YO5UmK4O8z+9hfcAZOgQ5kwGivmQKYffbEbL0YWTi79zET5LXI4 QzVkDkhH0ABc555APHDJrywzhm7cV0GppCuMqcUqyCSYpkj9PrWyFwJDhcTM9/5kUcid gaz3e3QS4iedEcMTGyDh0vvzn5xQtrjbFpOAXxKmCBbCjKRPzeO8qTVsyxwYMQiqyB+b mStw== X-Forwarded-Encrypted: i=1; AJvYcCU0/d5Gk/opgVkJ3AVihk5pVwRBMxMcSrsFCE9a7Yr0iCoiC+fIlnbkS+3InbfY1HOnMDEz6Aztqw==@kvack.org X-Gm-Message-State: AOJu0YwkRutL+wq20yh4si2K8ykrvAO2xgfZeYrVs6IQVXyXbimeCDlI 2O4JmA+5jhNxVYEiR987KDGPzgcf8T/F46D/iDVXC22pr4J4CWgZZ8QCnze/DzA= X-Gm-Gg: ASbGncvReoBnbJn+2pJIztwYFr86Iss7ZlfsFqKDvAEJhYsf01pr/sqcB6arTUlDkVY 8MkX0Mo36uCkBW0Gsam6mk9IviUysMHnAgkJmyW76iwjAIvu9HTHd1ocn9OZ3pk7ZVW9cSjxQwx iC+a2biTlsnwTfucZ4gxgN+TIXGECAvgr1TBx7nlJ1aO5+hGbP2V3E6fOGhsLXGX3yhAddzX4Nf km5alz0F9QrzsWRQnenyrpNKKPZxjWgNUPSINhL1qrWkJ4Q+9PKRfbMzQlU0ZMZh0CCPcRoZC9U VADACCIpHN3E5dv2imyHIZHWlmTCbiuOvxsEuiOQgZ9AcBqPy2ETV8syLn5swighogcIkx/jCnv d/TsNoPUFLHKIMGGEJD7XOe7Va1c= X-Google-Smtp-Source: AGHT+IHeMQ4TK7mWZ8ZCPZ0HfjaVy2CNDBY+DoggANGCjpN0TVfqxk3IlMuRg8yeq+gDT6U2kTi9hA== X-Received: by 2002:a05:620a:470f:b0:7c5:5008:436a with SMTP id af79cd13be357-7c57c73da02mr2385055785a.1.1742310796559; Tue, 18 Mar 2025 08:13:16 -0700 (PDT) Received: from gourry-fedora-PF4VCD3F (pool-173-79-56-208.washdc.fios.verizon.net. [173.79.56.208]) by smtp.gmail.com with ESMTPSA id af79cd13be357-7c573d8aecfsm730776785a.100.2025.03.18.08.13.15 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 18 Mar 2025 08:13:15 -0700 (PDT) Date: Tue, 18 Mar 2025 11:13:13 -0400 From: Gregory Price To: Honggyu Kim Cc: Yunjeong Mun , kernel_team@skhynix.com, Joshua Hahn , harry.yoo@oracle.com, ying.huang@linux.alibaba.com, gregkh@linuxfoundation.org, rakie.kim@sk.com, akpm@linux-foundation.org, rafael@kernel.org, lenb@kernel.org, dan.j.williams@intel.com, Jonathan.Cameron@huawei.com, dave.jiang@intel.com, horen.chuang@linux.dev, hannes@cmpxchg.org, linux-kernel@vger.kernel.org, linux-acpi@vger.kernel.org, linux-mm@kvack.org, kernel-team@meta.com Subject: Re: [PATCH 2/2 v6] mm/mempolicy: Don't create weight sysfs for memoryless nodes Message-ID: References: <20250318080246.1058-1-yunjeong.mun@sk.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Stat-Signature: 574h4mhknt615wuyfuizbx7pcz5tqw9i X-Rspamd-Queue-Id: AF4981C0012 X-Rspam-User: X-Rspamd-Server: rspam09 X-HE-Tag: 1742310797-881705 X-HE-Meta: U2FsdGVkX1/yrglps6qY4QsFRlbP/NO+OLKs6Vd66Nhd35y4zWqRkLPxspQ9lv7WHNJi24BCpevfIMFalFspqDNUx3rp0XjgfN2oWpYTH272nsyGuTOL/m2MAxpi8O0T+lFl4TvS6GcEPJR1uAVEliFbob2z0TZqdRa/0cMjromKSXPvSPxz0aMKHYz2udE9Vd3Ej1f1qBdBclaTyOiZVcO3NyhO0Y1fSl6jQYokI+uZvzIqk+Gtb9emaV5zHTx6wf/ehi/bYs9xDFqt8SoqSNdI7AOqj126Hs2OpHr8mRh9/cUjB7ArR9AOWtp12+VfsEy10J7OSNq9ulMTizHgMo6LUIEvaBNmyvpBnZFDR291G4j9S0RxK8zvo8DumJtppktNju2SEUxhdbabHNZfxsd4j2EoXxHJWobLA5qeOzwvwxVLBN22QNgLcYesbETaSXUFt5ZTA2gbWbrpnEnlqAKcvP65hn9pNuyhPJy3JuVn1YMaLQgsTHX/b2Nt8rNqIpp/O1GJEDV/WHsO+1ItMviqfHSD17GZ9FsVg/LOFbSj7bUYFRzMEN57/o4Su9ND34Eq5gt9Lb2S8SGMsSX8JS7IA+H3iChoy3kSyeOpb4tnlojFYiSLrbLsmPfbe+s8Q5YXCH/2GkRpKJhUok+NknxocuSxiEPE6e5T8WBo+sZ0ri7H25U+g1WL9nS22d20piZAnQkKcf3D0C0XoGRDloB6/ec1irJv2AnYPmsS2xtPgV8AGrjlBiWdoEK0wb763G9yeBkYeYKrVLKFs6mALGVFHNYP+q/OuoJL0L7NqZQSxu/qkqPupDW4WcFUSCMbrde3rCh3X8yYggNjHzhMMX0CD4rEwmrDqQR8PMc2dQXBbYkbmyiUayRWrEJc35V9js9hqyw0uGJPhdLWZsQc+WZMln6YhfTflLpWadySZyFNN+4+EdxTvU/vm0O07tB6b6Q1RlPKKqjZH2O2UM2 qWZBK5mP mvsD929r/nMD4vdifOS2RFbn98kMgCwbu2zSOdNymADe2fyXveubDco1U8frE9iVYynRv8+RpPhG+0nmZIXIkM9hyHlA/KbeNIV1aqsv7yq4LwfX80s8N+mat4nV4+/zEaTQremlgbrfoibZ7ycr5ZCkjFMJvGvpUCArgnZYtsDaf8bqBRJUPp7i6HHJfC6VQakMpp+1YSbmZ9IcTZzpkeiZUF4UsaeaQ+VSmaejz6UGCjXGIcDGMX7qCsqn5upygKu0UWaOcjdc32jfgruKavArBHCD7IEGA6NTwOUMnTRfcWr5rYf3I7x0dLbysAT9CDxHqBvUEXeLriNBksYeE7ta6VUBZW8pQ2kOS4uWaja5IJTWgOclKtE2moB0g/+RSSIBMM0dTMp0oWomhAIrEY0PIEYpto+tIrB7lmRAsB+VHrlM= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000004, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Tue, Mar 18, 2025 at 08:02:46PM +0900, Honggyu Kim wrote: > > > On 3/18/2025 5:02 PM, Yunjeong Mun wrote: > > Some simple corrections here. host-bridge{0-3} above aren't detected from CEDT. > The corrected structure is as follows. > > rootport/ > ├── socket0 > │ ├── cross-host-bridge0 -> SRAT && CEDT (interleave on) --> NODE 2 > │ │ ├── host-bridge0 > │ │ │ ├── cxl0 -> CEDT node 4 > │ │ │ └── cxl1-> CEDT node 5 > │ │ └── host-bridge1 > │ │ ├── cxl2 -> CEDT node 6 > │ │ └── cxl3 -> CEDT node 7 > │ └── dram0 -> SRAT ---------------------------------------> NODE 0 > └── socket1 > ├── cross-host-bridge1 -> SRAT && CEDT (interleave on)---> NODE 3 > │ ├── host-bridge2 > │ │ ├── cxl4 -> CEDT node 8 > │ │ └── cxl5 -> CEDT node 9 > │ └── host-bridge3 > │ ├── cxl6 -> CEDT node 10 > │ └── cxl7 -> CEDT node 11 > └── dram1 -> SRAT ---------------------------------------> NODE 1 > This is correct and expected. All of these nodes are "possible" depending on how the user decides to program the CXL decoders and expose memory to the page allocator. In your /sys/bus/cxl/devices/ you should have something like decoder0.0 decoder0.1 decoder0.2 decoder0.3 decoder0.4 decoder0.5 decoder0.6 decoder0.7 decoder0.8 decoder0.9 These are the root decoders that should map up directly with each CEDT CFMWS entry. 2 of them should have interleave settings. If you were to then program the endpoint and hostbridge decoders with the matching non-interleave address values from the other CEDT entries, you could bring each individual device online in its own NUMA node. Or, you can do what you're doing now, and program the endpoints to map to the 2 cross-host bridge interleave root decoders. So your platform is giving you the option of how to online your devices, and as such it needs to mark nodes as "possible" even if they're unused. ~Gregory