From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7FCA1C36008 for ; Wed, 26 Mar 2025 12:53:21 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id E2A6C28007D; Wed, 26 Mar 2025 08:53:19 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id DD9EA280069; Wed, 26 Mar 2025 08:53:19 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id CA1B928007D; Wed, 26 Mar 2025 08:53:19 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id ADE10280069 for ; Wed, 26 Mar 2025 08:53:19 -0400 (EDT) Received: from smtpin25.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 60195808DD for ; Wed, 26 Mar 2025 12:53:20 +0000 (UTC) X-FDA: 83263692960.25.3188531 Received: from mail-qk1-f174.google.com (mail-qk1-f174.google.com [209.85.222.174]) by imf22.hostedemail.com (Postfix) with ESMTP id 75C55C0005 for ; Wed, 26 Mar 2025 12:53:18 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b=lwYbCSM1; spf=pass (imf22.hostedemail.com: domain of gourry@gourry.net designates 209.85.222.174 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1742993598; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=unBBZW4o0XvmaaTwB/+3iSkpD4sIQERsLXl81RTyoyQ=; b=wVh0ght9AZz40UlwYJWwd8gkQisQhSbdbZkOdB2rM6IRVI/eVGX9wij277L1Qb0xg9zl0k CxK9Fv6z2TEf3D2kR9qVST5XzFwCkEePjqduFOFL699CsOW+ss67/4ReDu7bQcwY7VojWa paFv8IaqD7mR7OUINk6JcaoQ26XzIOM= ARC-Authentication-Results: i=1; imf22.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b=lwYbCSM1; spf=pass (imf22.hostedemail.com: domain of gourry@gourry.net designates 209.85.222.174 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1742993598; a=rsa-sha256; cv=none; b=g4Yqy09BfTXuF1/QEsjo8JEv4DaNpkqUVDDK9xjR9J0j+8qL1IqO0kulRNVG2vgoItfS4e VocIKjz1ab1pXcKlqoxsyStfzgsHJ8vU2PeEU1owdAp4WcryIRHCVdzH5LQC7xWapGv4YB GyXOU3XfzA/hPpf1471q6xxBgVwTl1M= Received: by mail-qk1-f174.google.com with SMTP id af79cd13be357-7c5e1b40f68so153789085a.1 for ; Wed, 26 Mar 2025 05:53:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gourry.net; s=google; t=1742993597; x=1743598397; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=unBBZW4o0XvmaaTwB/+3iSkpD4sIQERsLXl81RTyoyQ=; b=lwYbCSM1mZkyWV2q79eRp646dwJTuL/lpYxSkQOsi7lD9nYtIYJtymPNITXYFun+sj jVtkLv5NjkxLL3zf/WalVjAp4ihHCJ7ORfr/qjpusakZINs6uUiFdhepG+QASV/cSb77 JB7K2zis01y5v9qe6BolECTBBuc7PQKbzvyYbu/jgxPEt0JR19z3pe2f3vqt3Fy6AAU6 OSo4vw70JUo13M0YAimoSrjRDBBHEsQSl+cUxhgWSPqwzJFYE9r8b68mMKnKAW1XiSPk u+lWLx9cofRB4c9bmjG9hcSGggYzpsCAiqXDu2WlmQksI8E82VPMl/uxGGqVTctoOx2w rO8w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1742993597; x=1743598397; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=unBBZW4o0XvmaaTwB/+3iSkpD4sIQERsLXl81RTyoyQ=; b=vkb+9la6UdNt1umEUVnhKkrc31FiIl2VClYWr+VZqFsf2TFo3wzxGZg/2ZN3gvmWqI 2f5z8rUkMGb99J22/wz9WuiEiJbnW0GXSrDELSy3vAwSZgr5w70vj8ctm9BrRQgfcmIL Ajr2JRONrQzU0HxL2gHH0IdIAKPohSnNl/5j92BGVJOPR0BjKpvtZP0OiAkmJ8e+8+Lf 5T9QotaYznped9xVoIGDxdwt741VRS7ZW8CDJrNRTxMzu/4VV8Ym3YlpDFOeUdYRRC3g 24EFTQSuUXihh6jcxkznbrBwcxUJlGt+deOKMp8g4s8OXQbH6+Z8vqAGH4jA85bIc3rI a4iQ== X-Forwarded-Encrypted: i=1; AJvYcCVhNtg6QHEha4rcS7CZu295rLxirvMhKGccCgzgZ1v00ewMl6hMVtuqlO6LuhOTO44NGNlSCSDtBQ==@kvack.org X-Gm-Message-State: AOJu0YxSbuQOeMkq4/aHGH5D8+Ck8E6hJFmVw9Pg0xA0FN27XVBOgtZr hoXbuLtQ0h04DDzHe+uAVFpXX7ZW8WhAGmNtjgTnSsehRW8Eb76F98G6E7YweDc= X-Gm-Gg: ASbGncti0cvRumU/A26i4uU2bYTnXPrfVJb0CtFgomd+8vKzV2CNpnkzZdXIQlE0W5O qo5I8rK/LRRn51pNM5U/UEOik+jVT4AD+SBgHI5/Akfb4IbaVYwM8ZTWQcpZxug8hH05eNnEBJK 7ajE/KpTxpnkLEvj5df0etslcuCvOLvQ6QTmKTwC33zxRlxwbvYUVv//40oiyrlee/oDVeLm0bH bqeYXk+JlVVuMhXFJf04YiRmxCEz4XuEtW5oDo9XjLEp/F+S1YdcC3RBXo4jnLrmZcvuAQfzUI2 9r/aCXUOucYUtnXETdG+j+ag0yXuK8E+TQPQxnNiOWDEKLatzvbSwg== X-Google-Smtp-Source: AGHT+IEyK007wueidBJdaxRdr4xRWmnbMteuuUEM+eIwVWK6Vpov8l7x9HZXE3tKIEMisQ/zDeiPqg== X-Received: by 2002:a05:620a:29d0:b0:7c5:3c62:804c with SMTP id af79cd13be357-7c5ba157d0amr3415424585a.21.1742993597358; Wed, 26 Mar 2025 05:53:17 -0700 (PDT) Received: from gourry-fedora-PF4VCD3F ([99.209.85.25]) by smtp.gmail.com with ESMTPSA id af79cd13be357-7c5b92ec688sm760794885a.64.2025.03.26.05.53.16 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 26 Mar 2025 05:53:16 -0700 (PDT) Date: Wed, 26 Mar 2025 08:53:14 -0400 From: Gregory Price To: Yuquan Wang Cc: lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, linux-cxl@vger.kernel.org, linux-kernel@vger.kernel.org Subject: Re: [LSF/MM] CXL Boot to Bash - Section 4: Interleave Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspam-User: X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: 75C55C0005 X-Stat-Signature: hm3mea3476i4fsjy1cmeux8ukd4r9ca1 X-HE-Tag: 1742993598-357002 X-HE-Meta: U2FsdGVkX1+lQOih+e32Fcq81hmIm+Q/YxbYbeGZiDuu1FzUfDxockvHwo1/DRs+TCymF5IKJ6TOV4Bd6u0sMJ3kOETgc7zpnBlR8msdb9l2leLxXelizVKVQUQAzJMnHdK4fWyqa/DSK4BtX+Ll2CunrorwZsJ5CUYWSrGDgnkAJjSdSzzM9fbBu8yc7YtijHqlLyWdpMSn0GuuP54JgJ+OJjlov1eKA6kRl5jD2TYPOornKGePwqVsejcn/BY3T50F7BGySVlAeDifZJIrCBG6UUpsN6ipVzi8I4DAzsyjr81ptc7zkehpD82BVGC6dNIH1OpRT0b1WSAS7/OjHZNrmCwgNsnoa2aH9Up3HovTRUy57rsobHmPQyBLdC7yqGSzuBnUoKZXsmi0MOKTvbNF5ElprN3k6hpS1Fxb+IX3Bga5i3r9jodkv/rrWZyOByBKCHUh24YVsXaL8cSXC3bzQUJiB4kc+fUOOX1PbCzroDJLNPExYJIGjF3qgJIAuIYUJ7Srrgt6vJAWZ1/uyHT+ECxzyO1sXtOpDHgqxJDYta0rCzClGQ20ecGCkfuLrL02GBqWAv85qXMaCi6hOQtfk83FM237luA1SLgmElc3X3gWNnWG3Ght8DoJflPq/eUNSrE+9ko69PA9lQsrlKducpbj8K+kWltF3nBI8Lf91xdWOQywyL6OEqX+MpHG9f6tBDe4XY3hWYD8XRyDBM1TcwZAruxhPcmvjqa0cCnPJHpxtDSIVVjdS5PkDDDwCZNJFYG6C3v1mXHrpow/hd9wizRFxciiPy4r4WmysLiKkP17FceB2fjyk4GNV5rqvagwe8lJ4y1198yl+N22I10NRjePoSh47G3C1IFypM1GlMzeVN0nM7ajSUbRzLZWi8PR01d+EjoijCMTan35ZBgAJBGnTJOevNitZl4TTYhiV8vi+m419VQU4ZhuwyO/em+YybVBZLKLx5IQuHl IyVqy07K nGr4ICEE67xwDuYNwxrAlIiINVfqTKO9z8G+NLA96J9mvPOJOqFCTn8FSPm//mOUEV1V/pUt1YmYhmvzaYI094cwIrVyRwFL0qIwmOjJFo6Pw6LGhdzLWq1TjoClY4vZvKbFoV1uSgbIHMRO0ALl5TO9twKtmhyUzyqaxWn483cosNhKMR8Kit+xi5kyaKsgpWdk5GqSJjca+K4Ao7qBPe42sQ3INsPSxn0Sh4Q1IRva5P+wm524ivA3dgbMj+OhEP7Yqyfsdp+gRQTw2gUhojlSRclZYkOP/oQMVSyjsSlldD1OrCExDME7U3Mak9BhzfUtqQ4TzMKGz0/E= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000001, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Wed, Mar 26, 2025 at 05:28:00PM +0800, Yuquan Wang wrote: > > > > Notice at both the root and the host bridge, the Interleave Ways is 2. > > There are two targets at each level. The host bridge has a granularity > > of 512 to capture its parent's ways and granularity (`2*256`). > > > > Each decoder is programmed with the total number of targets (4) and the > > overall granularity (256B). > > > > Sorry, I tried to set this topology on Qemu Virt and used: > "cxl create-region -d decoder0.0 -t ram -m mem0,mem1,mem2,mem3" > > but it failed with: > "cxl region: validate_ways: Interleave ways 2 is less than number of memdevs specified: 4" > > It seems like the CFMWs IW should be 4? > It has been a while since i've interacted with QEMU's interleave stuff, but IIRC (at least back when I was working on it) most configurations had 1 device per host bridge - in which case the CFMWS IW should be 4 with each of the host bridges described in it. I'm not sure you can do multiple devices per host bridge without a switch setup. ~Gregory