From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0D594C3600B for ; Thu, 27 Mar 2025 06:30:13 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C0FF12800C6; Thu, 27 Mar 2025 02:30:11 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id BBF3A2800A5; Thu, 27 Mar 2025 02:30:11 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id A87C32800C6; Thu, 27 Mar 2025 02:30:11 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 82AE02800A5 for ; Thu, 27 Mar 2025 02:30:11 -0400 (EDT) Received: from smtpin07.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id 58F9056537 for ; Thu, 27 Mar 2025 06:30:12 +0000 (UTC) X-FDA: 83266356264.07.4576F4F Received: from zg8tmtyylji0my4xnjqumte4.icoremail.net (zg8tmtyylji0my4xnjqumte4.icoremail.net [162.243.164.118]) by imf23.hostedemail.com (Postfix) with ESMTP id 31E2914000E for ; Thu, 27 Mar 2025 06:30:09 +0000 (UTC) Authentication-Results: imf23.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf23.hostedemail.com: domain of wangyuquan1236@phytium.com.cn designates 162.243.164.118 as permitted sender) smtp.mailfrom=wangyuquan1236@phytium.com.cn ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1743057009; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references:references; bh=5ED4aewdYk9i5Q+VxNQX2ZSX58Slh8oraLF1gJZuqYc=; b=63GqMMTphdFbTyzvelvsy3zMca8j3TSeagGAIwyXJYglQloGzoTjF3KUcUDOf58O84W3+h O5PkB0FnEhYoQIqc8cVNlxZWv/3fzpZN7auYx21mjsg6EOmte9dw4uAXS7cdI7xPA4MBch /Se3qn61x0tHhwrYIb2dyGmprDAKkQg= ARC-Authentication-Results: i=1; imf23.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf23.hostedemail.com: domain of wangyuquan1236@phytium.com.cn designates 162.243.164.118 as permitted sender) smtp.mailfrom=wangyuquan1236@phytium.com.cn ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1743057009; a=rsa-sha256; cv=none; b=T5LQYJMQ6xDjkJFlFTlQhu8rUflxS9AFcNVpjv2HMfwvCu5pW0ZlYtwUAFRyCd9bqgLq5E BMutSu7my48oT7PhyRfvJnNf6f0mZOWbDVRCj5Q8GJ2Gqvuce7BoFRqD4VQuKXdEmD5PsP nyy9KSv6xIMMV5aEJ/qjXaD95Ik6xtE= Received: from prodtpl.icoremail.net (unknown [10.12.1.20]) by hzbj-icmmx-6 (Coremail) with SMTP id AQAAfwC3viZo8ORnDTiIDg--.18829S2; Thu, 27 Mar 2025 14:30:00 +0800 (CST) Received: from WYQ-S (unknown [218.76.62.144]) by mail (Coremail) with SMTP id AQAAfwBnaoZm8ORnzQlXAA--.450S3; Thu, 27 Mar 2025 14:29:58 +0800 (CST) Date: Thu, 27 Mar 2025 14:29:58 +0800 From: "Yuquan Wang" To: dan.j.williams , gourry Cc: lsf-pc , linux-mm , linux-cxl , linux-kernel Subject: Re: [Lsf-pc] [LSF/MM] CXL Boot to Bash - Section 4: Interleave References: , , , , , <67e4bd1de1282_152c2942c@dwillia2-mobl3.amr.corp.intel.com.notmuch> X-Priority: 3 X-GUID: DE420CB4-971F-494A-8390-F744B9F2735F X-Has-Attach: no X-Mailer: Foxmail 7.2.25.301[cn] Mime-Version: 1.0 Message-ID: <202503271429584650694@phytium.com.cn> Content-Type: multipart/alternative; boundary="----=_001_NextPart618048217208_=----" X-CM-TRANSID:AQAAfwBnaoZm8ORnzQlXAA--.450S3 X-CM-SenderInfo: 5zdqw5pxtxt0arstlqxsk13x1xpou0fpof0/1tbiAQACAWfkXV4FHAABsa X-Coremail-Antispam: 1Uk129KBjvJXoWxAF1fZF45tw1rur45WrWUXFb_yoWrWr1kpF W2yFW2ga1rXr1xXF1vvryqgFyjgw1kCFWUXryDtryF9r1kZFW8Xr40yF909a4IgF97tw1q q398tF97XrWjyaUanT9S1TB71UUUUUDqnTZGkaVYY2UrUUUUj1kv1TuYvTs0mT0YCTnIWj DUYxn0WfASr-VFAU7a7-sFnT9fnUUIcSsGvfJ3UbIYCTnIWIevJa73UjIFyTuYvj4RJUUU UUUUU X-Rspam-User: X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: 31E2914000E X-Stat-Signature: 4bzikt7rfg78f6qaggeej76t8a9hcw7x X-HE-Tag: 1743057009-70824 X-HE-Meta: U2FsdGVkX18Hh0RY8bJCVsFGRiw+reZN6iUroVPKJRAMtqmvGrR+2VCScI7qn10zCWB+AFWmsdfuca4jlC/Mv9t9L2pSB0JfvSyTQIJGtFARsJTwcFU1PCUAzpifCY+lF3pFNttwMVDXUOoEgh2v4Pwj65ZwFhl3r+f0HtW035zWOrZRQp3oqLBdRj/eqQosdhLmoOa7ko40av6R5XAvOeZcxISd6KJfrxpneM3UU2jYHo+rSVw3kCARuI6PEIlHfTU/Xmb+OjXfRgtjZysVuKfUPUjA5CQu87mVYWjxv/Y7xzOcP2mu9KJF7crtPlNWrlLpQsZssBb/G2RaQPx1jGBbqJvwBNI2cgHouQtbA9AMe+836JgPp1ZzinzNJoI2L1otgOCC38WwNKgmhKYpk5d2a06jWJkkJEAmdLBARfadQ/kXQfEoWNg2zuSKe+X2R+7uj2d9/JdVqslX/oovyKk8NZBPr938F1lyKFmDb/eOeUKBW8QdzbDXV/pY3GFImJYqLX6XL5R7VORx8LkZEMKBx+Rhv0xTZ/pHbVaZd43VW+3MOtodJ0FvxBRsgjQ7X6LxL61mQ1xE1Q5mkSZGCCVFCgH1Qvcb+iUfuu5+RKypXcX91qWI8qGpcLI+BDGCydp3a92UHaTitV1T6gT/XGMeWkBQGvSCiulqK7EU39aW0f+D/ev6dT59azLSCQy1V7HDYmfckOJjtXt/al+c+zIqddrwFWGKSMO6IZbPMUROUJMzeUp1qC382o1KhOcibsDrDpZtycI2wA0DYQ6PKL86CbsPJWUMw7VSBNULr38GSEj351iXz62UbpmIl3xo139dI0xQHfCZgImTb0Ehq4+Zj3KkdIoaeF6GCIxfgpg54eaXER9wyykpckXZU5Pub5iDBaDvT+Yo1mo+HkNUftG74xEm9W5gVwt9nPXx3KdsdXodzGsbTJ+hn5ctdbZLCqqSwVbTNKAl/sdVXGv KD6k93zU YIcMi3S+DoJBCRcH4yyvM6hG1lUl5BwW7yxvRZqZpk597JSdj85kPQKBExt6BA2+PJZ9d8BwQaaU9NNdhbZoYI+cIBzmCTqAOQmW5fubEDAH1Jyow26Zhiq5xrJK9RrZUESxLQ/2J1eLJsA5eGSz8vtAHU/p2pRuZ42qQC6lQKg+nBqU6LEx8fGgn3iZ95BxkqYFaXHLRHok5H9ZPWOLvPEou3KGKAAcE3Dzv+M6cbcJDxgQqXxRCm6nLXEvw0m6fyWcKVxctZCV2Mqnpcvdyc/KDwnRYjHEuMNLpRuLkrPOg5xErdcxRWXZt3A== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: This is a multi-part message in MIME format. ------=_001_NextPart618048217208_=---- Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: base64 T24gMjAyNS0wMy0yNyAxMDo1MSwgIGRhbi5qLndpbGxpYW1zLCBnb3Vycnkgd3JvdGU6DQpZdXF1 YW4gV2FuZyB3cm90ZToNCj4gT24gV2VkLCBNYXIgMjYsIDIwMjUgYXQgMDg6NTM6MTRBTSAtMDQw MCwgR3JlZ29yeSBQcmljZSB3cm90ZToNCj4gPiBPbiBXZWQsIE1hciAyNiwgMjAyNSBhdCAwNToy ODowMFBNICswODAwLCBZdXF1YW4gV2FuZyB3cm90ZToNCj4gPiA+ID4gDQo+ID4gPiA+IE5vdGlj ZSBhdCBib3RoIHRoZSByb290IGFuZCB0aGUgaG9zdCBicmlkZ2UsIHRoZSBJbnRlcmxlYXZlIFdh eXMgaXMgMi4NCj4gPiA+ID4gVGhlcmUgYXJlIHR3byB0YXJnZXRzIGF0IGVhY2ggbGV2ZWwuICBU aGUgaG9zdCBicmlkZ2UgaGFzIGEgZ3JhbnVsYXJpdHkNCj4gPiA+ID4gb2YgNTEyIHRvIGNhcHR1 cmUgaXRzIHBhcmVudCdzIHdheXMgYW5kIGdyYW51bGFyaXR5IChgMioyNTZgKS4NCj4gPiA+ID4g DQo+ID4gPiA+IEVhY2ggZGVjb2RlciBpcyBwcm9ncmFtbWVkIHdpdGggdGhlIHRvdGFsIG51bWJl ciBvZiB0YXJnZXRzICg0KSBhbmQgdGhlDQo+ID4gPiA+IG92ZXJhbGwgZ3JhbnVsYXJpdHkgKDI1 NkIpLg0KPiA+ID4gPg0KPiA+ID4gDQo+ID4gPiBTb3JyeSwgSSB0cmllZCB0byBzZXQgdGhpcyB0 b3BvbG9neSBvbiBRZW11IFZpcnQgYW5kIHVzZWQ6DQo+ID4gPiAiY3hsIGNyZWF0ZS1yZWdpb24g LWQgZGVjb2RlcjAuMCAtdCByYW0gLW0gbWVtMCxtZW0xLG1lbTIsbWVtMyINCj4gPiA+IA0KPiA+ ID4gYnV0IGl0IGZhaWxlZCB3aXRoOg0KPiA+ID4gImN4bCByZWdpb246IHZhbGlkYXRlX3dheXM6 IEludGVybGVhdmUgd2F5cyAyIGlzIGxlc3MgdGhhbiBudW1iZXIgb2YgbWVtZGV2cyBzcGVjaWZp ZWQ6IDQiDQo+ID4gPiANCj4gPiA+IEl0IHNlZW1zIGxpa2UgdGhlIENGTVdzIElXIHNob3VsZCBi ZSA0Pw0KPiA+ID4NCj4gPiANCj4gPiBJdCBoYXMgYmVlbiBhIHdoaWxlIHNpbmNlIGkndmUgaW50 ZXJhY3RlZCB3aXRoIFFFTVUncyBpbnRlcmxlYXZlIHN0dWZmLA0KPiA+IGJ1dCBJSVJDIChhdCBs ZWFzdCBiYWNrIHdoZW4gSSB3YXMgd29ya2luZyBvbiBpdCkgbW9zdCBjb25maWd1cmF0aW9ucw0K PiA+IGhhZCAxIGRldmljZSBwZXIgaG9zdCBicmlkZ2UgLSBpbiB3aGljaCBjYXNlIHRoZSBDRk1X UyBJVyBzaG91bGQgYmUgNA0KPiA+IHdpdGggZWFjaCBvZiB0aGUgaG9zdCBicmlkZ2VzIGRlc2Ny aWJlZCBpbiBpdC4NCj4gPiANCj4gPiBJJ20gbm90IHN1cmUgeW91IGNhbiBkbyBtdWx0aXBsZSBk ZXZpY2VzIHBlciBob3N0IGJyaWRnZSB3aXRob3V0IGENCj4gPiBzd2l0Y2ggc2V0dXAuDQo+ID4N Cj4gUWVtdSBjb3VubGQgYWRkICdjeGwtcnAnIHVuZGVyIGEgY3hsIGhvc3QgYnJpZGdlLiBCZWxv dyBpcyBteSBxZW11DQo+IGNvbW1hbmQ6DQo+IA0KPiAtZGV2aWNlIHB4Yi1jeGwsYnVzX25yPTEy LGJ1cz1wY2llLjAsaWQ9Y3hsLjEgXA0KPiAtZGV2aWNlIGN4bC1ycCxwb3J0PTAsYnVzPWN4bC4x LGlkPXJvb3RfcG9ydDAsY2hhc3Npcz0wLHNsb3Q9MCBcDQo+IC1kZXZpY2UgY3hsLXJwLHBvcnQ9 MSxidXM9Y3hsLjEsaWQ9cm9vdF9wb3J0MSxjaGFzc2lzPTAsc2xvdD0xIFwNCj4gLWRldmljZSBj eGwtdHlwZTMsYnVzPXJvb3RfcG9ydDAsdm9sYXRpbGUtbWVtZGV2PW1lbTIsaWQ9Y3hsLW1lbTEg XA0KPiAtZGV2aWNlIGN4bC10eXBlMyxidXM9cm9vdF9wb3J0MSx2b2xhdGlsZS1tZW1kZXY9bWVt MyxpZD1jeGwtbWVtMiBcDQo+IC1kZXZpY2UgcHhiLWN4bCxidXNfbnI9MjAsYnVzPXBjaWUuMCxp ZD1jeGwuMiBcDQo+IC1kZXZpY2UgY3hsLXJwLHBvcnQ9MixidXM9Y3hsLjIsaWQ9cm9vdF9wb3J0 MixjaGFzc2lzPTAsc2xvdD0yIFwNCj4gLWRldmljZSBjeGwtcnAscG9ydD0zLGJ1cz1jeGwuMixp ZD1yb290X3BvcnQzLGNoYXNzaXM9MCxzbG90PTMgXA0KPiAtZGV2aWNlIGN4bC10eXBlMyxidXM9 cm9vdF9wb3J0Mix2b2xhdGlsZS1tZW1kZXY9bWVtNCxpZD1jeGwtbWVtMyBcDQo+IC1kZXZpY2Ug Y3hsLXR5cGUzLGJ1cz1yb290X3BvcnQzLHZvbGF0aWxlLW1lbWRldj1tZW01LGlkPWN4bC1tZW00 IFwNCj4gLU0gY3hsLWZtdy4wLnRhcmdldHMuMD1jeGwuMSxjeGwtZm13LjAudGFyZ2V0cy4xPWN4 bC4yLGN4bC1mbXcuMC5zaXplPTJHIFwNCj4gDQo+IE15IGxzcGNpIHNob3dzOg0KPiANCj4gLSst WzAwMDA6MDBdLSstMDAuMCAgUmVkIEhhdCwgSW5jLiBRRU1VIFBDSWUgSG9zdCBicmlkZ2UNCj4g IHwgICAgICAgICAgICstMDEuMCAgUmVkIEhhdCwgSW5jLiBWaXJ0aW8gbmV0d29yayBkZXZpY2UN Cj4gIHwgICAgICAgICAgICstMDIuMCAgUmVkIEhhdCwgSW5jLiBWaXJ0aW8gYmxvY2sgZGV2aWNl DQo+ICB8ICAgICAgICAgICArLTAzLjAgIFJlZCBIYXQsIEluYy4gUUVNVSBQQ0llIEV4cGFuZGVy IGJyaWRnZQ0KPiAgfCAgICAgICAgICAgXC0wNC4wICBSZWQgSGF0LCBJbmMuIFFFTVUgUENJZSBF eHBhbmRlciBicmlkZ2UNCj4gICstWzAwMDA6MGNdLSstMDAuMC1bMGRdLS0tLTAwLjAgIEludGVs IENvcnBvcmF0aW9uIERldmljZSAwZDkzIChDWEwpDQo+ICB8ICAgICAgICAgICBcLTAxLjAtWzBl XS0tLS0wMC4wICBJbnRlbCBDb3Jwb3JhdGlvbiBEZXZpY2UgMGQ5MyAoQ1hMKQ0KPiAgXC1bMDAw MDoxNF0tKy0wMC4wLVsxNV0tLS0tMDAuMCAgSW50ZWwgQ29ycG9yYXRpb24gRGV2aWNlIDBkOTMg KENYTCkNCj4gICAgICAgICAgICAgIFwtMDEuMC1bMTZdLS0tLTAwLjAgIEludGVsIENvcnBvcmF0 aW9uIERldmljZSAwZDkzIChDWEwpDQo+IA0KPiBNeSBjeGwgbGlzdCBzaG93czoNCj4gWw0KPiAg IHsNCj4gICAgICJtZW1kZXYiOiJtZW0xIiwNCj4gICAgICJyYW1fc2l6ZSI6MjY4NDM1NDU2LA0K PiAgICAgInNlcmlhbCI6MCwNCj4gICAgICJob3N0IjoiMDAwMDoxNTowMC4wIg0KPiAgIH0sDQo+ ICAgew0KPiAgICAgIm1lbWRldiI6Im1lbTAiLA0KPiAgICAgInJhbV9zaXplIjoyNjg0MzU0NTYs DQo+ICAgICAic2VyaWFsIjowLA0KPiAgICAgImhvc3QiOiIwMDAwOjE2OjAwLjAiDQo+ICAgfSwN Cj4gICB7DQo+ICAgICAibWVtZGV2IjoibWVtMiIsDQo+ICAgICAicmFtX3NpemUiOjI2ODQzNTQ1 NiwNCj4gICAgICJzZXJpYWwiOjAsDQo+ICAgICAiaG9zdCI6IjAwMDA6MGU6MDAuMCINCj4gICB9 LA0KPiAgIHsNCj4gICAgICJtZW1kZXYiOiJtZW0zIiwNCj4gICAgICJyYW1fc2l6ZSI6MjY4NDM1 NDU2LA0KPiAgICAgInNlcmlhbCI6MCwNCj4gICAgICJob3N0IjoiMDAwMDowZDowMC4wIg0KPiAg IH0NCj4gXQ0KPiANCj4gVGhlbjoNCj4gDQo+ICMgY3hsIGNyZWF0ZS1yZWdpb24gLWQgZGVjb2Rl cjAuMCAtdCByYW0gLW0gbWVtMCxtZW0xLG1lbTIsbWVtMw0KPiBjeGwgcmVnaW9uOiB2YWxpZGF0 ZV93YXlzOiBJbnRlcmxlYXZlIHdheXMgMiBpcyBsZXNzIHRoYW4gbnVtYmVyIG9mIG1lbWRldnMg c3BlY2lmaWVkOiA0DQo+IGN4bCByZWdpb246IGNtZF9jcmVhdGVfcmVnaW9uOiBjcmVhdGVkIDAg cmVnaW9ucw0KPiANCj4gVGhpcyBjYXNlIGNvbmZ1ZXNlZCBtZSA6KA0KIA0KV2hhdCBpcyB0aGUg b3V0cHV0IG9mOg0KIA0KICAgIGN4bCBsaXN0IC1NIC1kIGRlY29kZXIwLjANCiANCi4uLm15IGV4 cGVjdGF0aW9uIGlzIHRoYXQgaXQgb25seSBmaW5kcyAyIHBvdGVudGlhbCBlbmRwb2ludCBkZXZp Y2VzDQp0aGF0IGFyZSBtYXBwZWQgYnkgdGhhdCBkZWNvZGVyLCBJLmUuIFFFTVUgZGlkIG5vdCBw cm9kdWNlIGEgQ0ZNV1MgdGhhdA0KaW50ZXJsZWF2ZXMgdGhlIDIgaG9zdC1icmlkZ2VzLg0KIA0K VGhlIGVycm9yIG1lc3NhZ2UgY291bGQgYmUgaW1wcm92ZWQgdG8gY2xhcmlmeSB0aGF0IG9ubHkg ZW5kcG9pbnRzDQptYXBwZWQgYnkgdGhlIGdpdmVuIGRlY29kZXIgYXJlIGNhbmRpZGF0ZXMgdG8g YmUgbWVtYmVycyBvZiBhIHJlZ2lvbi4NCg0KIyBjeGwgbGlzdCAtZCBkZWNvZGVyMC4wDQpbDQog IHsNCiAgICAiZGVjb2RlciI6ImRlY29kZXIwLjAiLA0KICAgICJyZXNvdXJjZSI6MTA5OTUxMTYy Nzc3NiwNCiAgICAic2l6ZSI6MjE0NzQ4MzY0OCwNCiAgICAiaW50ZXJsZWF2ZV93YXlzIjoyLA0K ICAgICJpbnRlcmxlYXZlX2dyYW51bGFyaXR5IjoyNTYsDQogICAgIm1heF9hdmFpbGFibGVfZXh0 ZW50IjoyMTQ3NDgzNjQ4LA0KICAgICJwbWVtX2NhcGFibGUiOnRydWUsDQogICAgInZvbGF0aWxl X2NhcGFibGUiOnRydWUsDQogICAgImFjY2VsbWVtX2NhcGFibGUiOnRydWUsDQogICAgInFvc19j bGFzcyI6MCwNCiAgICAibnJfdGFyZ2V0cyI6Mg0KICB9DQpdDQoNCkNGTVdTOg0KDQogICAgICAg ICAgICAgIFN1YnRhYmxlIFR5cGUgOiAwMSBbQ1hMIEZpeGVkIE1lbW9yeSBXaW5kb3cgU3RydWN0 dXJlXQ0KICAgICAgICAgICAgICBSZXNlcnZlZCA6IDAwDQogICAgICAgICAgICAgIExlbmd0aCA6 IDAwMkMNCiAgICAgICAgICAgICAgUmVzZXJ2ZWQgOiAwMDAwMDAwMA0KICAgICAgICAgICAgICBX aW5kb3cgYmFzZSBhZGRyZXNzIDogMDAwMDAxMDAwMDAwMDAwMA0KICAgICAgICAgICAgICBXaW5k b3cgc2l6ZSA6IDAwMDAwMDAwODAwMDAwMDANCiAgICAgICAgICAgICAgSW50ZXJsZWF2ZSBNZW1i ZXJzIDogMDENCiAgICAgICAgICAgICAgSW50ZXJsZWF2ZSBBcml0aG1ldGljIDogMDANCiAgICAg ICAgICAgICAgUmVzZXJ2ZWQgOiAwMDAwDQogICAgICAgICAgICAgIEdyYW51bGFyaXR5IDogMDAw MDAwMDANCiAgICAgICAgICAgICAgUmVzdHJpY3Rpb25zIDogMDAwRg0KICAgICAgICAgICAgICBR dGdJZCA6IDAwMDANCiAgICAgICAgICAgICAgRmlyc3QgVGFyZ2V0IDogMDAwMDAwMEMNCiAgICAg ICAgICAgICAgTmV4dCBUYXJnZXQgOiAwMDAwMDAxNA0KDQpZdXF1YW4NCg== ------=_001_NextPart618048217208_=---- Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable = =0A =0A
On=  2025-03-27 10:51,  dan.j.williams, gourry wrote:
=
Yuquan Wang wrote:
=0A
> On Wed, Mar 26, 2025 = at 08:53:14AM -0400, Gregory Price wrote:
=0A
> > On Wed, M= ar 26, 2025 at 05:28:00PM +0800, Yuquan Wang wrote:
=0A
> >= > >
=0A
> > > > Notice at both the root and t= he host bridge, the Interleave Ways is 2.
=0A
> > > >= There are two targets at each level.  The host bridge has a granular= ity
=0A
> > > > of 512 to capture its parent's ways a= nd granularity (`2*256`).
=0A
> > > >
=0A
&= gt; > > > Each decoder is programmed with the total number of tar= gets (4) and the
=0A
> > > > overall granularity (256= B).
=0A
> > > >
=0A
> > >
=0A=
> > > Sorry, I tried to set this topology on Qemu Virt and u= sed:
=0A
> > > "cxl create-region -d decoder0.0 -t ram -= m mem0,mem1,mem2,mem3"
=0A
> > >
=0A
> >= > but it failed with:
=0A
> > > "cxl region: validat= e_ways: Interleave ways 2 is less than number of memdevs specified: 4"=0A
> > >
=0A
> > > It seems like the CF= MWs IW should be 4?
=0A
> > >
=0A
> > =0A
> > It has been a while since i've interacted with QEMU's= interleave stuff,
=0A
> > but IIRC (at least back when I w= as working on it) most configurations
=0A
> > had 1 device = per host bridge - in which case the CFMWS IW should be 4
=0A
>= > with each of the host bridges described in it.
=0A
> >= ;
=0A
> > I'm not sure you can do multiple devices per hos= t bridge without a
=0A
> > switch setup.
=0A
> = >
=0A
> Qemu counld add 'cxl-rp' under a cxl host bridge. B= elow is my qemu
=0A
> command:
=0A
>
=0A> -device pxb-cxl,bus_nr=3D12,bus=3Dpcie.0,id=3Dcxl.1 \
=0A
&= gt; -device cxl-rp,port=3D0,bus=3Dcxl.1,id=3Droot_port0,chassis=3D0,slot= =3D0 \
=0A
> -device cxl-rp,port=3D1,bus=3Dcxl.1,id=3Droot_por= t1,chassis=3D0,slot=3D1 \
=0A
> -device cxl-type3,bus=3Droot_p= ort0,volatile-memdev=3Dmem2,id=3Dcxl-mem1 \
=0A
> -device cxl-= type3,bus=3Droot_port1,volatile-memdev=3Dmem3,id=3Dcxl-mem2 \
=0A> -device pxb-cxl,bus_nr=3D20,bus=3Dpcie.0,id=3Dcxl.2 \
=0A
&= gt; -device cxl-rp,port=3D2,bus=3Dcxl.2,id=3Droot_port2,chassis=3D0,slot= =3D2 \
=0A
> -device cxl-rp,port=3D3,bus=3Dcxl.2,id=3Droot_por= t3,chassis=3D0,slot=3D3 \
=0A
> -device cxl-type3,bus=3Droot_p= ort2,volatile-memdev=3Dmem4,id=3Dcxl-mem3 \
=0A
> -device cxl-= type3,bus=3Droot_port3,volatile-memdev=3Dmem5,id=3Dcxl-mem4 \
=0A> -M cxl-fmw.0.targets.0=3Dcxl.1,cxl-fmw.0.targets.1=3Dcxl.2,cxl-fmw.0= .size=3D2G \=0A
>
=0A
> My lspci shows:
=0A=
>
=0A
> -+-[0000:00]-+-00.0  Red Hat, Inc. QEMU = PCIe Host bridge
=0A
>  |     &n= bsp;     +-01.0  Red Hat, Inc. Virtio network dev= ice
=0A
>  |       &nb= sp;   +-02.0  Red Hat, Inc. Virtio block device
=0A>  |          = +-03.0  Red Hat, Inc. QEMU PCIe Expander bridge=0A
>&nb= sp; |           \-04.0&n= bsp; Red Hat, Inc. QEMU PCIe Expander bridge
=0A
>  +-[00= 00:0c]-+-00.0-[0d]----00.0  Intel Corporation Device 0d93 (CXL)
= =0A
>  |         =   \-01.0-[0e]----00.0  Intel Corporation Device 0d93 (CXL)
= =0A
>  \-[0000:14]-+-00.0-[15]----00.0  Intel Corporation= Device 0d93 (CXL)
=0A
>      &n= bsp;       \-01.0-[16]----00.0  Intel C= orporation Device 0d93 (CXL)
=0A
>
=0A
> My cxl l= ist shows:
=0A
> [
=0A
>   {
=0A>     "memdev":"mem1",=0A
> &nb= sp;   "ram_size":268435456,
=0A
>   &= nbsp; "serial":0,
=0A
>     "host":"0000:1= 5:00.0"
=0A
>   },
=0A
>   {=0A
>     "memdev":"mem0",
=0A
>= ;     "ram_size":268435456,
=0A
> &nb= sp;   "serial":0,
=0A
>     "hos= t":"0000:16:00.0"
=0A
>   },
=0A
> =   {
=0A
>     "memdev":"mem2",
= =0A
>     "ram_size":268435456,
=0A
&g= t;     "serial":0,
=0A
>   =   "host":"0000:0e:00.0"
=0A
>   },
=0A>   {
=0A
>     "memdev":"me= m3",
=0A
>     "ram_size":268435456,
= =0A
>     "serial":0,
=0A
> &n= bsp;   "host":"0000:0d:00.0"
=0A
>   }=0A
> ]
=0A
>
=0A
> Then:
=0A
&= gt;
=0A
> # cxl create-region -d decoder0.0 -t ram -m mem0,me= m1,mem2,mem3
=0A
> cxl region: validate_ways: Interleave ways = 2 is less than number of memdevs specified: 4
=0A
> cxl region= : cmd_create_region: created 0 regions
=0A
>
=0A
>= ; This case confuesed me :(
=0A
 
=0A
What is the o= utput of:
=0A
 
=0A
    cxl list -M = -d decoder0.0
=0A
 
=0A
...my expectation is that i= t only finds 2 potential endpoint devices
=0A
that are mapped by = that decoder, I.e. QEMU did not produce a CFMWS that
=0A
interlea= ves the 2 host-bridges.
=0A
 
=0A
The error message= could be improved to clarify that only endpoints
=0A
mapped by t= he given decoder are candidates to be members of a region.
=0A

# cxl list = -d decoder0.0
[
  {
    "deco= der":"decoder0.0",
    "resource":1099511627776,
=
    "size":2147483648,
    "interleave_= ways":2,
    "interleave_granularity":256,
&= nbsp;   "max_available_extent":2147483648,
    "p= mem_capable":true,
    "volatile_capable":true,
<= div>    "accelmem_capable":true,
    "qos_cl= ass":0,
    "nr_targets":2
  }
]

CFMWS:

  &= nbsp;           Subtable Type : 01=  [CXL Fixed Memory Window Structure]
  &n= bsp;           Reserved : 00
  =             Length : 002C
 = ;             Reserved : 00000000<= br>              Window base = address : 0000010000000000
         =     Window size : 0000000080000000
  &nb= sp;           Interleave Members : = ;01
              Interleave Ar= ithmetic : 00
             = ; Reserved : 0000
            &= nbsp; Granularity : 00000000
        &nbs= p;     Restrictions : 000F
      &nb= sp;       QtgId : 0000
      &n= bsp;       First Target : 0000000C
 =             Next Target : 00= 000014

Yuquan
------=_001_NextPart618048217208_=------