From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 81829C36008 for ; Thu, 27 Mar 2025 02:51:38 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 91C5F2800C1; Wed, 26 Mar 2025 22:51:36 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 8CA3C2800A5; Wed, 26 Mar 2025 22:51:36 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 745902800C1; Wed, 26 Mar 2025 22:51:36 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 572612800A5 for ; Wed, 26 Mar 2025 22:51:36 -0400 (EDT) Received: from smtpin15.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 32FF8141B1D for ; Thu, 27 Mar 2025 02:51:37 +0000 (UTC) X-FDA: 83265805434.15.FED7079 Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.13]) by imf27.hostedemail.com (Postfix) with ESMTP id 329FE40005 for ; Thu, 27 Mar 2025 02:51:32 +0000 (UTC) Authentication-Results: imf27.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=fDrIpmI4; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}"); dmarc=pass (policy=none) header.from=intel.com; spf=pass (imf27.hostedemail.com: domain of dan.j.williams@intel.com designates 192.198.163.13 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1743043894; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=MSPtvXnsCneq8G1OqAHteBGwhblpHLD/H4iecaOJteE=; b=v8B3jOb4CUzexS5sQARdlSrkNhQyxboIr+uo2JgdfGZEI8ldL+ValRSpGzpsZ6kkU0CQOk lKCFFPwkeguH8PcfEBCAY29FLDlu4cfLASp9iqYTnwfkZwGMIQSW1SmYRNJpuewqOIUPOb hLS7w5uTwzoJXAYyh8us+g0x0EY+hIk= ARC-Authentication-Results: i=2; imf27.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=fDrIpmI4; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}"); dmarc=pass (policy=none) header.from=intel.com; spf=pass (imf27.hostedemail.com: domain of dan.j.williams@intel.com designates 192.198.163.13 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1743043894; a=rsa-sha256; cv=fail; b=P5N5uHKgNu8qvKNfgGAAvHTEREAO+J0jH/nt+6z0Wd9SMWt9+boazKoTsBd5InQzvIesDj on5rIOvzzMndI/UBo8CpPzF3Ap5UdYN4Jr6pV/xNtJuNLDl51r4uwRBdoFp4os5BQXGdvs Zjno4ocPdO8X71g26sg0oZkqTk11nKY= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1743043893; x=1774579893; h=date:from:to:cc:subject:message-id:references: in-reply-to:mime-version; bh=F/C/PnlvOCgxR0DcEYu0I1pAQor6iQwU4d5OtPSXzyA=; b=fDrIpmI4vQ9rJgNxdkNglKNVp6CvVaOd9WyVmghH3EX2VkRTPhNq0KpK HEAgHrLH6VUCQ9d3zZIVnyjtEyw2GKww2Mtpl6xg1Gc61Mh2C6KLkLm8O GChGvlf58N15Utbyi0TJWt7jjdAIs33fRfx8pyPjpDXgOwRdnJclgTLFt N9AQPeYdHqVFgWmN327T8D4vcVPv1Ty1epSNenDUk5TW1L4eritVCaKS+ vOC9BY5+VQw6kaxOSgNANFFGZQriD/xDRacAlML3F4JJjJNh/7HokQxRP IKLbsv1YVPLOdhJdUbEDg5LprZxfy2ez8fnGlf7nO0GyaE5Eont0M9jZw w==; X-CSE-ConnectionGUID: Lt6omCJ5SNaOgJ3mheqZVg== X-CSE-MsgGUID: q3GdZjD1RvKYK71098YxXg== X-IronPort-AV: E=McAfee;i="6700,10204,11385"; a="47094605" X-IronPort-AV: E=Sophos;i="6.14,279,1736841600"; d="scan'208";a="47094605" Received: from orviesa001.jf.intel.com ([10.64.159.141]) by fmvoesa107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Mar 2025 19:51:32 -0700 X-CSE-ConnectionGUID: vFE6raewStuKqfWLOWZyCA== X-CSE-MsgGUID: fQT+HVMYRIKOu31Bhth0+w== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.14,279,1736841600"; d="scan'208";a="162237757" Received: from orsmsx903.amr.corp.intel.com ([10.22.229.25]) by orviesa001.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 26 Mar 2025 19:51:31 -0700 Received: from orsmsx603.amr.corp.intel.com (10.22.229.16) by ORSMSX903.amr.corp.intel.com (10.22.229.25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.2.1544.14; Wed, 26 Mar 2025 19:51:30 -0700 Received: from orsedg603.ED.cps.intel.com (10.7.248.4) by orsmsx603.amr.corp.intel.com (10.22.229.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.44 via Frontend Transport; Wed, 26 Mar 2025 19:51:30 -0700 Received: from NAM11-DM6-obe.outbound.protection.outlook.com (104.47.57.169) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.44; Wed, 26 Mar 2025 19:51:29 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=QxNTw8+xUNAQa84Mrhf76OdmlRE7UENwpZ8yhtrVLCZGYgtMqA1TW+n8NLWBIJh+snZOA6OaSMhyS9Nht2SlaZlRnzUQ77ujwK6eds7BqyflEClaQMwv+cK8QMfHxrSR5G8JH6UBxHyOU6idxGm3nqpQDLvJq+l94B2tqmoA0L76xlaY7/WyglF7Detp2u3jCOfGKruQZpPTJzCDUKY1slPGP/9ydVu5lS7wJTsorgcT1LMTVLOjudjIHMtpELOqzW51yAG2DXZttCGkDxDKC/c2u5gZfhmF9JCUy55towXJr+cYM9f9yh/33Bez/93jfhHNmcp9WwXtltXJ40k+7w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=MSPtvXnsCneq8G1OqAHteBGwhblpHLD/H4iecaOJteE=; b=mj/BPw7ugokMEWE9BNxj6g4xWrwwzAOoLl3lCuQbR2d/on5wvk0iukZx7f0n5f3pNP1di8h50SXxTwPCfoYBrZ7IUvdGGWLtPyh/Pi5RA0dQ4K1MRElSzwBT3JCo+cHIjwiZiW3q10C95AIP4Bfg9icC1ye9tdXIg7iDMmjpaSVe3iZ/FmIeKLctd0cadYO6vXgsUBDZSALwnERoUGAT7Ky8oAwOhkOl/oOr8WI6gcHuaFtTaHC5Nc5V+YYh2Vd09GaFxsXWvv9ysOoTALOYIVzKDW6WwTjvFYNbTAHuTO58AwfoGnwuYGQr7jZ0Iun1m437RbZFvcHW6bZmxXdI+A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from PH8PR11MB8107.namprd11.prod.outlook.com (2603:10b6:510:256::6) by IA4PR11MB9059.namprd11.prod.outlook.com (2603:10b6:208:560::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8534.44; Thu, 27 Mar 2025 02:51:14 +0000 Received: from PH8PR11MB8107.namprd11.prod.outlook.com ([fe80::6b05:74cf:a304:ecd8]) by PH8PR11MB8107.namprd11.prod.outlook.com ([fe80::6b05:74cf:a304:ecd8%4]) with mapi id 15.20.8534.043; Thu, 27 Mar 2025 02:51:14 +0000 Date: Wed, 26 Mar 2025 22:51:09 -0400 From: Dan Williams To: Yuquan Wang , Gregory Price CC: , , , Subject: Re: [Lsf-pc] [LSF/MM] CXL Boot to Bash - Section 4: Interleave Message-ID: <67e4bd1de1282_152c2942c@dwillia2-mobl3.amr.corp.intel.com.notmuch> References: Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: MW4PR03CA0095.namprd03.prod.outlook.com (2603:10b6:303:b7::10) To PH8PR11MB8107.namprd11.prod.outlook.com (2603:10b6:510:256::6) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PH8PR11MB8107:EE_|IA4PR11MB9059:EE_ X-MS-Office365-Filtering-Correlation-Id: b7ba09ec-25fb-41f3-a9c3-08dd6cda3cfb X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|376014|1800799024|366016; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?7uk7ACliZfxyWmpIxXsWeIq5HjWfEzl/nDMKRQI/wOl8mQtFPik8X93xADSG?= =?us-ascii?Q?u6nAsOPKJn04WOrl+w5rbqLxtoLemAkVXmKYkBQnpfF6g4TfCwWgHe9qF/dk?= =?us-ascii?Q?jb3aVkqMK+XUd25l0b18VytMaRYEygY1FhvLrh1QfKjEW64LOXORnuYV5G5X?= =?us-ascii?Q?S+TKdDGTbtTjgTc7wR1L5UJvYxva8pOvfJoDrlZWwQjRaFItBBOPkHUcZdw/?= =?us-ascii?Q?9kj4AX4T0rn7FbH0teQX0OQ9AMZnFCrCYu0OVchqELE2RqkwRXIuSatO4HCg?= =?us-ascii?Q?8vtL1IU/xSFcaoBW7OwE5fiBkBDfbouFLzQ3n2QMmL5fyGyIddwjrAJ6Kyz3?= =?us-ascii?Q?NXhP/zngqQTVuU1NN/uvO0IH9Y8uccLSNTXVi/la01QFZj1G9dIiVZZDEhVZ?= =?us-ascii?Q?g288fvC2XkbMic6hS6FQ7UNTwD68Vdl7WPIqJiizESXByYbb72/HEY7vFoVT?= =?us-ascii?Q?bTdKNcMMaPFqunUjvaOdsAryxsWTv4J8tZvDc/P+r0BTh/5Rncwy5qREqqzi?= =?us-ascii?Q?UW3dTpHkdWnSNeLKK9wLXKMe2HAzxOivWCbWkPnZnqmTjalevCXov6b8X4p8?= =?us-ascii?Q?DCF63mGtuFUHZHWfFGCUo8rQ+663m1YnRGi/S2GXkEqs5M7F3p1kqm5RUnRX?= =?us-ascii?Q?fx44srZpPwSc2OL/42CbJnavNQo44N0RO8GO8jeGK7KyfyFkBrbc/LETcEM7?= =?us-ascii?Q?WieESOWTP6LCNscyeQ9Be461dSuCCsUrlNLzfzImzK/WNSQiLCCYMjwZHp2v?= =?us-ascii?Q?9mE9SfCRDdiAsNkArySzLXq7J82Nri26tmCHkaI+ZYPVlPUlool6D2xky5+O?= =?us-ascii?Q?yQqj0dMZ/TLOdypX4AM17UiqGShvxHKuqWidM7Djr9nBDgIifZBlAW2McoNF?= =?us-ascii?Q?922UUraNRALAXHI9etKVSu64bXG6qjIOM7SRNTtlYdzBnahYiwU5wRWQu4eQ?= =?us-ascii?Q?z5DDr5zonkfcm2Ok1+tZ1YJ64rTiaa3cmbnuEmFhdUzdRSgStdrSAFzlBpYm?= =?us-ascii?Q?LsCOeuHCCfXhrP5gcXJ3sxhB3TMKbkQe05URQyJMcaxzaZDHnrmRWtz8DqsO?= =?us-ascii?Q?vQbbMcpxLdsE/UNSblQGydUq2fcTfDtubzxhDxRS83yaR72DVFwCmFm76SDt?= =?us-ascii?Q?ml8USWkPoCnE1+AgXD8BPfoRbmf7/2GkjgzhyzR0dgwpCN5SCV72F6+PGEOX?= =?us-ascii?Q?qDB2z18ftaWFnRsTaHWPrwP96Vdj06aKkrh1olM8wuHfLEWY9YHwtkh5CqoC?= =?us-ascii?Q?twOtOf5tE6DzF8CL/KnJAKMzg+WHfs8f237uJ1x7QbxVpFZo7DF+fedce1f3?= =?us-ascii?Q?6wyNBXq6R9rZT4DmFugkYoe/zV+Hr1KdO8I5GL6NMmsJx9l1JwUVIc6mo6aD?= =?us-ascii?Q?4YhVcsUfAsZB4AHx0P9GHhFF1Z1+?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH8PR11MB8107.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(376014)(1800799024)(366016);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?an+pQiLD2JVKYGi4cpHPzKEzJ1qXjjUSB3ik3g0Lyele0KOOFFv6DF6Wtlgl?= =?us-ascii?Q?fyA9CrTyCmUZocqmOUDB14dwQVNnUtjlD59Uy/pN/9YPsK3qfctFVv2QKEW7?= =?us-ascii?Q?Mgc0kPwl7IVX/+uFoNLTo1XLqgzIzivIft/5dY9/MFIRz01kqtWkU+36T5ti?= =?us-ascii?Q?wVdZs9HvWPXb3LGTmS+6mTnsPByNIgG0m9Gn/4kCIrkt90D3vpcEz1lANFT4?= =?us-ascii?Q?ooDnK8sVRuVVuUX+fiyowfgloWGH2CYCgZZnyj2O5APhcUd76/DxNwd4EGWv?= =?us-ascii?Q?X19c4EVZbMozgLogGkc6tD+3oLUeSKXXX8X3Auzky3GE3S8IUi4cfbmjKtlG?= =?us-ascii?Q?bl35PZoMfGELYO4BsC60YFfXoAqLU7ttMfl/md164r1hH127OoTN7nxk/e1t?= =?us-ascii?Q?2fvVvYL5vZZ09GaEpE1OLbV6vUsXde02Mv14eJnZg8BE7xadpfiHDqhP8WHM?= =?us-ascii?Q?M8PC8EglGthTUSAdOvcJDKjfW13URBXEGBPDi8D9sNTRFTbVs+27uAtK6Y6m?= =?us-ascii?Q?Oh635SUUbddqrStckRBaUFgQxBK5En5IdJ9+meTYk0tpXxu0ci+MI8udBiuK?= =?us-ascii?Q?Dl/VWYxFcxrp6cS528xwig/rCMQcoEBocFOLnGEpvwgTxL8hDbIFcPVhUZj0?= =?us-ascii?Q?17chSq5IXrF8X9XPG2WaVRbUFzK3HtHOcNT28d6VFx1IJ2af+EDr3XaPONMu?= =?us-ascii?Q?pCleEGwFRJjYrUw00mzx2b/WjbqGXAlJoT7EiSUEU5fAP4QIBj/PChHowLz1?= =?us-ascii?Q?6kEfGQhSPtwYZAn47dfZpQmLfFwc9iNLcaP1qYhquYN1SBfgzysJduFAaOL5?= =?us-ascii?Q?SyBKNdtzAXJ0B+/VznAQkH+vCZJW11A9/f3E3KR1kquxlQbgcgu0vQmRDlJ2?= =?us-ascii?Q?Y09SGp0CKQA+9MF3aEfy/dl9qzTccyC7VfC7Zk1vKI0f82TTra+FCXl+cQnj?= =?us-ascii?Q?GxyoxV1zVTkxQpVHrXccwcbMG3YoZWf978gkdzwLYofdKxEHX+H1VFAe7sCj?= =?us-ascii?Q?LcWnTNn2U6k7DcEkRUe0Oof5DAribBvvXMrfxkAVnxYZgoZeVuixjUIxjzHJ?= =?us-ascii?Q?o5FSSsyHe+FWY1oRqDBu2zB7F+UJ/bD8/rO1KzSAfj8Na7FWSSp0NFau4kXq?= =?us-ascii?Q?2RhFrCACgTnigKeXHcQs4tsIaNvuNAoGmvKJwY+kR+9ZtA6Hhq/Vshg0qkdB?= =?us-ascii?Q?/GrZJoFaSxG2YNSROVWqyNr7NOScketwHOCwOrcALrpvH6gvXYg//r5vYcCZ?= =?us-ascii?Q?RWn9loMIhojdQzZ4+AQEpN4Qharh9PPTD5mUME0ft4msng0FnO8OnV2EBgXI?= =?us-ascii?Q?YdrgaYRxnQ4PRjaDUWm4fMMfmMr4FVDvt4jbGCW+ySCs8yiCDOqcPLgkN2oV?= =?us-ascii?Q?rhDYHTSyqKAq839gCIG0VoNRc/Rtu5mEIyzeWV694O64fLHTjfZbnlrHEBZA?= =?us-ascii?Q?9IF2hlrdAjdYYli+agAmU0jIQtnPU/Xkp5L9ufdLNbfkFuiIYf4kvhnS5Tk1?= =?us-ascii?Q?LQXa6i7UvrZuFf/dgHdWO/8LxNSd/9kBvhO/Edjd9by5ouxrK5pwr2R/pyl1?= =?us-ascii?Q?6bei0J1HDRH9mYdUKafKWDdc/yYKJfQHeq6kvDPo2z3JXF8fb3rUZt3sQttP?= =?us-ascii?Q?Gg=3D=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: b7ba09ec-25fb-41f3-a9c3-08dd6cda3cfb X-MS-Exchange-CrossTenant-AuthSource: PH8PR11MB8107.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Mar 2025 02:51:14.0752 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: eiL6aTx6v19pmQcG7ijt8W4t719UCNsNnsJgCZmS/tLOsjske8NustgkhEhvhulxyzCe4K0JM646KXYnQcV8IOEOPyLDJaTz29HE5z83SKQ= X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA4PR11MB9059 X-OriginatorOrg: intel.com X-Rspamd-Server: rspam11 X-Rspamd-Queue-Id: 329FE40005 X-Stat-Signature: 5oak851xm9d31ftb95dmkbhrugi5u46t X-Rspam-User: X-HE-Tag: 1743043892-957827 X-HE-Meta: U2FsdGVkX18r4qS2xtkjobzD3/QUn3kS9t8ZCHrvm4jI2vpdIgfk8KfhS47gCjn40RD9XHNuzAtEUO4zOfCS4ZrGsfu5I4t6G8cL3hl7fYvYRazUcXE8fgadeCnIMBmnjKfUrDsa+VFc88EjLwqmZ6TGV1vs7NBUQhs3PzPIl75dh+eWm/AF6iSWxTY7Xk2zJMN+JoRQa2mMnk96Gs0oAHvms4fRL7cKwwVg4MqicZKLkcZh9X68J0VIJsEMnU+ZyY7ILNs5E+SwsYJ6YUvzgEQSZG3PvIqmjyn5JraT5NV4v1r08qJ1HE6QQUtDSvBGR3Y4q9PRKw9helVI2qCv8XH+g0DRUXHOXvPn1fpTBf6XKyG/Bm5JGvAWyhVzblTmH8TA3YefJqfwnyktbPc5GhnUy/qTYBlOObo/gKQxCtlaNVuoyjvykuzsTbyOUE/HhK0DsOE2lvGfAmJfY0oEi0KTworV0lEMKGyvn58dZaDex7pKAgFd8uPgb1D+ULXmJ5Ikxl2uyh84FEMvu42IMCBneRFqCp1xqkYVmB7OyiF/cm3SR8wJzgoB8G2SqcHlPmlpz6tzh32cBBPaao28nug+D6R820Uhpl1536Pgn5F1rQl+i36nSBTtMpkYhWmOisNEKv//eqlxopsyvqTYw3x0wPOFdRR9GCTRoTPVM2Q/VoI206VuEOEU69MrAL38ZEBvW4i9T+iv0SwSzrp8++vn6p4SBKBHYostowKY4YZDae97064GvvrkKAgAhUWDW6zXdxvPP2LmspS01YNvXlOluG/m31/BmcBFCLugDd8uEjtsXYTOBkj6Us0C4hboyVwd8CnNvUcREwle1u0ioFkt6eMEvVz21/hE2PWQwmRBXfkdM8YIh8EMd0UeU0Jb1d1C7SyNswbfj0L+1DnIaE7/Neme46i5HxA8xl7c0qE= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Yuquan Wang wrote: > On Wed, Mar 26, 2025 at 08:53:14AM -0400, Gregory Price wrote: > > On Wed, Mar 26, 2025 at 05:28:00PM +0800, Yuquan Wang wrote: > > > > > > > > Notice at both the root and the host bridge, the Interleave Ways is 2. > > > > There are two targets at each level. The host bridge has a granularity > > > > of 512 to capture its parent's ways and granularity (`2*256`). > > > > > > > > Each decoder is programmed with the total number of targets (4) and the > > > > overall granularity (256B). > > > > > > > > > > Sorry, I tried to set this topology on Qemu Virt and used: > > > "cxl create-region -d decoder0.0 -t ram -m mem0,mem1,mem2,mem3" > > > > > > but it failed with: > > > "cxl region: validate_ways: Interleave ways 2 is less than number of memdevs specified: 4" > > > > > > It seems like the CFMWs IW should be 4? > > > > > > > It has been a while since i've interacted with QEMU's interleave stuff, > > but IIRC (at least back when I was working on it) most configurations > > had 1 device per host bridge - in which case the CFMWS IW should be 4 > > with each of the host bridges described in it. > > > > I'm not sure you can do multiple devices per host bridge without a > > switch setup. > > > Qemu counld add 'cxl-rp' under a cxl host bridge. Below is my qemu > command: > > -device pxb-cxl,bus_nr=12,bus=pcie.0,id=cxl.1 \ > -device cxl-rp,port=0,bus=cxl.1,id=root_port0,chassis=0,slot=0 \ > -device cxl-rp,port=1,bus=cxl.1,id=root_port1,chassis=0,slot=1 \ > -device cxl-type3,bus=root_port0,volatile-memdev=mem2,id=cxl-mem1 \ > -device cxl-type3,bus=root_port1,volatile-memdev=mem3,id=cxl-mem2 \ > -device pxb-cxl,bus_nr=20,bus=pcie.0,id=cxl.2 \ > -device cxl-rp,port=2,bus=cxl.2,id=root_port2,chassis=0,slot=2 \ > -device cxl-rp,port=3,bus=cxl.2,id=root_port3,chassis=0,slot=3 \ > -device cxl-type3,bus=root_port2,volatile-memdev=mem4,id=cxl-mem3 \ > -device cxl-type3,bus=root_port3,volatile-memdev=mem5,id=cxl-mem4 \ > -M cxl-fmw.0.targets.0=cxl.1,cxl-fmw.0.targets.1=cxl.2,cxl-fmw.0.size=2G \ > > My lspci shows: > > -+-[0000:00]-+-00.0 Red Hat, Inc. QEMU PCIe Host bridge > | +-01.0 Red Hat, Inc. Virtio network device > | +-02.0 Red Hat, Inc. Virtio block device > | +-03.0 Red Hat, Inc. QEMU PCIe Expander bridge > | \-04.0 Red Hat, Inc. QEMU PCIe Expander bridge > +-[0000:0c]-+-00.0-[0d]----00.0 Intel Corporation Device 0d93 (CXL) > | \-01.0-[0e]----00.0 Intel Corporation Device 0d93 (CXL) > \-[0000:14]-+-00.0-[15]----00.0 Intel Corporation Device 0d93 (CXL) > \-01.0-[16]----00.0 Intel Corporation Device 0d93 (CXL) > > My cxl list shows: > [ > { > "memdev":"mem1", > "ram_size":268435456, > "serial":0, > "host":"0000:15:00.0" > }, > { > "memdev":"mem0", > "ram_size":268435456, > "serial":0, > "host":"0000:16:00.0" > }, > { > "memdev":"mem2", > "ram_size":268435456, > "serial":0, > "host":"0000:0e:00.0" > }, > { > "memdev":"mem3", > "ram_size":268435456, > "serial":0, > "host":"0000:0d:00.0" > } > ] > > Then: > > # cxl create-region -d decoder0.0 -t ram -m mem0,mem1,mem2,mem3 > cxl region: validate_ways: Interleave ways 2 is less than number of memdevs specified: 4 > cxl region: cmd_create_region: created 0 regions > > This case confuesed me :( What is the output of: cxl list -M -d decoder0.0 ...my expectation is that it only finds 2 potential endpoint devices that are mapped by that decoder, I.e. QEMU did not produce a CFMWS that interleaves the 2 host-bridges. The error message could be improved to clarify that only endpoints mapped by the given decoder are candidates to be members of a region.