From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7557CC282DE for ; Thu, 13 Mar 2025 17:01:02 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 1E310280004; Thu, 13 Mar 2025 13:01:00 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 1936B280001; Thu, 13 Mar 2025 13:01:00 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id F2916280004; Thu, 13 Mar 2025 13:00:59 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id D1F51280001 for ; Thu, 13 Mar 2025 13:00:59 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id 8D58552A4D for ; Thu, 13 Mar 2025 17:01:00 +0000 (UTC) X-FDA: 83217142680.19.EEE08F9 Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) by imf01.hostedemail.com (Postfix) with ESMTP id A57BB40035 for ; Thu, 13 Mar 2025 17:00:56 +0000 (UTC) Authentication-Results: imf01.hostedemail.com; dkim=none; spf=pass (imf01.hostedemail.com: domain of jonathan.cameron@huawei.com designates 185.176.79.56 as permitted sender) smtp.mailfrom=jonathan.cameron@huawei.com; dmarc=pass (policy=quarantine) header.from=huawei.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1741885258; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3Y83yFJwG6CHTVTP70wAtYO2zWKDStYJ1Gw+4oxkD64=; b=oOWq4aY8EJvV+eC9uZ90wTJUsuVIn0ge1NokOGL+Gl5++g+aHBBWuROPa1DSMqjAxGTjB7 QtnZ0ZnL/OMH82P5J2dmpluTMNBU4Vj7o5q1tOI4ZJPOZk5pmfO9VFLuGOJoTxmCxOtnkV G1A8ySa4huofvG2oNSD+6dFjsrOgSP4= ARC-Authentication-Results: i=1; imf01.hostedemail.com; dkim=none; spf=pass (imf01.hostedemail.com: domain of jonathan.cameron@huawei.com designates 185.176.79.56 as permitted sender) smtp.mailfrom=jonathan.cameron@huawei.com; dmarc=pass (policy=quarantine) header.from=huawei.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1741885258; a=rsa-sha256; cv=none; b=QRXWRdV0jrAiojWXfiKFDAEBlwXPWte8+Q28rG1f0+Qw0EdTGmvz5+MkK4OOyYYBJvBtLa 0dq5Fcr5aRAAcvYuXynJrvE/ZANiw4zbKWAXaAQC8pKNCgV/fxS8+BsV3+uBnsYDZ1tfja BvIkaVNG6Bf9wPEFMLW2QjUQAme0pjU= Received: from mail.maildlp.com (unknown [172.18.186.216]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4ZDDFf6bPpz6M4PN; Fri, 14 Mar 2025 00:57:42 +0800 (CST) Received: from frapeml500008.china.huawei.com (unknown [7.182.85.71]) by mail.maildlp.com (Postfix) with ESMTPS id E2FB9140A77; Fri, 14 Mar 2025 01:00:52 +0800 (CST) Received: from localhost (10.203.177.66) by frapeml500008.china.huawei.com (7.182.85.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.39; Thu, 13 Mar 2025 18:00:52 +0100 Date: Thu, 13 Mar 2025 17:00:51 +0000 From: Jonathan Cameron To: Gregory Price CC: Yuquan Wang , , , , Subject: Re: [LSF/MM] CXL Boot to Bash - Section 0: ACPI and Linux Resources Message-ID: <20250313170051.0000267e@huawei.com> In-Reply-To: References: X-Mailer: Claws Mail 4.3.0 (GTK 3.24.42; x86_64-w64-mingw32) MIME-Version: 1.0 Content-Type: text/plain; charset="US-ASCII" Content-Transfer-Encoding: 7bit X-Originating-IP: [10.203.177.66] X-ClientProxiedBy: lhrpeml100001.china.huawei.com (7.191.160.183) To frapeml500008.china.huawei.com (7.182.85.71) X-Rspam-User: X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: A57BB40035 X-Stat-Signature: 81hoqzgdxs9mpmyhrwx95yxqtanhhbgf X-HE-Tag: 1741885256-560210 X-HE-Meta: U2FsdGVkX1/XmP0vQ+BLAJfpd5JWH0GbfRKEV0hbWm2dndyKJ5s7V1+oj8ZehRWso/apY+9xvYDwblBr2B2TVzlUL2qbJ/TspgQHVYFeoGn8Sz59UqLE282HvWwsd6/HCWpDNdPt+tuIZrpCM2H5zimHOL6MfzCqC6hwGoFpLd8VQW2zyZIkqVfgarmVJMdpun+yCgekpaogb9VmbMXaZv5LrXU0s3fNviTulipPd4M8SMmtsss8pJ7DYre5bKF2iRs/NqfRnG1GhoUXSm0VoGufWpHc4cu6h3mulFv5wRZCmyynSnHEZqpEECpWVPOIxiA1tWBeJKR++dc07yRQ3d+aiKjyApTO1nZWyNf+Ns75gypjuMtbsXpCyshIj6Ry+IFUDE+cGwJi12wLkFOxoMdCOqLA3qXR3j4nsOj9Kv/SmENurXPVE+xI1cKdK4d8Ou8+xwg7cmjkou1dPuP4WiVt+OBvw3/fS15EFE+wOVwVfdkya4ijAoJwAb7e6hobbNqxP7gp+6T7gaCVhQFjrM/0z8vhI3NL5tCytdOSo9hhO6mw7j5VaUQ+TR5PW+P0YmdzXFAyONCl9EYdTXCeQJtNZJizbshb/3C0qUzWwkGwUtc+khagt6ZOLyG8QabfdBY2Dyquvalx7K3J4Q7XNvjY9ZUgTlLDlNP6i+kk9wE4rgbKqqom+eWToImb47r3r3y/u8Jz4sbCQQnOv4b9J89sspSuiEfOdK+clnJpXq8c2Una6B0O0BTOIh6ERb/Tk3uKvUCVSm531+xCD6MLPhQxW0JogdqrdTB1zxXrJSmNU4KOYqJBL5gna97b4JsIhrTupVqqnmqUn9MnBrZ/3bxM/aapn4TpwT8Jf6u8/WXN9hNrJPD9XaQ4qLhleim1q6BtqoXsuu599zmdGyEUftVh+a7NrDlC7pnQabFQjAjsuFWTmDeTG3DJV4ZaRFC15myHi/1Zd+nYzm6/qHm U+iHmy8j 5UuPEogGQfW0iKrHZfFx2N2CekVng1J1HYei2zZx3hYQyXJwHlGfJ59j5Jh2xNOAoa5iROJxY7T94BdKjMlbOfw12z/2nD8YQc3YKOZoz6TaG/NSRApklwXmLIh4YykZ2TGKRQTyTVT/ZxjNAhl1B9LY1sQmcGcfjNElUebHHJubUBWT5uWYQ7Cym9hYXS2q8YsA8fQHBjpaDV4dqLKG5KrAaXCrcgxnANVSblwZx7LScIonMd5Lilu2+ABSf3qL5snvk3XoCmWgXdSz2yVu3lFyBYcErlftDtBrt X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Fri, 7 Mar 2025 10:12:57 -0500 Gregory Price wrote: > On Fri, Mar 07, 2025 at 10:20:31AM +0800, Yuquan Wang wrote: > > > 2a) Is the BIOS programming decoders, or are you programming the > > > decoder after boot? > > Program the decoder after boot. It seems like currently bios for qemu could > > not programm cxl both on x86(q35) and arm64(virt). I am trying to find a > > cxl-enable bios for qemu virt to do some test. > > What's likely happening here then is that QEMU is not emitting an SRAT > (either because the logic is missing or by design). > > From other discussions, this may be the intention of the GenPort work, > which is intended to have placeholders in the SRAT for the Proximity > Domains for devices to be initialized later (i.e. dynamically). > For QEMU you need to provide a whole bunch of config to get SRAT / HMAT etc ( and BIOS never configures the stuff, it's all OS first. I wrote a slightly pathological test case that should give the general idea https://elixir.bootlin.com/qemu/v9.2.2/source/tests/qtest/bios-tables-test.c#L1940 It flushed out a few bugs :) test_acpi_one(" -machine hmat=on,cxl=on" " -smp 3,sockets=3" " -m 128M,maxmem=384M,slots=2" " -device pcie-root-port,chassis=1,id=pci.1" " -device pci-testdev,bus=pci.1," "multifunction=on,addr=00.0" " -device pci-testdev,bus=pci.1,addr=00.1" " -device pci-testdev,bus=pci.1,id=gidev,addr=00.2" " -device pxb-cxl,bus_nr=64,bus=pcie.0,id=cxl.1" " -object memory-backend-ram,size=64M,id=ram0" " -object memory-backend-ram,size=64M,id=ram1" " -numa node,nodeid=0,cpus=0,memdev=ram0" " -numa node,nodeid=1" " -object acpi-generic-initiator,id=gi0,pci-dev=gidev,node=1" " -numa node,nodeid=2" " -object acpi-generic-port,id=gp0,pci-bus=cxl.1,node=2" " -numa node,nodeid=3,cpus=1" " -numa node,nodeid=4,memdev=ram1" " -numa node,nodeid=5,cpus=2" " -numa hmat-lb,initiator=0,target=0,hierarchy=memory," "data-type=access-latency,latency=10" " -numa hmat-lb,initiator=0,target=0,hierarchy=memory," "data-type=access-bandwidth,bandwidth=800M" " -numa hmat-lb,initiator=0,target=2,hierarchy=memory," "data-type=access-latency,latency=100" " -numa hmat-lb,initiator=0,target=2,hierarchy=memory," "data-type=access-bandwidth,bandwidth=200M" " -numa hmat-lb,initiator=0,target=4,hierarchy=memory," "data-type=access-latency,latency=100" " -numa hmat-lb,initiator=0,target=4,hierarchy=memory," "data-type=access-bandwidth,bandwidth=200M" " -numa hmat-lb,initiator=0,target=5,hierarchy=memory," "data-type=access-latency,latency=200" " -numa hmat-lb,initiator=0,target=5,hierarchy=memory," "data-type=access-bandwidth,bandwidth=400M" " -numa hmat-lb,initiator=1,target=0,hierarchy=memory," "data-type=access-latency,latency=500" " -numa hmat-lb,initiator=1,target=0,hierarchy=memory," "data-type=access-bandwidth,bandwidth=100M" " -numa hmat-lb,initiator=1,target=2,hierarchy=memory," "data-type=access-latency,latency=50" " -numa hmat-lb,initiator=1,target=2,hierarchy=memory," "data-type=access-bandwidth,bandwidth=400M" " -numa hmat-lb,initiator=1,target=4,hierarchy=memory," "data-type=access-latency,latency=50" " -numa hmat-lb,initiator=1,target=4,hierarchy=memory," "data-type=access-bandwidth,bandwidth=800M" " -numa hmat-lb,initiator=1,target=5,hierarchy=memory," "data-type=access-latency,latency=500" " -numa hmat-lb,initiator=1,target=5,hierarchy=memory," "data-type=access-bandwidth,bandwidth=100M" " -numa hmat-lb,initiator=3,target=0,hierarchy=memory," "data-type=access-latency,latency=20" " -numa hmat-lb,initiator=3,target=0,hierarchy=memory," "data-type=access-bandwidth,bandwidth=400M" " -numa hmat-lb,initiator=3,target=2,hierarchy=memory," "data-type=access-latency,latency=80" " -numa hmat-lb,initiator=3,target=2,hierarchy=memory," "data-type=access-bandwidth,bandwidth=200M" " -numa hmat-lb,initiator=3,target=4,hierarchy=memory," "data-type=access-latency,latency=80" " -numa hmat-lb,initiator=3,target=4,hierarchy=memory," "data-type=access-bandwidth,bandwidth=200M" " -numa hmat-lb,initiator=3,target=5,hierarchy=memory," "data-type=access-latency,latency=20" " -numa hmat-lb,initiator=3,target=5,hierarchy=memory," "data-type=access-bandwidth,bandwidth=400M" " -numa hmat-lb,initiator=5,target=0,hierarchy=memory," "data-type=access-latency,latency=20" " -numa hmat-lb,initiator=5,target=0,hierarchy=memory," "data-type=access-bandwidth,bandwidth=400M" " -numa hmat-lb,initiator=5,target=2,hierarchy=memory," "data-type=access-latency,latency=80" " -numa hmat-lb,initiator=5,target=4,hierarchy=memory," "data-type=access-bandwidth,bandwidth=200M" " -numa hmat-lb,initiator=5,target=4,hierarchy=memory," "data-type=access-latency,latency=80" " -numa hmat-lb,initiator=5,target=2,hierarchy=memory," "data-type=access-bandwidth,bandwidth=200M" " -numa hmat-lb,initiator=5,target=5,hierarchy=memory," "data-type=access-latency,latency=10" " -numa hmat-lb,initiator=5,target=5,hierarchy=memory," "data-type=access-bandwidth,bandwidth=800M", &data); Jonathan > ~Gregory >