From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id A25EBC54798 for ; Fri, 8 Mar 2024 02:53:35 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id CBE1E6B031C; Thu, 7 Mar 2024 21:53:34 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id C6D3A6B031D; Thu, 7 Mar 2024 21:53:34 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id AC02B6B031E; Thu, 7 Mar 2024 21:53:34 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 9C7126B031C for ; Thu, 7 Mar 2024 21:53:34 -0500 (EST) Received: from smtpin18.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 610DF81280 for ; Fri, 8 Mar 2024 02:53:34 +0000 (UTC) X-FDA: 81872351148.18.20A4229 Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.19]) by imf02.hostedemail.com (Postfix) with ESMTP id EE01C8000A for ; Fri, 8 Mar 2024 02:53:29 +0000 (UTC) Authentication-Results: imf02.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=KTImHRHE; dmarc=pass (policy=none) header.from=intel.com; spf=pass (imf02.hostedemail.com: domain of dan.j.williams@intel.com designates 198.175.65.19 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1709866411; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=liNvJeh7CX/rBrVQmmSoP9pqR0P97ruvvuToDpjaxAE=; b=7czKw6NyJXjLV2P8iZXoBy6FXZXWoKRVhv0YofvIcpg94JR0TT7ocsqUpdigJl/otuM2n/ XTBgSB5DCJwif7OIWyGesd3cNrPZ+XhWFSXBT3wvYGlSYJMFrulyYwLS8U/526UxUNCtsT dDDb7lKqA2NtwYqhuvHpBa3gu9u2DTE= ARC-Authentication-Results: i=2; imf02.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=KTImHRHE; dmarc=pass (policy=none) header.from=intel.com; spf=pass (imf02.hostedemail.com: domain of dan.j.williams@intel.com designates 198.175.65.19 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}") ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1709866411; a=rsa-sha256; cv=fail; b=CGIRHlQfUO1UQeBnfOq3sG0Ia+ro8LS2iLwEoaB57Jm4ebDvVauigOSoCmzDC687rKSyls PO8SQCwg3vr6ogOkzRSoNxTzW2OOydeL7nD4M34XA8fCYHOli/RFBIcWrR3VRS8caxQn4f HTWbIH9YSd+5gOXqZc5gM4aQ7Q41xpg= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1709866410; x=1741402410; h=date:from:to:cc:subject:message-id:references: content-transfer-encoding:in-reply-to:mime-version; bh=A4+WAkba1l6LOBpCVYoG3ahnValJxWv3PJ93CbE9ooI=; b=KTImHRHEjuytJ2+hYm8qhl9CmpVIMcfCYcRlNQ/1kBcaOR/GunZgA3u/ ciG5PYZ+jR6f27wwWbxllubfvk7LkkLGRu21De0FYYkJC0MEBhCHCwfQ1 qkDDmUaG0Q+u/xixP1rRe5vpCCu71KFiXjD4oMRuSXKRP+ru4FL7C7StA Lgpcy10Ag/fBpR/TFjODjzRp+n09tGo/gsXFY8VfWL0M9FtshHQK+cGwE XNcnxzEs+oobvnU/QcEuKJb9Vnx/a4MR0ZFkWUO1IejUwdv4U+1CFavxY GLs5PnbvEQ9P2wEvyBWX67iQba0uWxTKf4TJlT5SPuet3FjwlJ4AOQybM A==; X-IronPort-AV: E=McAfee;i="6600,9927,11006"; a="4432090" X-IronPort-AV: E=Sophos;i="6.07,108,1708416000"; d="scan'208";a="4432090" Received: from orviesa005.jf.intel.com ([10.64.159.145]) by orvoesa111.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 07 Mar 2024 18:53:28 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.07,108,1708416000"; d="scan'208";a="15010517" Received: from fmsmsx602.amr.corp.intel.com ([10.18.126.82]) by orviesa005.jf.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 07 Mar 2024 18:53:29 -0800 Received: from fmsmsx612.amr.corp.intel.com (10.18.126.92) by fmsmsx602.amr.corp.intel.com (10.18.126.82) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Thu, 7 Mar 2024 18:53:27 -0800 Received: from fmsmsx611.amr.corp.intel.com (10.18.126.91) by fmsmsx612.amr.corp.intel.com (10.18.126.92) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Thu, 7 Mar 2024 18:53:27 -0800 Received: from fmsedg601.ED.cps.intel.com (10.1.192.135) by fmsmsx611.amr.corp.intel.com (10.18.126.91) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35 via Frontend Transport; Thu, 7 Mar 2024 18:53:27 -0800 Received: from NAM12-BN8-obe.outbound.protection.outlook.com (104.47.55.169) by edgegateway.intel.com (192.55.55.70) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.35; Thu, 7 Mar 2024 18:53:26 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=G4vHKpZm7o4txS9HGpQCq8XT/+pl8jktlKCKBpJ8rK9Ty1K+OVTzrxzSsgvcpyntf7sAD8sDb13BBMz+RLUiToGTuhIyy4xaPgi6e//OruTIRxiyTw3HPhehRsAYUSZ/BRdyJCffujkD6IWv56QovDDYiD0fAo6JFsw48/PGG8VysP/aTuOTwjNWjBT2c4WjTxbWYpdgJ+iOQSLyGJ7QI+PJGkUzSU578KpbiHT9osVoyMyhQVskJAJh3JnuGA/3LyZVu7idrkzUGPgQINCKvKfMBsXrRCFmvdVzYN2qA9r4EwbZTG/nh97Vn7GvDN2zTYqfDnIrZS02SJbz5DPGFw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=cEnwiZ5jLnG9zg32aAPoTUpazBNeiNhrCbBahSaP0bw=; b=AIkZjs8g2po6sesMB7K3qGz794MzjAVcz4JUAqzF0hBV83L8kO08PQczYe9zmL+bV5h6n5ihjXaeickvsQ6qHhkSPDt2ZClI6wXDR3ISNK8Wf9LzaUCo8tn1RSrawUCyDSlFU1eLDd2IppthJ1sccHcnm0MfXwZGV5pTq+KwV9tLKnytSRzTtb0cCZi/yPFCl2GzkYjJ/wOaFNrUdZ75NYuvwfrWhiVA2qgtczQsEuR9r4/OB67YT19cueEvDTjjf7GMrU5/lTzgxYGDY/V6W58lO2vLEulkRBpLkCQMH0NIKoHwT5SWQJerhPv5xT0wmCRK7TKC0XP6XvBBw5KLTw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from PH8PR11MB8107.namprd11.prod.outlook.com (2603:10b6:510:256::6) by PH0PR11MB7493.namprd11.prod.outlook.com (2603:10b6:510:284::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7362.26; Fri, 8 Mar 2024 02:53:18 +0000 Received: from PH8PR11MB8107.namprd11.prod.outlook.com ([fe80::82fd:75df:40d7:ed71]) by PH8PR11MB8107.namprd11.prod.outlook.com ([fe80::82fd:75df:40d7:ed71%4]) with mapi id 15.20.7362.019; Fri, 8 Mar 2024 02:53:18 +0000 Date: Thu, 7 Mar 2024 18:53:16 -0800 From: Dan Williams To: Jane Chu , Dan Williams , , CC: Linux-MM , Joao Martins , Jane Chu Subject: Re: Barlopass nvdimm as MemoryMode question Message-ID: <65ea7d9c710c0_142a129493@dwillia2-mobl3.amr.corp.intel.com.notmuch> References: <65ea2c1a441d_12713294d9@dwillia2-mobl3.amr.corp.intel.com.notmuch> <65ea60971700e_1ecd29472@dwillia2-xfh.jf.intel.com.notmuch> <36816706-cdf5-4bd0-9be3-0521e2107f32@oracle.com> <0660501f-ae9f-48a3-a1c0-f19be8ca5f02@oracle.com> Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <0660501f-ae9f-48a3-a1c0-f19be8ca5f02@oracle.com> X-ClientProxiedBy: MW4P221CA0013.NAMP221.PROD.OUTLOOK.COM (2603:10b6:303:8b::18) To PH8PR11MB8107.namprd11.prod.outlook.com (2603:10b6:510:256::6) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PH8PR11MB8107:EE_|PH0PR11MB7493:EE_ X-MS-Office365-Filtering-Correlation-Id: e98746e2-a9d5-45a6-8eac-08dc3f1ae8b1 X-LD-Processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 7jBEnBHKJiGuLXecitiCHhFw6Bu+vmx3qQDOCbXRp9inJHA1UaDmZIcPUcaEGIZhmuLz614zL2vnsxOjgeKW9JBq6SZXJ0z9IDIt1WAtSV7uK7e8YVXQj6HHPLhts+1WmdVa9lYlFTe5uir0BAEwEC04ok6UOm6z3WNHFQWF/HvuItkenaj/9dY6/MXgMDJ+r9CgkCKcQNM+y2LKigXs5F6DzVBigY80D5cF8UqJS+ErXwLY3S2rsLgx7umw8o+natCzIPbiqORhn0zQ6SYBEaY60PUDRiOxsb6vrRWpurbbrq/LC6o7ybDXJU5rIqOvv4sxS8OTk2pMLuccfEWbIUJSlJ15By3/owHbJvPCTw3xgtKuSAs/2FlnlZclLMRy2NTgDSaTp40nVOeeZ7ugKcEXTsXJhfvNqXA16vEyNaYESUlAKoMxRAwokYe5rjtLfrJDBZnFOaPh1Vr0PoGnThaEAyV75mVuFf4+3zsHTrtENsqckpVG+IqHx/5Aoy3niJRLZGiEFLvf9iCEnbQmC2yyx3fgM1/lnSoSMqYDFMLKakejXSWH366kkN0JfGKpvQzWEwa8WlOvVc1nJZ32VrKpgwQBALAzuPrMWc4cp7U= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH8PR11MB8107.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(1800799015)(376005);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?iso-8859-1?Q?KRD2l1uE5NOr8JJMKMpEs8TMY9bHk1upIcU5/GDEfCbfzitgBejK6qZYNH?= =?iso-8859-1?Q?ADh2SnvOWFAkk9Q1ce0AsvEgi7A7ZtDe86yHWP1gnLgvk6IeSMoT8Uba6q?= =?iso-8859-1?Q?eHVqBiy4hY385oPXzXHDiwRwoAkfVT5PpB9mGRcQc88fP/Kv/xaQBmvpyU?= =?iso-8859-1?Q?OT/vKQsx+fG8Vq5uVFYiTWe48BH6cvtI2U9hBl/jWnsPY0+R2zcrYwWPEC?= =?iso-8859-1?Q?LyNfZYRQm94vBXxJLrH9i1PnPN9iyM67pMqHVDNoDEVqkqwVZVUPX6gMsw?= =?iso-8859-1?Q?8se94vGub+FxLjTwTPZzJMz2fmXzBc/7SMPtITnXTjF3eEkVjzIhOhjEOV?= =?iso-8859-1?Q?d2ADyPcjekwa5H3fZoh/kn3/vghfhqC8pyKq/v0iQjeb4GeBACBczreZLQ?= =?iso-8859-1?Q?E5ihrymS8W85z2sG8YJWDMhr2FPfplhCDI5OriJVSkkmgEyvF/9jmPIDtO?= =?iso-8859-1?Q?7sysqpycUfBLYDkuxIcXc9nC5uLdo4ZYTiB/k3j9TEBrLX/8WB9bQV/J3q?= =?iso-8859-1?Q?0S2jhRLbxjqIJtm6JrMarZIPYd6jCpRhfk/aO45XLjjvJaJCDyEJ/3ebGe?= =?iso-8859-1?Q?sBD6xhBNHa8+YYWELRSoHAvGYmOfJIcJ1+H0LjdWIpyltTvPFxXXB7x5Jv?= =?iso-8859-1?Q?9R4xZlLRWTnCVQYCinZOosH+AiCxKpDChXtFxHsi2+PAyImsVf11qFvSuU?= =?iso-8859-1?Q?60D7+wL/ZpxuDQW3X5lw+AVTT4SyLEEFWBydZ6fRBu9AUJ9VKsSAUJb2ab?= =?iso-8859-1?Q?X1pD7Ch2lQEcUwcm8ow+mRTWtms9Raq2zv6DO3qid9BDxxBPzeh+PyTfuG?= =?iso-8859-1?Q?qpXjK3WolnmM6X7zIQMQeh0ZzsMtkZf+x0VgyLf9z49sXQHwoay6gk8ecA?= =?iso-8859-1?Q?P2UVUC56yZq9bYVbV9Lm+F5/brgaRMzdyP9rafMyBD7EiArBq+CICgr2hz?= =?iso-8859-1?Q?ddkWSOn9k5GKUgi0ZCSoEDlnJHsn9dRgRSddXfK2qgv6vzKpaZxCPAiIgz?= =?iso-8859-1?Q?zpSLFBjh3EPHSpsVT6byNIcQjXNgqiptE+QuaZDzp5eqnoYG27tyaUEhby?= =?iso-8859-1?Q?VZhMkZQvbOm1bK+ZHlJyqQDC7SbFDdoN1hgs99+voXdhbX6todhK6JI2i2?= =?iso-8859-1?Q?BvLLXwBpoNOZr6gCUs0ragoP6Q8UJojm7paOqhprwwzdABJJDv+3Kn56Rw?= =?iso-8859-1?Q?gHA8W66ZyZcNr2jMW6VPkPJIJsgzi6u6ESPcaZd2BwhCFD0RxOB+1d38WS?= =?iso-8859-1?Q?rEvokx2PVYbJ0tVZUBsUD7vZx7/hNiUaCZ3bMtljtQkOwHqxKqoWUNBCYw?= =?iso-8859-1?Q?ZhpJQ/ipLy186J1NIhNDj9NOGmuxd+OerKQzm5rvKbTzxR4BLdj9s60i5H?= =?iso-8859-1?Q?2OyVgP1ymEIO8cjR8y3gjyX21VwoGZikszwIRDyHpB8vM0T92CXdiIEEct?= =?iso-8859-1?Q?8C/1MFMzTVrMXktllyzJ/fd70lEWCcY+nu0xVw3N7awgrPmqQ+dD6vy/kU?= =?iso-8859-1?Q?LYo6nefqQLRZSr+/MgKOLYS4XyZuHtnLsM9pRlpZNCf6Dwcdp6cWKekrHP?= =?iso-8859-1?Q?rVIfJqc5njeb8K4gpbsBDtRqm9qLMeIOh6acT4LY0gJMOT89NwR/+xoBvR?= =?iso-8859-1?Q?DsVOvzgljpDMWJzdEAnxUEebuLFxfWUttsUlnKRScaMt2Ap1+1mRitdg?= =?iso-8859-1?Q?=3D=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: e98746e2-a9d5-45a6-8eac-08dc3f1ae8b1 X-MS-Exchange-CrossTenant-AuthSource: PH8PR11MB8107.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Mar 2024 02:53:18.7153 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: FCIMHd0bAGnwb1u9BmkV3YXqEqPiFbFqeHPFCuiBam/Emk2hmhqsVfeGb6jpwlFf9Bl1VNCRMNXs2aC0fwAe3SV5GmsIrv65+WlfVCbES7Y= X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR11MB7493 X-OriginatorOrg: intel.com X-Rspamd-Queue-Id: EE01C8000A X-Rspam-User: X-Rspamd-Server: rspam02 X-Stat-Signature: ra7pbzfrhysw7dyhqxxbj7ut8f5qn6ek X-HE-Tag: 1709866409-34489 X-HE-Meta: U2FsdGVkX1+4D+89TrGawN3EHxpAdsfYYV5OtOcPv1Z4rAZY9SjHjTzhC3S85AWAoxZHV7YVvyybbb1PzECp9wnGhYva8iCRZrnDZnwrAHElu9OSteGAqZqZC+Z2IxOVG+7Of2id6TVTlh+fjZxp4vcksHcfGc+606eNxjqQng7wEyTa95Z3xYWM5jFSc/GBgGjhQ7P3aGxne7DPrXjEMa2sq6mz4Dp1P20mcR9VB0L78BZSW7KhjSsirO8w2udaLjF626EyzhfkxjYBRqMDgxxdvQlMur+O6vKGRReqEd4VEuPx7pebGJ4WPx9mIacB/P492yYJQdVXKyewuSFggK5Cps6dZOCWvmYd61MOiUQT47IlX1gB0dB2KjLxGc0UuER2k7JThKHNNvlt6eUUFeB5jFI9RgXzcjjAYkYPS2b9nBZN+Amhlt1xJ3+KCE4BeYCz3do4r8loMais8uUNqapQarLGGK25Z3Tepa7ylsmKHjUSUQkuIylJDcpTSJ1D8eK/pAlFbOpRkta5XwdGqjALzbPnxmUYB7ccma1w/sEW6NKgZ84hU8AfUmH71FxWKrQmJBBlzbqmDHH6qfuJFiZgFlqhYEuSzsaOXsV4/ygHP/ndn2xv4KR09OJ0hDLCYyB1SvWRbViI0K0KqZBdu/BwMt8fgcVPYBxDL6awYgOG+MhML2oYCRrZonQYlwhGi2vAeBwjdaScswcdyrFzdo7BqnqXs7jevyUyQezkbGYSSgKhp3rDwbK0Pzsu6/auQKlgLv0WZrB426kk9aBSnjVYl4t0Xbih+I+8cLaN+p42Ye9Cr60pNwzyFIIRDI5HB/X61Zz3TP888nIAhR3mzNaH3E063ZpmIthC+wc6etS5tMMyAC9UvsmkSeKyBu11sEIY8j3RIZE= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Jane Chu wrote: > On 3/7/2024 5:42 PM, Jane Chu wrote: > > > On 3/7/2024 4:49 PM, Dan Williams wrote: > > > >> Jane Chu wrote: > >>> Add Joao. > >>> > >>> On 3/7/2024 1:05 PM, Dan Williams wrote: > >>> > >>>> Jane Chu wrote: > >>>>> Hi, Dan and Vishal, > >>>>> > >>>>> What kind of NUMAness is visible to the kernel w.r.t. SysRAM region > >>>>> backed by Barlopass nvdimms configured in MemoryMode by impctl ? > >>>> As always, the NUMA description, is a property of the platform not the > >>>> media type / DIMM. The ACPI HMAT desrcibes the details of a > >>>> memory-side-caches. See "5.2.27.2 Memory Side Cache Overview" in ACPI > >>>> 6.4. > >>> Thanks!  So, compare to dax_kmem which assign a numa node to a newly > >>> converted pmem/SysRAM region, > >> ...to be clear, dax_kmem is not creating a new NUMA node, it is just > >> potentially onlining a proximity domain that was fully described by ACPI > >> SRAT but offline. > >> > >>> w.r.t. pmem in MemoryMode, is there any clue that kernel exposes(or > >>> could expose) to userland about the extra latency such that userland > >>> may treat these memory regions differently? > >> Userland should be able to interrogate the memory_side_cache/ property > >> in NUMA sysfs: > >> > >> https://docs.kernel.org/admin-guide/mm/numaperf.html?#numa-cache > >> > >> Otherwise I believe SRAT and SLIT for that node only reflect the > >> performance of the DDR fronting the PMEM. So if you have a DDR node and > >> DDR+PMEM cache node, they may look the same from the ACPI SLIT > >> perspective, but the ACPI HMAT contains the details of the backing > >> memory. The Linux NUMA performance sysfs interface gets populated by > >> ACPI HMAT. > > > > Thanks Dan. > > > > Please correct me if I'm mistaken:  if I configure some barlowpass > > nvdimms to MemoryMode and reboot, as those regions of memory is > > automatically two level with DDR as the front cache, so hmat_init() is > > expected to create the memory_side_cache/indexN interface, and if I > > see multiple indexN layers, that would be a sign that pmem in > > MemoryMode is present, right? > > > > I've yet to grab hold of a system to confirm this, but apparently with > > only DDR memory, memory_side_cache/ doesn't exist. > > On each CPU socket node, we have > > | |-memory_side_cache | | |-uevent | | |-power | | |-index1 | | | > |-uevent | | | |-power | | | |-line_size | | | |-write_policy | | | > |-size | | | |-indexing > > where 'indexing' = 0, means direct-mapped cache?, so is that a clue that > slower/far-memory is behind the cache? Correct. Note that the ACPI HMAT may also populate data about the performance of the memory range on a cache miss (see ACPI 6.4 Table 5.129: System Locality Latency and Bandwidth Information Structure), but the Linux enabling does not export that information.