From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C0850C47422 for ; Fri, 26 Jan 2024 23:03:39 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id BCD906B007E; Fri, 26 Jan 2024 18:03:38 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id B7DD36B0080; Fri, 26 Jan 2024 18:03:38 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 9F7176B0081; Fri, 26 Jan 2024 18:03:38 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id 8EC906B007E for ; Fri, 26 Jan 2024 18:03:38 -0500 (EST) Received: from smtpin14.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 585EB806FA for ; Fri, 26 Jan 2024 23:03:38 +0000 (UTC) X-FDA: 81722990916.14.7FEADA4 Received: from NAM11-BN8-obe.outbound.protection.outlook.com (mail-bn8nam11on2040.outbound.protection.outlook.com [40.107.236.40]) by imf14.hostedemail.com (Postfix) with ESMTP id 7620C100029 for ; Fri, 26 Jan 2024 23:03:35 +0000 (UTC) Authentication-Results: imf14.hostedemail.com; dkim=pass header.d=memverge.com header.s=selector2 header.b=V6YSEKII; dmarc=pass (policy=none) header.from=memverge.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf14.hostedemail.com: domain of gregory.price@memverge.com designates 40.107.236.40 as permitted sender) smtp.mailfrom=gregory.price@memverge.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1706310215; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=Whlkl0mTO+anoQ/tJn0eZqb+8hQAMIjWulMFaoidSFE=; b=Wc6RXbsannfho2hqwtNHEXIdNn3Fw/m15ERDtYAbP+V60J2WdWf/bn0HjpgP7qaG1AUQN9 DzcmEmCNwCnRHlT7KxTfklBdB98uOaoN7UGQPd9c9LMCa24v/sA1g2UfOwoCTXM0BVHbX9 /9Yz3qxbZ5MVnxzSZHHCoXl99E+pVBE= ARC-Authentication-Results: i=2; imf14.hostedemail.com; dkim=pass header.d=memverge.com header.s=selector2 header.b=V6YSEKII; dmarc=pass (policy=none) header.from=memverge.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf14.hostedemail.com: domain of gregory.price@memverge.com designates 40.107.236.40 as permitted sender) smtp.mailfrom=gregory.price@memverge.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1706310215; a=rsa-sha256; cv=pass; b=0UOAWzbORDWxxfYifogTyHBwoXf+bXy21cV/uLeiBmp56dpx3Z5QtgUNKgHQYM+6KkbQgH w8hpemGc02YowsdwAR2+tHgbrvLsodT5aybovYDDdQgi9FbROyYMCRPxB/sRwJpn4Xg5yA 61vNApkTm1V/TLX92uBayjY1THyzK7U= ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=EEIdBE22z3h0aS4XSFuDjpWSNI1EhKyKrKJtjSb4aqZe2p4kbVukekrOwbAOzlVTBBpsiK48xeO/f2AIY4YM9Iqe/lzWbnLBcIKvPmYzJzjjLPvSh0fxT6kQkjpCKkVVafq3DrtV+aElZQNUp/xwr8UDTOscSitZtaq2fW3bqUdyqfN1HG1Nkm+r1F9SiPu4JuAhBkUyu0RlcUljer/o1pq8TzL07B6jrmDLGhpQ92UAGYgW3jO3wCh6+BmobZHvrQQlDrLj6UHFUh47v7shq2pM4QVBB5XnbsukygrJrzgVPDkLzHJDAIqMzWdkrc+9GZqKUqp8jDHz8LFFfJW4rg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Whlkl0mTO+anoQ/tJn0eZqb+8hQAMIjWulMFaoidSFE=; b=E/Sd7JwWTF3W4CTQ6IhJ6I0yyES1qqhCF+e+mI8VkfuKUxJuaaiW5kBv/u2iDUyCzaHsUJ/aUUK/4+cjmcS+88Dzvs7Lgzrq7orjXtrpbJgUMlPnGY6ckFPnfFrHFcXHK0QLjmJtzWq0ISDspgPHoKHi7pjR0QHAmHZ3uPMDAVaB9yxcI9XCKTsHJ6cGT1gdAGK0ojq9UBmVr0sjvEENzSjVZ6Bz5Afpf+Y0EjbzVgD03aewOd5gbbuzA0YBFVX91C+XulcC9h9+FrhZuabLfWEM2qfVrBseK1Cvmzfthzx0D3tOGJJljsbj+wJiZfUxlhWdBp+FMb7yGhMogDSs+Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=memverge.com; dmarc=pass action=none header.from=memverge.com; dkim=pass header.d=memverge.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=memverge.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Whlkl0mTO+anoQ/tJn0eZqb+8hQAMIjWulMFaoidSFE=; b=V6YSEKIIImXbQooZSNwr3+S0OU5juZ6bSkJgr2bouLjysXerpIsJV8+ypft35ghktXVkRPs5pqWszuvq+egQtgariGhJcjJhe1//ZEBqchCp5o6vli/CQpTO4B2jAZDXT4Tl6lHwxuiHpVTupw8P3sgNtYkDR5VsOkEWHHRs3Ck= Received: from SJ0PR17MB5512.namprd17.prod.outlook.com (2603:10b6:a03:394::19) by SN4PR17MB5814.namprd17.prod.outlook.com (2603:10b6:806:212::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7202.37; Fri, 26 Jan 2024 23:03:32 +0000 Received: from SJ0PR17MB5512.namprd17.prod.outlook.com ([fe80::7a04:dc86:2799:2f15]) by SJ0PR17MB5512.namprd17.prod.outlook.com ([fe80::7a04:dc86:2799:2f15%5]) with mapi id 15.20.7228.023; Fri, 26 Jan 2024 23:03:31 +0000 Date: Fri, 26 Jan 2024 18:03:23 -0500 From: Gregory Price To: "Christoph Lameter (Ampere)" Cc: David Rientjes , Matthew Wilcox , John Hubbard , Zi Yan , Bharata B Rao , Dave Jiang , "Aneesh Kumar K.V" , "Huang, Ying" , Alistair Popple , Andrew Morton , Linus Torvalds , Dave Hansen , Mel Gorman , Jon Grimm , Gregory Price , Brian Morris , Wei Xu , Johannes Weiner , SeongJae Park , linux-mm@kvack.org Subject: Re: [RFC] Memory tiering kernel alignment Message-ID: References: <75f21150-1e12-4f4b-e578-e170e4fea18b@google.com> <2b29dd3d-bb2c-6a8c-94d2-d5c2e035516a@google.com> <17a45e1e-66c4-08ae-92c7-cef4fb0c4e2c@linux.com> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <17a45e1e-66c4-08ae-92c7-cef4fb0c4e2c@linux.com> X-ClientProxiedBy: SJ0PR05CA0101.namprd05.prod.outlook.com (2603:10b6:a03:334::16) To SJ0PR17MB5512.namprd17.prod.outlook.com (2603:10b6:a03:394::19) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SJ0PR17MB5512:EE_|SN4PR17MB5814:EE_ X-MS-Office365-Filtering-Correlation-Id: 92c72705-2241-4ca9-0229-08dc1ec303eb X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 0UgBt7yibUrYkAwPEywwoSJbDuTDsvow1hV9arHZ/kuIpIrNAhgL/qe2NjnG1HE5PvS2HjXqPX3VM4yl9lc+BnSND7mBlKahuD5TcGWnyIuExWTzHaF2srgwMKzXLcW8EL5D+9Q2ZTiTAL0wgizYxXEJ5k2lXv4f6dhGftvQc4eGfQ91ERMRfQiAF7zlrj5Kv0U5GNqLV+ScB0UAw9xwcHfEeLI/dTdYCqrGcK8Xh17OJOdNFKmC1/oeTWnabCpMsMS9Nhr4pLVfsnLv7MOAB47zKAJPC9GE09ZyBYYZ3oqdGTOCnh+RFPV4qkKOETh6eGmwcF0U9f97r+KTFTIhXlOhEQx+7ld+3hhlOkfueRSgjOMe9qm0KFIrOxSfKWhVta8mMvfnny21z1tcOt5zGCQ6Asqr96cH9Po98XkrbVp9IfxEFit+IR8hhUM9ev8+d0t6LRNPYV0g5kikWtLbbmSoQOZLKvju7DOYY/CD5EmQLnV5m1Fgq9KIN1+R0ldfVm2yiUWvxlisCpduLm9TtWXLoYUw62wkJjUmqpgm+CBaToBY8SHKgfSB9rsik63z X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:SJ0PR17MB5512.namprd17.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(136003)(39850400004)(396003)(366004)(376002)(346002)(230922051799003)(186009)(1800799012)(64100799003)(451199024)(26005)(6506007)(6512007)(4326008)(41300700001)(36756003)(6666004)(2616005)(316002)(66946007)(54906003)(6916009)(66476007)(5660300002)(2906002)(44832011)(66556008)(6486002)(38100700002)(8676002)(478600001)(7416002)(8936002)(86362001)(83380400001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?AOd0bUVLg4b6K7eK7Xr0+tHabTCTuF7rknvEKeHZFCa/jalGILuZDxwNJVmR?= =?us-ascii?Q?2FTqUvuDkV6KTwysAeLMoIuiqwHtbRiknjbzg70XP3Zrr5OXO/vH8hSYdO7s?= =?us-ascii?Q?W/dFhs1kqD+KCmB2lfAQ0p6dTiog2UcuaVkfG7zaxQIfwFe9iyAP5TCvcaTR?= =?us-ascii?Q?zPmSzVbY1nXBYIEcMzKVZKCW20A9h1b1rLdL2+Uozpm/pXmTVYlRDpTXyh4U?= =?us-ascii?Q?RK/Ov+GzdRjPG9xOnNXEqpAP0VLs94ERvSG3u0EpriJuUmNguWytriLtDn6M?= =?us-ascii?Q?05/Q7rQO3MMJLXFXLoH//lm4YDh74cqSIsJ5nATfdd2EOXCLrIW6vYJi8A1f?= =?us-ascii?Q?LlDO/r+4sNXiIDHY9rxPR2A2fFa4XXzUpSXtXvGxAI0y5t6s5Bz1UyhcYfxD?= =?us-ascii?Q?3PcduMf3gKpnCLgKYMzY3RwMSmKuOSnclc5z1Z/4TNt2rbhf3Vhy8Ommwmap?= =?us-ascii?Q?ddk4ciR8wKzphFNYTmspcGvcYs6q6whv5jxRx9rM2nTNA0HausiFwkzJwYmH?= =?us-ascii?Q?V5I5y+ryM+iR+F5PCIP46834tGRtYufF/OvTJeo6enRERxC6ORYTEv3LfvFV?= =?us-ascii?Q?UZBRwNL1RKr6uIK4EHpZXJqnsUjXlyCCSn7XKJUdSiGeYf5qOk5tHAUlcSzx?= =?us-ascii?Q?qihpCFhrmBTmrPIYY97JuRLk24pY5X86OTdKoMqzbTGQ1YezHNvuhY0c/xeA?= =?us-ascii?Q?SQhgoaqEfZGKL8singKat0L3n5Er/qEC7MKoWVrXcGnI46/NUoQEklA2LVEe?= =?us-ascii?Q?/srWRgGtqgUwKn5/hY/lVENJeDqinTeKUzY9RJ32Jdq67eh9VIRzqAooLSad?= =?us-ascii?Q?VDvdBFsFov1EZuAi/7Nit1zfj5Pj4s1N00KsUthanOCHBrD5InR2A5lDdInu?= =?us-ascii?Q?dLFCXImXTUi+XO93/v+mqFu+2oU/K95/QDYi82Z794bL0w+53TGpCgmWRUJE?= =?us-ascii?Q?PILxdQV5VPK7H5LeakZYXZ8JQ/4drTTSYejINI3aBtOtoGWo5wwwRXAT68VY?= =?us-ascii?Q?cbg87FZ96DuB1JwxNjgHNMa/BG78qkTZl/EyRjty4wJL2V4xgz0VBDOuh4FS?= =?us-ascii?Q?DD2C+KoZ2m+H/tH9ZAcMoNDlqzKwptiQvLTg9xy5IXsZUyLPtTLor+CENmLJ?= =?us-ascii?Q?M5Mkb24o3ulLAVOUHJRuKZlBIQqg58o7gf5NWxkfCMfjiFwTVT1F+AMnYxDN?= =?us-ascii?Q?980NSrOGLwFt+0r8Kx1kIn2XOd45WFEntFWKxfwgh7cUD5IbLKmx8e1T+CCp?= =?us-ascii?Q?4x7u8vsQG+d6t46XZBkMNqGJ3iVkDfRGiXdtprjznW17ZYJjwsmb8N+nvwuy?= =?us-ascii?Q?iBzefWzGPeDmApDBHUxR+ulZb0yFlADWxeFxicijyd580i9Pep5U6qiwGCwL?= =?us-ascii?Q?S2rSmhIaWr/bXM+DJHXjRo3VAH8E9wm0sm7WzIED3Sd8C3oSq0KnU1j5zs2L?= =?us-ascii?Q?R/rzWoaehfIRywXk5Tm9lTtQ/lDbMsAChwYKGk3w55VFttN+mqo4Jn77RHPO?= =?us-ascii?Q?/LxIx194uy1GJx2j1FH8RAR9tIgatTnphXKqXOKNK85S1Fh1OKU4eCvV2O4o?= =?us-ascii?Q?juhBnZrtpwRfXrZBN0C+4W4g6qzqtltx/k6neTHqlyYsr9nfSAIL2EXGyITV?= =?us-ascii?Q?6Q=3D=3D?= X-OriginatorOrg: memverge.com X-MS-Exchange-CrossTenant-Network-Message-Id: 92c72705-2241-4ca9-0229-08dc1ec303eb X-MS-Exchange-CrossTenant-AuthSource: SJ0PR17MB5512.namprd17.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Jan 2024 23:03:31.4886 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 5c90cb59-37e7-4c81-9c07-00473d5fb682 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: lBAuFBrSnHh+VO79zAslZY/7rQpw6ivEsxtUHhKIft6reXS9jNAN3XzUIJmTBN2lMoVHdujHRTvtoPZPk10zlU5mh8fFPeNNyNfn3kf8A08= X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN4PR17MB5814 X-Rspam-User: X-Rspamd-Server: rspam12 X-Rspamd-Queue-Id: 7620C100029 X-Stat-Signature: br8sqqkaxc1f4w7hijesrmrcgn3bcp91 X-HE-Tag: 1706310215-3776 X-HE-Meta: U2FsdGVkX1+rWZz6RxSHsXIw4KMSusP8SzFIx1m9Y1zSejoP2Cyy0Je7agvpZPUdF2deYVZth2IJpoU6hxwBbW4klRiQBGcpzGdrIVRJS6LJ3qFLcGPVAwWKwVQkNtAb2werTy1XkXjGnTrgwK6ptbHHdlI3fkL0TLml6N+uH6bTRyhHIKSOvxBURN5wrq/cr/Be3NrzM2ESTIiR9xKEsP7P7Lk64N9+Tbk1feo1FKTrijE7y6bMiy13EGvfW6b7e/1Cda4KR8ogGBzdU4Nfo7Ay4qfIISkyi/ShQzZ98BuZMi7tH0g6AJ9+R6dxs/oqwc/hETxkXGKV7MbmX4ig048U3Mp+AZaif31MpXWVg3/+iPA7pGXGeIdHZKUcc0bZixlfIbKSIkh8VAr2xt/hHitKgSUQbqkV47uFrkdO2NSLkcWJNWqKus3aTuon7OGSxkSVDYm3YNN+YPNAAzMLYSOsyMeA8Lib7kU7CtRRDAc39ncADqBJvB/Mmn5RodKBfFcXcY8SUttlbRns5jJY9KYRPGgJ1jhThznwgPzdYDmwzI1nxKIP873Bc5pO9Uys4XbzTxtPHfDs44dY9vmuqRFXnedOSL/HaBEkQmLBLIBq86Uw+HBVyRKRqaCFHNCNAyZ9JQVdGwUQNR3jLiJrrY+Ak1ziEyV1x4vTi4XDJDasqpnEhkOej27i2pG/e+BCgZ8pn3zOvwyj3D/7zX0s0F+hp+SXOJgCSWIgNh4cs/jSVSKVXn//4IOn+k9suRrQ+9Jy3z6q+9ErwLnW8mwTZOQT/Cc2InYL+XijPV0ooNX5OrY2FqLEij5zsJZ18tl0Ihdhv2xsbe+0cvuuOBsUGDcM+2HL37Ezn00DR3ZnTxvbFKpzeInwdo3sJU1vQUBGAK99X4FwBhve90320bPwsjwF1i3vjkOsLlFnyJse9amLcmvVjujmLOYPSLXdrbrHoQ5/zdYaBwZFN0ODsu7 vmc9ewvU VU5Eo7nejkNN1LzCjd51aw6k2xbKXpTM2gFGPaU+tM+iRIPQp/Ohz/9z/tQ1F3eoP9HoV1lQyOyjp1ikuPviGR4dMaOYwiEiD7tEDxSCqZkXeYw9CZMqTP7/NooOxLA6URSPPyX2pCMqv0mM85K0iepm6KbhByoipIvnNF2++ILtFw+Ym/cdlhM4dZ8BM1DEgvZ0k39GIeSRCnLog3L23t63bTPfVN5cRQcFrSYbuCdPc9s65DA/O0Q2Kgp0K4Z5HRYddEc/05txe4AQCt5hp6tMREUYkkE7w1M78 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Fri, Jan 26, 2024 at 01:06:25PM -0800, Christoph Lameter (Ampere) wrote: > On Thu, 25 Jan 2024, David Rientjes wrote: > > > My dream world would be where we could discuss various use cases for > > locally attached CXL memory and determine, as a group, what the shared, > > comprehensive "Linux vision" for it is and do so before LSF/MM/BPF. In a > > perfect world, we could block out an expanded MM session in Salt Lake City > > to bring all these concepts together, what approaches sound reasonable vs > > unreasonable, and leave that conference with a clear understanding of what > > needs to happen. > > I thought the main use of CXL is as a standardized interconnect. We finally > can link up heterogeneous systems with various types of nodes in larger > system configuration. As such it could contain processor nodes, memory nodes > and i/o nodes and allow the setup of powerful systems with large address > spaces, coprocessors, diverse types of processing etc etc. if you ask 30 people what the "main use" of CXL is/will be, you will get 30 different answers. We should not try to solve world peace here. That starts with defining scope, and I think topological details should be extremely limited for a general tiering system. Otherwise we're inviting serious trouble. > > Well yes this is going to create some work but it looks like an exciting way > to move forward to more powerful system configurations. > > All of this will then be possible then in pretty small configurations of > just a couple of chips. > > >