From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 5A5D0C48BF6 for ; Mon, 4 Mar 2024 03:08:06 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D93166B007B; Sun, 3 Mar 2024 22:08:05 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id D1BC76B0098; Sun, 3 Mar 2024 22:08:05 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B95856B0080; Sun, 3 Mar 2024 22:08:05 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id A216D6B00A3 for ; Sun, 3 Mar 2024 22:08:05 -0500 (EST) Received: from smtpin24.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id 4F39B1C0712 for ; Mon, 4 Mar 2024 03:08:05 +0000 (UTC) X-FDA: 81857872530.24.94F90D2 Received: from mail-pf1-f170.google.com (mail-pf1-f170.google.com [209.85.210.170]) by imf02.hostedemail.com (Postfix) with ESMTP id 6F9398000D for ; Mon, 4 Mar 2024 03:08:03 +0000 (UTC) Authentication-Results: imf02.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=CdGcBIDa; spf=pass (imf02.hostedemail.com: domain of nifan.cxl@gmail.com designates 209.85.210.170 as permitted sender) smtp.mailfrom=nifan.cxl@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1709521683; a=rsa-sha256; cv=none; b=AuAfrgPU6qQpEcp2VHpkZ5bKV0XSsgMaFxafd8dNR8F3xQz9YKsApgC5lonaUX8Hqv6dei OqZDmhry51k2whg1Et5RhJEzoEHc7Eud7M9jYjw0ib3t881/EW7d5j5LCLmxW/6eQY5AL1 8y4nhg37kAwNmfi3s9tU0SxS/rYlsTQ= ARC-Authentication-Results: i=1; imf02.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=CdGcBIDa; spf=pass (imf02.hostedemail.com: domain of nifan.cxl@gmail.com designates 209.85.210.170 as permitted sender) smtp.mailfrom=nifan.cxl@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1709521683; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=09c5Ld8ZWpizXtKH4r3UpdHmyvyQCrCH0kV5BMr3LS0=; b=AX++z4YK2lSFn0vZNz1QyOF/jV5H3SZ5fTiuvvN0FNjFZYdj4oHa4ZKcPmxJIL14BEnXYF MCH7quELFPwLoiIFLNMdCPQJ6Jb5uBhOA5553Dw6SL50ouXS+rZxqQPPwcNANSHIjQshz0 6fZqfE0pxihz5I+HqLHCZikpuFNzzz4= Received: by mail-pf1-f170.google.com with SMTP id d2e1a72fcca58-6e56787e691so3335804b3a.0 for ; Sun, 03 Mar 2024 19:08:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1709521682; x=1710126482; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:date:from:from:to:cc:subject:date:message-id:reply-to; bh=09c5Ld8ZWpizXtKH4r3UpdHmyvyQCrCH0kV5BMr3LS0=; b=CdGcBIDaD8M2mr07+ltNPhRKwQAKG8z9fKtnNiG3SU/qqndbrRzQ0zlEGfCo2LYu2A K15qGEYfiYyaE9nK/zI6XBJrCnFLI3+zkwOvhKs1O1Nn82xB/ztVH2gyjViu1YVKtCJV K4cS3pWLSz0++kFrUgEC74nkr4mktrbguj3WYpfxH1mBIBd1tYYGYbVzEBbbloVAt+ie U7CgGwtNUyULFP/xsEZ9cvCWCqs77WhtZx5IrPd+jS2qHvzII0ZItQ2IJrtiAKpkBBMM Xc5prsgja1bFoHqhllPCP3ZbYCJCVEB0yEoDxGPwLXuzHhjiwvAMQTBqVY+Lcn+35d98 fR5A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1709521682; x=1710126482; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:date:from:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=09c5Ld8ZWpizXtKH4r3UpdHmyvyQCrCH0kV5BMr3LS0=; b=M6QLF9jPR8pW4lp3lm/A32SKsxR/4nE8tjeK+5ABaslC8uBMzk16NwnAA6SHPXhNh1 L8dI8gPxkte7D7CwbMqMAZ7FZqhz2AQAtcdQCrNm9rovt+uK7dkuJrsnghp1kFzqTDsw ma1mB3DfG/gfhGkqshwHDRFH2bAPqgR9NnZ6VnrL13QDYqtEUGyxJCo+puVFLmxJrZCr lAZQPDbJddH0z+si9sL1Ychj6VoWnHojoyJyUGNGURY0ACxAAvH+tWfDNVIruijDOemQ 6bKqBxKCvehixMrETYcBbwvIqRPmzJWEy9Rs0Z362hXgDvCcagNK0EI4kqxrcyObT0Bv PdUw== X-Forwarded-Encrypted: i=1; AJvYcCWVlIhz2SxVVnDf1Qk3AeI8MY7xckHDp47Q6yvJYwDZ5YloCBBlUhdPkSWc2ayQY6Qgc46Hf5vExXR7LpDWornRTQg= X-Gm-Message-State: AOJu0YxKFeMEsBtmPTFhNbcIuTaIbqrA46MaXCyTSG5OztlwtyFrrzD9 LTaIuOvvTeaz+W34Mj47LheXgS2MSaxa8j3wWzIvy98iguqHiJrU X-Google-Smtp-Source: AGHT+IG2uYM8bLWoyeF3gdZVlOJfprj9tSG/wxizpVtatiHSeXDThSwnJefuUnh4WouBjPO9U9WXKA== X-Received: by 2002:a05:6a20:8f29:b0:1a1:461a:3691 with SMTP id b41-20020a056a208f2900b001a1461a3691mr6916853pzk.15.1709521682220; Sun, 03 Mar 2024 19:08:02 -0800 (PST) Received: from debian ([2601:641:300:14de:bae0:aa65:8bdd:7233]) by smtp.gmail.com with ESMTPSA id a3-20020aa78643000000b006e0debc1b75sm6348979pfo.90.2024.03.03.19.08.00 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 03 Mar 2024 19:08:01 -0800 (PST) From: fan X-Google-Original-From: fan Date: Sun, 3 Mar 2024 19:07:40 -0800 To: "Ho-Ren (Jack) Chuang" Cc: Hao Xiang , Gregory Price , aneesh.kumar@linux.ibm.com, mhocko@suse.com, tj@kernel.org, john@jagalactic.com, Eishan Mirakhur , Vinicius Tavares Petrucci , Ravis OpenSrc , Alistair Popple , "Rafael J. Wysocki" , Len Brown , Andrew Morton , Dave Jiang , Dan Williams , Jonathan Cameron , Huang Ying , linux-acpi@vger.kernel.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, "Ho-Ren (Jack) Chuang" , "Ho-Ren (Jack) Chuang" , linux-cxl@vger.kernel.org, qemu-devel@nongnu.org Subject: Re: [PATCH v1 0/1] Improved Memory Tier Creation for CPUless NUMA Nodes Message-ID: References: <20240301082248.3456086-1-horenchuang@bytedance.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20240301082248.3456086-1-horenchuang@bytedance.com> X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: 6F9398000D X-Stat-Signature: cjd7d83qxgjntw37nud98rkm6o4pwdye X-Rspam-User: X-HE-Tag: 1709521683-946787 X-HE-Meta: U2FsdGVkX1+SibWKu2uddlAu2afA1ILhEt3a3EvLYxXjA9vbSun9ubVR+H1XH/uGN0Z73jiBsyvEfDKL5eQMMk/pzXkRGrv9YLDXEgoaPY4YkF9aXWXSsiOwoSIStilzNhgsTH/6YozvYQcaKI+Hfkqbp5NEbEDriMmC6rK7dLoMHf1pQAjGRNx+HGf+EU4yaX3l4b8jsKSScMd7Uvy6LaLeBmSyUtdHdjyXMWNbMxr1CZjCSh4olhLM5rpQQH/WyTl0boTG9eHpDEaz514bCtL9l/oMlQUCWVGHLsxOkJObkDS+RFAd1tQsyRovsQnWm412Y/i8f+JlUKPH8VQ2vBMINESLMtXFWU0LcjKpxXR9dH3qkjhIpFsOou3s655QG7IdsrLAbayomim+mEHgiqR1/uhm4PrCxnnmQROoMYni26Fc4c17BXUXAINd+PbYMgU8D34CGBkKsXy5guX7XiI4aMtnVisUTqrbzbJHTbU2DrN4idtsP0fnYc+QDCFAy96NPkHfJNE8/f2x08LVt1KJprngnGR7JboVCnw7bMbN9ku59IDABvgHihkeAxEHdq9apOmrQFkWCTr9Aj546uNIJiuF9eYKxeQJUTD0R4vNdeUiI7e4nPTkDlYvlvVMLgzFcYrPUxl7aijlp5MpjpCgB281gg674rKGT6o+YDFS7yN4KlXVawjncQojvGzW17uQAwCYRQyxd4zz5aOhfV1R9/7j3WmjcXw4/ytVtmnvkLdlg7oONn+btTM8QW34fp3hIfObZlKbrP6xF9PqzYgOTx9zUeQEC1VH9PTLnc8UMmLVjViVGsIopTmbE4GFK28KW+UbI2ghRglUD+07oqHE2BSrTriJ4JzonOvKH/2yRBsWo++9Wvzhq0WfCQIPR5Kf8UsayBei3jlNbz7kKfwYoIej2Vh8YQzuDjHTmPfoe0CfWSF+AVgZeVv0zasUZLU/Y9TmisV99HcAgMw Vv+Y83am 9KzYXKwVlQo3Jj5QGXO0/Sxz6JQ/fEhapcIhGs42+fnxopwJhLJYKL/fd4xoye0b+5nRjVIhR8vZqyHM/1+0M4OMBiYjwmHTzjvRAbojCjNeN8d9qoNIW9KiiYdbtZSKcHqy+CbpV1/+vdHSTwflLClUt8NubYDl1qrRWwj23FobMp1c46mUv4lzW6igHol5Xd7p2crZTGmB7OG7ZbhJk0jCmHMSaUEe2VHalzIdCFm0n710M1SPZyQeAlHAUSHd5VT8a90/TmW+eWgwyeVquCrNKvr/pd2iC1GwUxojInsGV4Q5zhYwDeQlKdWVTzUXCRcHp7E9jXaJs7wB4B6wGEy/qbLNvtR167a45g+GOBR1rrtvz/UdIMI+/zh+YfbCAGAF8KMSr28qEXKOCr5ZXqNsGAHgWc7T7RUwpU0zF0F08ldseLyzrsuR0uMrH3j5fWpaBf5gsBwjOC0a03SainbMGtTRRmefnQEbS/YET4mg9bRo0ltaANkS+HxBu3mFVnDTOGztt2kqtq2UPkufLRNmryucVEY5NuRCcOBCXY5CF3Lq5oGc4o+3oGGmcs0Kan5aaWIjCUfQgeSCL6s6RUhyYuH+C9H4X57/OPEVLn/aCFbu+MAmizeku+fWDx0j5vg2HE3YAgbYjBhCKzqMvmYxtWYNTUT9ddOmb X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Fri, Mar 01, 2024 at 08:22:44AM +0000, Ho-Ren (Jack) Chuang wrote: > The memory tiering component in the kernel is functionally useless for > CPUless memory/non-DRAM devices like CXL1.1 type3 memory because the nodes > are lumped together in the DRAM tier. > https://lore.kernel.org/linux-mm/PH0PR08MB7955E9F08CCB64F23963B5C3A860A@PH0PR08MB7955.namprd08.prod.outlook.com/T/ Is this the right patchset you want to refer to? It is about node migration between tiers, how is it related to the context here? Fan > > This patchset automatically resolves the issues. It delays the initialization > of memory tiers for CPUless NUMA nodes until they obtain HMAT information > at boot time, eliminating the need for user intervention. > If no HMAT specified, it falls back to using `default_dram_type`. > > Example usecase: > We have CXL memory on the host, and we create VMs with a new system memory > device backed by host CXL memory. We inject CXL memory performance attributes > through QEMU, and the guest now sees memory nodes with performance attributes > in HMAT. With this change, we enable the guest kernel to construct > the correct memory tiering for the memory nodes. > > Ho-Ren (Jack) Chuang (1): > memory tier: acpi/hmat: create CPUless memory tiers after obtaining > HMAT info > > drivers/acpi/numa/hmat.c | 3 ++ > include/linux/memory-tiers.h | 6 +++ > mm/memory-tiers.c | 76 ++++++++++++++++++++++++++++++++---- > 3 files changed, 77 insertions(+), 8 deletions(-) > > -- > Hao Xiang and Ho-Ren (Jack) Chuang >