From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B63E2C46CA0 for ; Tue, 5 Dec 2023 08:42:38 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 1B3696B007B; Tue, 5 Dec 2023 03:42:38 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 163A36B007D; Tue, 5 Dec 2023 03:42:38 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 003626B007E; Tue, 5 Dec 2023 03:42:37 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id E12A86B007B for ; Tue, 5 Dec 2023 03:42:37 -0500 (EST) Received: from smtpin22.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id B2CBDA0AD8 for ; Tue, 5 Dec 2023 08:42:37 +0000 (UTC) X-FDA: 81532123554.22.1BCAE5A Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2041.outbound.protection.outlook.com [40.107.237.41]) by imf18.hostedemail.com (Postfix) with ESMTP id 69C4F1C0011 for ; Tue, 5 Dec 2023 08:42:34 +0000 (UTC) Authentication-Results: imf18.hostedemail.com; dkim=pass header.d=micron.com header.s=selector2 header.b=X9Xx8bSq; dmarc=pass (policy=reject) header.from=micron.com; spf=pass (imf18.hostedemail.com: domain of sthanneeru.opensrc@micron.com designates 40.107.237.41 as permitted sender) smtp.mailfrom=sthanneeru.opensrc@micron.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1701765754; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=7r2kKGVp+XYl3zfMpQaQhPsbOW9XCf2yDig0v3uMkO0=; b=l2O3PduPS/Nq8upuPBXsOUpPSOP961UCq5VmJPkCx8926nvuetygC/p1LdoyLmEZ1YFLhU 06ueGim06T6GeEEdaSk6DA3s5USYeEKzdK40GVXYo5kHNT+wj0G0f8OKVKRMkYxGQtKbcc tMjmcmWcLlk96xESV2F5wtNcAbW9H6Q= ARC-Authentication-Results: i=2; imf18.hostedemail.com; dkim=pass header.d=micron.com header.s=selector2 header.b=X9Xx8bSq; dmarc=pass (policy=reject) header.from=micron.com; spf=pass (imf18.hostedemail.com: domain of sthanneeru.opensrc@micron.com designates 40.107.237.41 as permitted sender) smtp.mailfrom=sthanneeru.opensrc@micron.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1701765754; a=rsa-sha256; cv=pass; b=MU3eztfZ96kRzQdVusfbje6WXt+patAMdkj88tEp2FTov5JCHopqQuIM4a1On4At39QW8r qIAS2q8jDrHQAKyXk4jJ1rqlJd6TaOMb4pd2kTbCbkU5gUFHIdZ2A5zvq/SJlRHIFPM2HL UEhBqPIKmqX7MUuGeWrtWwb6oC6DHpk= ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=JmEF3YGCyFUdEuAzidXP7gwXJui05n/Fgfy6nxIXRoxtbGvYrLYabCdT7mn/dMSADiqjuRoDfNOyghspbIwU55lAs4OrZ6LEzB6yoRzdrJRPim0czkvDQjTx/BfAZK9K2e7CKcIg7W5Hz4Ig9lnbGopw1zLED22qtYqFn6Iw+1xe+Gw30U109npiCK3f/C99PmB9LxNLCz+5BgaxFxRR7XwDKUUlAvN7J9xwJcbub9gQ9SOCR8DKH+eNgYJWNdSe0zOCkaE1wiqmBoMN2DKqXHnKKY4X8/RNzjz+PBIkuPLF852FoYvr7GebnnqQs+ZfMe1oy3WelhbxMf9HaB16WA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=7r2kKGVp+XYl3zfMpQaQhPsbOW9XCf2yDig0v3uMkO0=; b=KIujEE/IS/qfmpidIUbAVAg6KLIpSZyq9LoGVUvbKcajPIUvzi7bgd2exd4Kk9kKaGgz757/SYFmtqK/2Ipmqo3p+y64O40vfFe/bF1wVux+jbWYAUuPVlP1K9DpDrZK71goPEIRj6gtQT1XvjsvBso18a3O7Gb2TPy7ryS2vo8pvCV3g6CuodLAXSPSxgyJ6JrNUM8+UNMDMw3vDZd1RWQISEtn8bIQ17Xzwymlk2qImEJ6D2LwAyyU4aXSPhBCf6QzO9fs4G74t02iCxKUfuXwQhGpR+n2kiKjukxiIHOwXyRZFl+AtnscMn22CtvZlOheIs/VuPvlz6Tkgry1BA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 137.201.242.130) smtp.rcpttodomain=suse.com smtp.mailfrom=micron.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=micron.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=micron.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7r2kKGVp+XYl3zfMpQaQhPsbOW9XCf2yDig0v3uMkO0=; b=X9Xx8bSqeUnItSAphgE6QSDSXnLAbpvWlrYzEkCoyX5fw9oKtgIwPQPeZpF5Z8qgCpfU4NhZc0EIMwSynRmJ/twexcQUWjd4b9lp9dt266a0C8/YA6IXNzcrf2kM9PjUW+4GzVsQqVwGgxtWsHzrL3p30PgSBzhDxa6KXMTnu2tUj5QwDyvXgZ/rSABc9TMUci1PgBfGnt/hvyMKmNvb+o7heAkWn4nC47HdxhEBrOHheLSL6nbySFU+aALpwXotmTx1hmbktsVNa6buHQipSLTe7svakhXq71LMhn/kqLLVps37uVMBGPmOpou31rxaEacv/mfVchGt7D3zbhbL3A== Received: from DM6PR02CA0042.namprd02.prod.outlook.com (2603:10b6:5:177::19) by SJ0PR08MB6717.namprd08.prod.outlook.com (2603:10b6:a03:2ac::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7025.21; Tue, 5 Dec 2023 08:42:28 +0000 Received: from DS3PEPF000099E0.namprd04.prod.outlook.com (2603:10b6:5:177:cafe::3) by DM6PR02CA0042.outlook.office365.com (2603:10b6:5:177::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7046.33 via Frontend Transport; Tue, 5 Dec 2023 08:42:28 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 137.201.242.130) smtp.mailfrom=micron.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=micron.com; Received-SPF: Pass (protection.outlook.com: domain of micron.com designates 137.201.242.130 as permitted sender) receiver=protection.outlook.com; client-ip=137.201.242.130; helo=mail.micron.com; pr=C Received: from mail.micron.com (137.201.242.130) by DS3PEPF000099E0.mail.protection.outlook.com (10.167.17.203) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7068.20 via Frontend Transport; Tue, 5 Dec 2023 08:42:26 +0000 Received: from BOW17EX19A.micron.com (137.201.21.218) by BOW17EX19B.micron.com (137.201.21.219) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1258.27; Tue, 5 Dec 2023 01:42:25 -0700 Received: from [10.3.101.85] (10.3.101.85) by RestrictedRelay17EX19A.micron.com (137.201.21.218) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1258.27 via Frontend Transport; Tue, 5 Dec 2023 01:42:19 -0700 Message-ID: <2552828e-6865-4fa8-a9c4-8ed76dd85257@micron.com> Date: Tue, 5 Dec 2023 14:12:17 +0530 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [EXT] Re: [RFC PATCH 0/2] Node migration between memory tiers Content-Language: en-US To: Michal Hocko CC: , , , , , , , , , , , , , , , , , , References: <20231130220422.2033-1-sthanneeru.opensrc@micron.com> <1db561a9-6984-418d-9305-a2a5ece93696@micron.com> From: Srinivasulu Thanneeru In-Reply-To: Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 7bit X-MT-Whitelisted: matched X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS3PEPF000099E0:EE_|SJ0PR08MB6717:EE_ X-MS-Office365-Filtering-Correlation-Id: d6a080d3-c46a-45d3-2715-08dbf56e1c14 X-LD-Processed: f38a5ecd-2813-4862-b11b-ac1d563c806f,ExtAddr X-EXT-ByPass: 1 X-MT-RULE-Whitelisted: Triggered X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: ZYwp7ZKtzecaEQ1PhczekeY12ZNUH589G5s6/ne3w0SLyShUyvY4f+kiSmGs2nYXHcoVoqzAD7bthFpKFhbgs84GwNPqvRjwDFpHQVb70h5KDTmymlywiimfuwOv6aHXfTBRUBtd8XndTFLd4I1X8NFYBn1BRfq5dzBpDNU8SHYpuQXmamUvt9fnpbwSSDUeVY224Lkl26PzNEtyXC+92dZGKZMkkaPmA3mTcjB7SemFfZJO8kcnbfOVsd1NvsS93x+T3ylBqu1z/p4+JSJr69j5/mcUyIG4wdP6exV4yFcxLH/qla8247WXgtlzLt/HJq0MdSfGWIDcrWxVSv0aMjhhscrYXZG8VzWqVnwCjeJhWd8Ia54p0SFfTeUxoda1/nshQmtpUsUpRrUL04o+OFRvSD46gt+OgKRsGm7/2q+HAUAVM9oU+GuEQv/cBb6Bp4AV3M6qcXI9avZgll8adZ5xNdrHSILsD9EGvWqy4Brog5wprMr5fBT8faS6SEYxqliIV59YUKTgNeVJlz0nXeq6u8zCJgyoNPSewdxt1eVSMqzZYmoq+HbG9sC11xTcoT5ZboNTHxB5ak8tRKGYSvF7aF6wps67Y1xjoUVv8nhBA8spskAEYEbxAwQm89MhPdE2Bk4W1QWcX5gcy/3ylnGK7dl7zdORVlDY20qYNM5x84eFvl3Gd3VoUuRR85YSmSzrvZ9hoh2LAjR7H8CZet6rmIKFpVRG+yXTfYlpT0x7JjQBddcr5fdJPi9j08DN3JcJKVwLbX/GWVB+e0UlgA2gcCec3FEY5wjmKG3vHuFHQysFnm57UPXJUrHdrJqbU0ORfwOMH1UcN2PQJXGKd/VEBj7J2D6dtr1QqUeIxlY= X-Forefront-Antispam-Report: CIP:137.201.242.130;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.micron.com;PTR:masquerade.micron.com;CAT:NONE;SFS:(13230031)(4636009)(136003)(346002)(396003)(376002)(39860400002)(230173577357003)(230273577357003)(230922051799003)(64100799003)(82310400011)(1800799012)(451199024)(186009)(36840700001)(46966006)(40470700004)(2906002)(31686004)(40480700001)(5660300002)(7416002)(40460700003)(82740400003)(36756003)(36860700001)(4326008)(478600001)(426003)(26005)(54906003)(47076005)(356005)(336012)(86362001)(8676002)(41300700001)(53546011)(83380400001)(316002)(6916009)(16576012)(2616005)(8936002)(70206006)(70586007)(7636003)(31696002)(3940600001)(43740500002);DIR:OUT;SFP:1101; X-OriginatorOrg: micron.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Dec 2023 08:42:26.8410 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: d6a080d3-c46a-45d3-2715-08dbf56e1c14 X-MS-Exchange-CrossTenant-Id: f38a5ecd-2813-4862-b11b-ac1d563c806f X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f38a5ecd-2813-4862-b11b-ac1d563c806f;Ip=[137.201.242.130];Helo=[mail.micron.com] X-MS-Exchange-CrossTenant-AuthSource: DS3PEPF000099E0.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR08MB6717 X-Rspamd-Queue-Id: 69C4F1C0011 X-Rspam-User: X-Rspamd-Server: rspam04 X-Stat-Signature: je3x9uceut5tbjhew93qrici9sermqiq X-HE-Tag: 1701765754-340281 X-HE-Meta: U2FsdGVkX19F4ykl7gym3cYznrSyPL6m4ln+KHI7P22Ib9beS31lQIe/2EmUSgdIWCgljkIaoer/RKeHJsurkqgdkcf4BoIWYDtsiLNxs2Z8sqdxfHPKzDoDGX20SzGa8oJOcJ734JSCBF0za1b2PuJRz7F96zNdU4MF8iUPtY1kgMhYwEm1DkZaArR0epTU2XWb9GOVnK4B3rg60DqCUfs5muf2C8cq0PO/m38zCeoBgBrd/DsqHd5egwE0BphsaUJwk8pb7TNQNCMNI9pSjSjQKxOBQSRcACKqM2vL7OH02NHhC0VFTREIJ/X43APvUsxbm6WrTybYzndx6Ql30nOJDWlcu17/5hKydrT1qo3tzvfmmh4EXCu7HLLK80Tw8WygA6kswJ2PNsvzGL/Va4rF9njDCE7f6zTN+KHUt7/f+z3ScDX06hm3IMvLXJ6WAll0UjnTnaKNLAWLHfMMpKBMyQP8fHyTFYQJmwbnevmjJ0Mx2yKtMj7wXiY7ng2K2kohbE7X3aXhy3Jz8CzSOEyhs0gfoT6m3Db5WEFMfjnehiyBa+FgpHqlOm3cTpECw1WsQ0Hl1OEJx6irZFSEKkL3WVfG9KlRKDrCP3FXRmQuOOp89ddIsl1Amz85Cv5mFparETDFi8pRTvSkwtvMnb7r63qx8Z4cfXnjFXEHRFUeayKyGmszita7b5MbuhW2v6DnFg08xPkKlWQ7oYhhW/tD3ykCg74oAsXD9Bg7o946LfuSOlJcjM/MGFHC+EthnzVic7t99vPrWwRFD8DIoDiEN/QN8X3LNzHg51vfooZyfgCQjYnXMTwRin8cniIAY1n+hLSTRiSqOmlO/MeJi0Wi7oNGcIiZ+11xCFN2ZOQJScB9z86Tv4fT/tK4BTS8dv7TzMLvw4g5hT7hTmrjKlhWN5ALpD7VXzftoFf+NEv4NzVINV6XQqw9ATKdMwJMtyOAmJ9eRZye3MZgXzX fXRDgisL oDDSxw2aC2nqnahCAT+FQ8uTepvdaA7qvv4odixxa3nRGEBuqmr3O9H2b9CqWWcHi+2i2QxuKIkeoMihbgBH5ui64EAdTnEO3riaGSLbKwSlQGhTb7VGfs4+QNubsbZ34yANnr2xionyaLixP3mYqax4KkkOjxDYJ4KzLSmtv6CPaYU5HXg5BB9mckYJp5ntWYOUp6O1PP9kRJxMErO9QPh0XWHT+sDNlgCAxHYgxTE34v1f/ARmagJtw8sEKINDf6cvqqp1zsz2FL7yuqBFvKT/M4F1YAayqEecbaPIpHCDQnnsbnsh3ssffWPcJNIXyDbD1Cb3+jVEfyhon1FDN2n0fUC8Y4039wOeg X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 12/5/2023 2:05 PM, Michal Hocko wrote: > CAUTION: EXTERNAL EMAIL. Do not click links or open attachments unless you recognize the sender and were expecting this message. > > > On Tue 05-12-23 01:26:07, Srinivasulu Thanneeru wrote: >> >> >> On 12/4/2023 9:13 PM, Michal Hocko wrote: >>> CAUTION: EXTERNAL EMAIL. Do not click links or open attachments unless you recognize the sender and were expecting this message. >>> >>> >>> On Fri 01-12-23 03:34:20, sthanneeru.opensrc@micron.com wrote: >>>> From: Srinivasulu Thanneeru >>>> >>>> The memory tiers feature allows nodes with similar memory types >>>> or performance characteristics to be grouped together in a >>>> memory tier. However, there is currently no provision for >>>> moving a node from one tier to another on demand. >>> >>> Could you expand on why this is really needed/necessary? What is the >>> actual usecase? >> >> Hi Michal Hock, >> >> Following two use-cases we have observed. >> 1. It is not accurate to group similar memory types in the same tier, >> because even similar memory types may have different speed grades. > > Presumably they are grouped based on a HW configuration. Does that mean > that the configuration is wrong? Are you trying to workaround that by > this interface? > >> 2. Some systems boots up with CXL devices and DRAM on the same memory-tier, >> we need a way to move the CXL nodes to the correct tier from the user space. > > Again, could you expand a bit more and explain why this cannot be > configured automatically? Yes, in both cases above, if hardware not automatically populated properly, in that case this interface would help to correct it from user space. We had observed case-2 in our setups. > -- > Michal Hocko > SUSE Labs