From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id F19C3C4167D for ; Mon, 6 Nov 2023 03:23:09 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 3DB648D0008; Sun, 5 Nov 2023 22:23:09 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 38B2B8D0002; Sun, 5 Nov 2023 22:23:09 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 252D28D0008; Sun, 5 Nov 2023 22:23:09 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 17EA18D0002 for ; Sun, 5 Nov 2023 22:23:09 -0500 (EST) Received: from smtpin10.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id E462EB5657 for ; Mon, 6 Nov 2023 03:23:08 +0000 (UTC) X-FDA: 81426083256.10.1E48736 Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.10]) by imf18.hostedemail.com (Postfix) with ESMTP id 5FA7E1C001C for ; Mon, 6 Nov 2023 03:23:06 +0000 (UTC) Authentication-Results: imf18.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=dzy7zORh; spf=pass (imf18.hostedemail.com: domain of ying.huang@intel.com designates 198.175.65.10 as permitted sender) smtp.mailfrom=ying.huang@intel.com; dmarc=pass (policy=none) header.from=intel.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1699240987; a=rsa-sha256; cv=none; b=vPX93BXtSBGb5aCGvkYNu2H/Ocl9u2CUVJvxI6lFFEo9DfNmKvM8B0HhF6unnDGbbV5mrq 8wAhE/W42Mw+ddZ7uYXC/h8EqA297itdoiCTbU5UrXLoZMAnoWtFbt3XLHBNpv3RznO95A gsQBDotOpNLgS5wFH53ORII5LYp+YI0= ARC-Authentication-Results: i=1; imf18.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=dzy7zORh; spf=pass (imf18.hostedemail.com: domain of ying.huang@intel.com designates 198.175.65.10 as permitted sender) smtp.mailfrom=ying.huang@intel.com; dmarc=pass (policy=none) header.from=intel.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1699240987; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=41Rd5twJNSO7+4HczT/S9PkhLRlrmYDb76NUsyiih9w=; b=20RSaujT5XXdx8vFUCGiiLUGktptfnqWcXHXKAyyh7V826UN5k4lzcyduu8CiXLhqq43zK mhaiotPSLfq981WbAdKXCLKiJBm2RWHlNPJrclWD/cxc3b6zcfOHvywEmeldna45vGLnps 9TyOAQcMQ5dLiRwBvDmjDCbRLCNZ0go= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1699240986; x=1730776986; h=from:to:cc:subject:in-reply-to:references:date: message-id:mime-version; bh=d0GJaRr0bVj8J9IvowV4cvGbvN8Uw+bGKm4vNcfReLQ=; b=dzy7zORhFPcnQ1h0w79eTVp75jGYBGvk+EB5dKtV729FCF1gyOnJcR6/ n7EFsmOja8Vu61cYhw3J95MD9CFXzHtlcw9GGvfrIWvh1eWaVJ82BbtZM Dz3Ohjh4TMeE+HnfbbNiCS9VoZ4VwumtsqZHqD6zaHkxzijr8ATaeq98q P3UpqoPZYw0za2QPCOlssnsDZuOo3JLCHPvH0rwhd2EdSo/m0WIK7KYEP ouM/R1zHAP71SVD+AZmkFpCbSkP1vES6rZRilcVVkXXSE353v9Q0qV+FE RRXQwnAEY42l7A4DiKanOd42YI1wWO8eK5yw7XrmklrLblAXFVg88Vsj0 A==; X-IronPort-AV: E=McAfee;i="6600,9927,10885"; a="2182572" X-IronPort-AV: E=Sophos;i="6.03,280,1694761200"; d="scan'208";a="2182572" Received: from orsmga004.jf.intel.com ([10.7.209.38]) by orvoesa102.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 05 Nov 2023 19:23:04 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10885"; a="885772160" X-IronPort-AV: E=Sophos;i="6.03,280,1694761200"; d="scan'208";a="885772160" Received: from yhuang6-desk2.sh.intel.com (HELO yhuang6-desk2.ccr.corp.intel.com) ([10.238.208.55]) by orsmga004-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 05 Nov 2023 19:23:00 -0800 From: "Huang, Ying" To: Jonathan Cameron Cc: Gregory Price , Michal Hocko , Johannes Weiner , Gregory Price , , , , , , , , , , , , Subject: Re: [RFC PATCH v3 0/4] Node Weights and Weighted Interleave In-Reply-To: <20231103141636.000007e4@Huawei.com> (Jonathan Cameron's message of "Fri, 3 Nov 2023 14:16:36 +0000") References: <20231031003810.4532-1-gregory.price@memverge.com> <20231031152142.GA3029315@cmpxchg.org> <87fs1nz3ee.fsf@yhuang6-desk2.ccr.corp.intel.com> <20231103141636.000007e4@Huawei.com> Date: Mon, 06 Nov 2023 11:20:58 +0800 Message-ID: <8734xjworp.fsf@yhuang6-desk2.ccr.corp.intel.com> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=ascii X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: 5FA7E1C001C X-Stat-Signature: 985rrfsd9wg9dg969bgf678p31cicj58 X-Rspam-User: X-HE-Tag: 1699240986-232070 X-HE-Meta: U2FsdGVkX1+C873uFlAW5pwaJ4ATcddUZR+R79Jh+oS5KRfYZwMppYZu2kpD1v/q9Ir5AuwYJzrLMxIZQgvFJQj3iQgCcHQ/F75+mWhODkUgHKUCf3I9vlnxDQfehg00AFkHAv60bLsK5kk40jO0g91QvW+q6JNcoCLo2jNVk/Y1kQfyY2ZNv2nuoqCMBuzAEHawpKzhJ0v8vGNrQdPQSNgq4u6VqQUXvai5qgh/xT+mEEq6s5YbRku9TCIISFG1KdxpNJupF03ZKzmmbHRWTvUefVmuowHFrX2PYzBfAmr3Czq2J6HCie/Y18xDn7h1rtFSk7Cbd4VO/WRBaxCGPPK++LBV/czbpLYApZok1KHAz2iJaCXf0kcV15vk0zmjy1u3Umdda61U5VvhLN1uJVaRVf2lan2ezEpX/La4pw6rnCtq+z82ZdsUl2CyCHAbOVHVnMFMC8gA+0L8Y4F8lHc5lm6ppAm6YH6Yf+NaPe38H09bWJc8gbpS+hDZ7XILEMQj977SvhIshoooYDJquILLNwP7UJbATv4k48zoXiFnKPdUTjhHfyNtk4ze/W1siMmDSvUpnhghxrf0BbRV3eIkNKPy0ramdRnK6diJ2SqRv4e+V6+vlOiQE7CI4bERPvlzENDJZ7Vd2U/uGPBao0GB3vRGRaXgLMDAUyGfSRHspdrcGXBCK0j/z4QEHGTkxfPu09tplBKmgUj1ITiUXX9pUOazyORd8DWdExvkk8gLCdBcFlrQTAbXSG1IVAkg4tPRDRz3jht9/8YjTwbbqNEA0briQuvsFY485H0akSfUMylEH5loBydsm/D5fUdHPBRqd07+NyJzhxRA7l/uLrljdy8sT/wtLosX1slDlU7vUra9mjhqev/Vy1XMWLpXBJ9HRrfQWn8fS1n57vvDrZWvzfiC6KglTIY395op8wR+vWjQpZd+xdYLuX1UM+C2IXxcGiUjq5GatmQ0l1f tIyFKQUD r1Xqu9Sf7HLx10XsTcvraufP6oH5UWoY9P0ufj5ZLevkYgeNDggdai1cJ/a0NtPvjgN5Do+5y4pHqJgm4QyzaRH519ukUWgJy9mQHAlT3TE8h27NHWxlJ5zgRtWJhEDraPl4bq9BwYLnpvTW8iJ3h/eXFLsWQ+wGVt4F1zTGIhtrIhHI4Z0UawmqOFTpHGcrYCPniPZYkFrSoW+IFfLiYzCoBh1rnQo/7EnPWfKuZ3xY7tr4+0DbnvcDjSYRy0KvlgsA0stMIj2fL/ln9ZTL7b6h0pIuPCAmiO7YO42VACtF4DeIRGsYMWflkz+DtDxXYEKPOV74Uok5evMI= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Jonathan Cameron writes: > On Fri, 03 Nov 2023 15:45:13 +0800 > "Huang, Ying" wrote: > >> Gregory Price writes: >> >> > On Thu, Nov 02, 2023 at 10:47:33AM +0100, Michal Hocko wrote: >> >> On Wed 01-11-23 12:58:55, Gregory Price wrote: >> >> > Basically consider: `numactl --interleave=all ...` >> >> > >> >> > If `--weights=...`: when a node hotplug event occurs, there is no >> >> > recourse for adding a weight for the new node (it will default to 1). >> >> >> >> Correct and this is what I was asking about in an earlier email. How >> >> much do we really need to consider this setup. Is this something nice to >> >> have or does the nature of the technology requires to be fully dynamic >> >> and expect new nodes coming up at any moment? >> >> >> > >> > Dynamic Capacity is expected to cause a numa node to change size (in >> > number of memory blocks) rather than cause numa nodes to come and go, so >> > maybe handling the full node hotplug is a bit of an overreach. >> >> Will node max bandwidth change with the number of memory blocks? > > Typically no as even a single memory extent would probably be interleaved > across all the actual memory devices (think DIMMS for simplicity) within > a CXL device. I guess a device 'could' do some scaling based on capacity > provided to a particular host but feels like they should be separate controls. > I don't recall there being anything in the specification to suggest the > need to recheck the CDAT info for updates when DC add / remove events happen. Sounds good! Thank you for detailed explanation. > Mind you, who knows in future :) We'll point out in relevant forums that > doing so would be very hard to handle cleanly in Linux. Thanks! -- Best Regards, Huang, Ying