From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id D5B1EC36000 for ; Fri, 21 Mar 2025 17:36:27 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id BBDB0280002; Fri, 21 Mar 2025 13:36:25 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id B6C73280001; Fri, 21 Mar 2025 13:36:25 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id A33E8280002; Fri, 21 Mar 2025 13:36:25 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 8259F280001 for ; Fri, 21 Mar 2025 13:36:25 -0400 (EDT) Received: from smtpin17.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 95281B72D2 for ; Fri, 21 Mar 2025 17:36:26 +0000 (UTC) X-FDA: 83246262372.17.07FCB80 Received: from tor.source.kernel.org (tor.source.kernel.org [172.105.4.254]) by imf17.hostedemail.com (Postfix) with ESMTP id A98514000F for ; Fri, 21 Mar 2025 17:36:23 +0000 (UTC) Authentication-Results: imf17.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=awF6dJVC; spf=pass (imf17.hostedemail.com: domain of sj@kernel.org designates 172.105.4.254 as permitted sender) smtp.mailfrom=sj@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1742578583; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=NHq/Vvbn2FkVpjjWbIwPzGFAZ9Bjf1cgVNG67AUlB4k=; b=PP3Ta7p4q9oNiHavU8L//mpENLeKpqs7B8I8j3ImAdF+3qqxiQoCwWdfhegnQpy5p+rBGa n38hS0KCiBZzcWbOrhU6gVCRsv+z29n14bicoPiKEwFk4u4LCyIbzcsK6NBcWiAZueI937 poTmBmVWW1XVIbGAT8bpG6abx0hu0GQ= ARC-Authentication-Results: i=1; imf17.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=awF6dJVC; spf=pass (imf17.hostedemail.com: domain of sj@kernel.org designates 172.105.4.254 as permitted sender) smtp.mailfrom=sj@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1742578583; a=rsa-sha256; cv=none; b=n/GbgZzZE4uFWWnDR0qKKv0iRfTqpV31FrJ2oCCR48duR7MKlyj7W26Mv16tDl3+9RowRj vjbM0Up0PNrj1dCPvZo3NC1h+8s3DycCNm/xD84sqFyVfi1fxEjO6c4v8dtTzNzaYe6S3W EHtj+plZbSdRV+s9KGQ4bf9/QSxoBw8= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by tor.source.kernel.org (Postfix) with ESMTP id 0039E61120; Fri, 21 Mar 2025 17:36:20 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id D54B6C4CEE3; Fri, 21 Mar 2025 17:36:21 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1742578582; bh=uZ+xLpqcSupt4aCRYTGlVvk2XlCzCvhypcHJVLDd8gA=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=awF6dJVCbtH0ZQmWXu6skDlgj/TiDBZ5/oMEvCm5zYx3oBTx/6FBF7/pdQ4cZsACD 8TUdrkkuJYeBY4rFS1fb6RBIo3AKpXr6kKl9wsholPvzNWITdOc6SPr2jvvoHF14ND iJ1JE8y3Aryd6OPmAb141mL73htyy/FbHSYfHlyh+mKtu83k5jMC6QZn/lYM7s/p+1 iqeQW5JfI+tQ9Dreu2HlxfuzKW5TFJ7cpIwJVoFx4LLjgJhJIE0FgAX+B2qPp5EPbD 95c7boacyhr22tAf1MhfQBW1n5ZVIUyqBhwEYUaskYPz6MB+HE7l6txGTyRBrmmFxb Ug+HrpwS4i6lg== From: SeongJae Park To: Jonathan Cameron Cc: SeongJae Park , Raghavendra K T , Bharata B Rao , lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, Michal Hocko , Dan Williams , linuxarm@huawei.com, Matthew Wilcox , Johannes Weiner , Gregory Price Subject: Re: [LSF/MM/BPF TOPIC v2] Unifying sources of page temperature information - what info is actually wanted? Date: Fri, 21 Mar 2025 10:36:19 -0700 Message-Id: <20250321173619.51964-1-sj@kernel.org> X-Mailer: git-send-email 2.39.5 In-Reply-To: <20250321153044.000017aa@huawei.com> References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: A98514000F X-Stat-Signature: g5tkck9uw6m9tafmcqhcmtkddr53au81 X-Rspam-User: X-Rspamd-Server: rspam12 X-HE-Tag: 1742578583-367662 X-HE-Meta: U2FsdGVkX1/WguYyc8pfUdTEBrznk4Np+k1EPVIr+vVkWjZ/tN1TT+nIzmi3Z7n223RH5zOPSSDBU/cXg928zNtu+5L9BpENN6ZE7hnlBD9FYOVYHSV7CwPPeqExwpiws+GFM1kJfOh7PkpqzI6sZGaHwS/1qri/7qwnFSDGBbwsmd3QRbvZXRdFTpVIfJp7hsz85EIZkKE+XYJRJW3/ps0m8vPjHh7k/izotfq9GwBpB2RVf8dpJkICE/FeMMOxZM8zHQPzWFsJPExFzGHxGt1rwtFgRhjSLH1u9pMFfnDcMjBqEoeu0sZksW2AFvTc396I4K1JPjumzXqcTNpThMG+ZGm1//Uf6fG7/qKPYZLEVXad6vOa8InELod+U7defFMuzlIwniZNDFr2+DJDDlmPHvoiHKLFDRS7k4JXklnzsAQMQssphhn161b+p3uNg4F9am6t5TNYsy9xCqB9/RH/6+0s5soEhyFx/IdBOfITTAIb7RMdz4qzSMfvFsEkYJUKSMTXjIzQBrYcTLL28SL4MudJd4b1jwMFM+tGbJ1bpCaOvixgQpyUTG6I/YALrQo1J4WLZGxJrSOLPGesYOJN9Gq3FLiOSHHemQdEVX7cwof7b/WgENMJtRB7kpx6IYo1dXXDTW1u3GK0rgLrZFe233gnM8rcyHWUPFIm0nivYcu0IaSI2bWjawOuOZwDaFEmpE/cIw6ITjgjdR/GbyRdRRwBcaABUCcTX0/7TV/6lEHuSq/ZGV29QW4DWN2okD9X+kpiGZZzujuT0CR2Aun5ZNinew+ciU9O7mChdZ3o551+/QR4PfKxDhZ4n6RkJvhBK+Y7V5m4MzYXG3XZMlf4s36Wea5h+1f41d7vSc8y3zw+7pHfSTzJ6UyXvQeI8jjnPLJ4wPUhPP/bwS3+z7S5ejuZkpu8PUY+bhLG3QHZ0K9tlWizecWekAxpwsmOrOCmQnt1BbIrGS1lI/s sgejQn+s DuytpLU/UGHL9yjvCBSb425cyq16gZWH0CEoT47hZGPXlduKS0TZWOCa0i8VTfEvJtelqlbX3VCtwKcB68ud62wqS6GgMFjMThsGLz644cTyt92bLmYqWOoeM72rVpPtPL88SOp8BNZMFIPGyGVsBixdeIJyDvdeM+lZrXvqJmdI9dDl0XaE1ZXZJR1c6Dp1rCctQPwvYLRTkX4IHrv7RYjV7HJMSS/tqF/i7KMn0deUy8zJXSAhyHw5g3qT4sCzxiHgaM8Kc5cV+eM2lM5s6oqthdiOaiYMYkv3V9blw8i4TuPk= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000002, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Fri, 21 Mar 2025 15:30:44 +0000 Jonathan Cameron wrote: Thank you for your nice comments. I agree to all your points, and adding just a few more details below. [...] > Whilst I'm not in a position to share the data, as it's not mine :( I've > seen graphs that show that for at least some use cases, even if we have some > contiguity of hotness in the VA space, it looks like noise in PA. So > I think this is a case of 'mileage may vary'. Damon works great sometimes but > sometime the spared of access statistics happen to be wrong. 100% agree. Your findings and conclusions match with mine. Nevertheless, we are trying to find why and when it works bad and good, and make it better in more cases. So far, we found better visualization methods and DAMON parameters tuning can help. We are therefore adding more visualization methods and DAMON parameters auto-tuning. Still far from the perfect, but it would continue being closer to the north star if we, the community, work together. [...] > > > b) Metadata beyond the counts is useful > > > https://lore.kernel.org/all/87h64u2xkh.fsf@DESKTOP-5N7EMDA/ > > > Promotion algorithms can need aggregate statistics for a memory > > > device to decide how much to move. > > > > DAMOS quotas goal feature is a sort of a feature for this question. It allows > > users to set target metric and value, and tune the aggressiveness. For > > promotions and demotions, I suggested using upper tier utilization and free > > ratio as such possible goal metric, and gonna post an implementation for that > > soon. > > Those are certainly good metrics to consider, but I think we definitely also > need a metric around how beneficial are the moves being made. > > That matters more on the promotion path, because that interrupts access to > hot data and so will cause a temporary drop in performance / latency spike. Good point, and agreed. I think we can, and should, continue making such better metrics together. And I think DAMOS quota goal is a feature that can be easily used for prototypes, experiments and hopefully productionizing of such new metric. The feature is easy to extend for new metrics, and also supports setting multiple goals. Also, it supports users directly feeding arbitrary input to the feedback loop. > > > > > > > > > As noted above, this may well overlap with other sessions. > > > One outcome of the discussion so far is to highlight what I think many > > > already knew. This is hard! > > > > Indeed. Keeping more people on the same page is important and difficult. > > Thank you for your effort again, and looking forward to discuss in more depth! > > > > I'm not sure we'll succeed. This may well be a wild west situation for a while > yet, but hopefully we can slowly converge or at least build some common > parts. I'm very sure this session will be an important step for the journey :) > > Jonathan > > p.s. Heathrow disruption means I'm crossing my fingers on actually getting to > Montreal. I hope it all go well with you! Thanks, SJ [...]