From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 03D79C25B75 for ; Wed, 15 May 2024 19:35:03 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 68B136B03B0; Wed, 15 May 2024 15:35:03 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 63B196B03B6; Wed, 15 May 2024 15:35:03 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 529F76B03B8; Wed, 15 May 2024 15:35:03 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 346506B03B0 for ; Wed, 15 May 2024 15:35:03 -0400 (EDT) Received: from smtpin22.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 3E5FF815A1 for ; Wed, 15 May 2024 19:35:02 +0000 (UTC) X-FDA: 82121633244.22.05CB187 Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) by imf04.hostedemail.com (Postfix) with ESMTP id 2E59C40004 for ; Wed, 15 May 2024 19:34:59 +0000 (UTC) Authentication-Results: imf04.hostedemail.com; dkim=pass header.d=infradead.org header.s=bombadil.20210309 header.b=dmBrRXrA; dmarc=fail reason="No valid SPF, DKIM not aligned (relaxed)" header.from=kernel.org (policy=none); spf=none (imf04.hostedemail.com: domain of mcgrof@infradead.org has no SPF policy when checking 198.137.202.133) smtp.mailfrom=mcgrof@infradead.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1715801700; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=GE1c3UWw1puy2keZXVPp8nIgNgXTG5j/czPycY5D+IM=; b=t3aDt89zVpyBVkbY9gWUBp2uwitUiRWYqB2QqIJmnX4/ZvahCJEaHTe8XpNsMuSZp6AefB e0Mb1dTxrTXyZPX5IUlP1FQar59lIYF3/oPdDksheIVydZHG5iRvEwmBn0fk41ex78cQUS DQybmMFVjwbV6t6O5h8GY4qNNnvoPCg= ARC-Authentication-Results: i=1; imf04.hostedemail.com; dkim=pass header.d=infradead.org header.s=bombadil.20210309 header.b=dmBrRXrA; dmarc=fail reason="No valid SPF, DKIM not aligned (relaxed)" header.from=kernel.org (policy=none); spf=none (imf04.hostedemail.com: domain of mcgrof@infradead.org has no SPF policy when checking 198.137.202.133) smtp.mailfrom=mcgrof@infradead.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1715801700; a=rsa-sha256; cv=none; b=wca2lQW3l+YNvIQhQsvFeyvxcQfGOjw8pTOIO8zPRgiuDu/hLvUvO4GKtAzsDUu/DRK0OL I5n0BwiqjwqBfIDDNvi7ATLLbBraayeeFZXVSthgYyw/FoWt4NWLebFBdFVNiR7n7gxK7n j5RhMoH5m/2ICDvlRKAGE1784tOFgeA= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Sender:Content-Type:MIME-Version: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:In-Reply-To:References; bh=GE1c3UWw1puy2keZXVPp8nIgNgXTG5j/czPycY5D+IM=; b=dmBrRXrAYHR2aJBl8LHnhOUCBd DVHKuAXrdDoCnB2ga1lQ6Kpe1FRX4iOPBTbqDBcgi8+Jvbj19VHxDgOF05U73vqcxGfbb/vBWFvTW j6HX0r5tUwIdDcMDeCt3Chl+ov09idsszeA8l23bwpLu2vobjVCE1Lxfc9LIubNCSQDPhdQmL6jrE WpAHV1Mi2M2fh0WaCc4CzebOsK7EUpm/tIVkImIn5u92cizXaIdGZILppXWYFcIEcoPzPKXTkiwQr VnRNna+U7NX8V13rVFd/+1bBKHi13QNO8gwb36Zm9HDfocfYoUBaa2YB79U8JM6tfZalmrKt3Fl4F XpXCDlZA==; Received: from mcgrof by bombadil.infradead.org with local (Exim 4.97.1 #2 (Red Hat Linux)) id 1s7KOr-00000002iVk-1Ool; Wed, 15 May 2024 19:34:53 +0000 Date: Wed, 15 May 2024 12:34:53 -0700 From: Luis Chamberlain To: Michal Hocko , Dan Williams Cc: Luis Chamberlain , Yu Zhao , John Hubbard , Daniel Gomez , linux-mm , lsf-pc@lists.linux-foundation.org Subject: [LSFMM] automating measuring memory fragmentation Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Queue-Id: 2E59C40004 X-Stat-Signature: k4m4kdz56ufuzdg5d6zgm9m5z19p36zs X-Rspam-User: X-Rspamd-Server: rspam08 X-HE-Tag: 1715801699-91977 X-HE-Meta: U2FsdGVkX1/2wO2a4Dyz92ecEQ4wS6KRmg0UkCQmC1uYvIabn6mJuCZ1mILByQN0C2NeRwJnC8XP9KmrTouvorK4sILzDu4NY85M9gXYRLyud/Ljw0utDLT+KpXz78R7u1jbqH87sGmT4cEPMjVFreOd54DCu4tlUY7Sbh9NQvmW6O5SwgGbCt6wys/5kGfei59GuSMMk2QbSIa009/V0/IsfsYmSuhUKghcwqjm6nz1RhnTbxPRq5bpt0p5Z6+IquPKNlyqFiiIXr/Ujp4WI1Ru/6SZoEEZV7rzfmKm9GPYrNvBiT7xwTpzzMjto4e+d8/mPM1exsCkv0r1WJex2p27urvuQDdO0rUCh9H6l1J93nfcD84A0eq8LAZP+3JUufrpDcY1dUzGcmaTe1/uAA6fCw9ObyGfExE95HM9hrzd9wkuIPEDNzBftBvCf1EqkwY5KrPY1cX0SR0xuFexTrot1SiOaTFQ45LZgrPuCPyEBJXC+KwlnqaIMeroTQbSuencKTKvMvbDzYw/5JFlLjpofYt6ThW6J7p+1uievE1mCNYtwwIJrBmrQGcusZd5skAuInbXCW9RRX7MwDGJuRMTRYnuQHUEBvpsHlgYpwC1bhUhZFt2/HFFDUR1AE20gE212iGaFHwdOcbHesHZpPOXuOTTtk69mO8cReGlTUk4IG4t//1vyuCes2DYLWJeAOVWidSaD7Lp50FcAut57da5yaw6yDlMAa4s4iRiidRcf0k8G9lia39YaAPho8TH9jtIDk9Jvay4rUIcCXoSiI2mubkGntBHeOrHDe5zX8p2EkMdEuiSdDDBChF92mepamEFdTBvHzn+MMY5wE7yYFh07PnKyUbpqtR+jBhR0BhJEXgEJVVVOUTogCpNs48qgl3ZSc5N0568eBWtopjBNST/0Hne4Bpk5ua6AXST6fs/UVSmypEQUbqvgsGFDwVMZMlC5yWqkQrV3eT17/R dfFKgH1n XIp8zF/iLpsN3QAuu9jn1Ny2Oc86pW6G2YZ3/pEGQlCNVg5CuxncEb1CrbdemW7oTwky8RMYHuUdSp9adEzKzFu3C+gmIoLp1pBkyaeCiDeAm+5YqUqbMpyeVmV76bM6T0aWjjT9yeOW2ClvIx2nNak1tn49h7dy5RbWdesfM+TciGCXQOHrrrIsnXYx2ZUKFBTOOC7PjNPxuGQMCy8Km1VI7tMmM6JlFqz1VaWmeio9aI+AGd82Kmv0+pj7SPi7lElcxNTx/GeAwBcMGcRx8EdPQlTIH2ArQFvcy1gL4oal5Xd7zn50FiPOO8XwWtDpsjw1HkTFfXBj0yczQmMrJgkMsY6GxJGEG/hXIeV0kgPjGiAFHaAKzTniQkqsTaQYEy6Vd X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: RFC to see if we have a breakout session today at LSFMM. After the TAO talk today it occurred to me that it might make sense to review how we're measuring memory fragmentation today. We're looking to add automation support into kdevops for this to help compare and contrast memory fragmentation behaviour with one kernel against another. A while ago, while mTHP was being evaluated I asked genearlly how we could measure fragmentation with a simple one value, and John Hubbard had one recommendation [0], working that proved we could simplify things [1] but we also could just use the existing fragmentation index and only consider the values where this is concerned for fragmentation and not lack of memory. It begs the question of how folks are measuring memory fragmentation today in production, and if they have any desirable changes. The first approach being considered is to reproduce the workloads Mel Gorman had written and used for mmtests and leverage those on kdevops, perhaps modernize them, but before we do so it seems reviewing how we measure fragmentation today might be useful to others too. As for mmtests integration into kdevops, first order of business are just a few distro-friendly updates [2], for the next steps after that though it would be great to review the above. [0] https://lore.kernel.org/all/5ac6a387-0ca7-45ca-bebc-c3bdd48452cb@nvidia.com/T/#u [1] https://lkml.kernel.org/r/20240314005710.2964798-1-mcgrof@kernel.org [2] https://lore.kernel.org/kdevops/20240319044621.2682968-1-mcgrof@kernel.org/ Luis