From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 023E1C54798 for ; Fri, 23 Feb 2024 23:16:28 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 4379B6B0072; Fri, 23 Feb 2024 18:16:28 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 4174A6B0074; Fri, 23 Feb 2024 18:16:28 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 2896E6B0075; Fri, 23 Feb 2024 18:16:28 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 1A91C6B0072 for ; Fri, 23 Feb 2024 18:16:28 -0500 (EST) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id C1FCE160C0D for ; Fri, 23 Feb 2024 23:16:27 +0000 (UTC) X-FDA: 81824629614.12.17354BE Received: from mailout2.w1.samsung.com (mailout2.w1.samsung.com [210.118.77.12]) by imf05.hostedemail.com (Postfix) with ESMTP id C8C30100013 for ; Fri, 23 Feb 2024 23:16:22 +0000 (UTC) Authentication-Results: imf05.hostedemail.com; dkim=pass header.d=samsung.com header.s=mail20170921 header.b="Nlq/e1E1"; dmarc=pass (policy=none) header.from=samsung.com; spf=pass (imf05.hostedemail.com: domain of da.gomez@samsung.com designates 210.118.77.12 as permitted sender) smtp.mailfrom=da.gomez@samsung.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1708730183; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:references:dkim-signature; bh=KOuOkxDM/eQDf+jaJBMTfT5yhj2zI/dHokHUYnTQK8A=; b=MPagjhIkCtXiroS43twUix/iqO6lLDQugRUx2C7P/jaFNDO2Utk5YS9tiI6qPvSRgDp4bw sFEwIdQegU01q3AzzD4vUtlyEvFuW2LOBcLCWoXwXZ1EHOeRwUkfcHYa2+HvRxktZ8lbgE juA1bjMvm1JotwM/7uTJ5OZPXDvm7QA= ARC-Authentication-Results: i=1; imf05.hostedemail.com; dkim=pass header.d=samsung.com header.s=mail20170921 header.b="Nlq/e1E1"; dmarc=pass (policy=none) header.from=samsung.com; spf=pass (imf05.hostedemail.com: domain of da.gomez@samsung.com designates 210.118.77.12 as permitted sender) smtp.mailfrom=da.gomez@samsung.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1708730183; a=rsa-sha256; cv=none; b=fsEc7+DqiHjitHkP3N+O87PEqKTwrMJSuFljD6maZh+StJSNeXvtPOFSl55QXE5Qc0AzgL HzVj/D6cFgLeWYDxP19uTVpI5UOcOelnbIs7chdmwn0s8oC/6JWnwpY21zro9s7pJYwEsi uJ1R6MkBhbNTCg06sITSh5T0Ws5Oe5I= Received: from eucas1p1.samsung.com (unknown [182.198.249.206]) by mailout2.w1.samsung.com (KnoxPortal) with ESMTP id 20240223231620euoutp024402e657c19e782f7e1c23a927244b33~2oQu7zn3Y2798227982euoutp02E for ; Fri, 23 Feb 2024 23:16:20 +0000 (GMT) DKIM-Filter: OpenDKIM Filter v2.11.0 mailout2.w1.samsung.com 20240223231620euoutp024402e657c19e782f7e1c23a927244b33~2oQu7zn3Y2798227982euoutp02E DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=samsung.com; s=mail20170921; t=1708730180; bh=KOuOkxDM/eQDf+jaJBMTfT5yhj2zI/dHokHUYnTQK8A=; h=From:To:CC:Subject:Date:References:From; b=Nlq/e1E1jNaEwyYofNYsMPl0rAYtScxglI9A7sBvSJm64ScfLP+Sno6uy3Nba28o5 fKbFWhWlo80qha7kXM4BxH3bp8bxjFJdBW+G6KTFTURA2j3n9HRdSG6uRUJ5ZcR83+ yeSGIRGimBxM6ENsORCbCf4wwSvkJcvomJMjK1oU= Received: from eusmges3new.samsung.com (unknown [203.254.199.245]) by eucas1p2.samsung.com (KnoxPortal) with ESMTP id 20240223231619eucas1p272cdbd444e3210e95b966f41debf5c12~2oQuCIHo12069220692eucas1p2l; Fri, 23 Feb 2024 23:16:19 +0000 (GMT) Received: from eucas1p2.samsung.com ( [182.198.249.207]) by eusmges3new.samsung.com (EUCPMTA) with SMTP id F2.5A.09552.34729D56; Fri, 23 Feb 2024 23:16:19 +0000 (GMT) Received: from eusmtrp1.samsung.com (unknown [182.198.249.138]) by eucas1p1.samsung.com (KnoxPortal) with ESMTPA id 20240223231618eucas1p1a885347603558c5d6185274b6bd7fc31~2oQs1GmFc0725607256eucas1p1V; Fri, 23 Feb 2024 23:16:18 +0000 (GMT) Received: from eusmgms2.samsung.com (unknown [182.198.249.180]) by eusmtrp1.samsung.com (KnoxPortal) with ESMTP id 20240223231618eusmtrp1bdd90a91dd95188a67323fb4b79a50a5~2oQs0hC__2676326763eusmtrp1v; Fri, 23 Feb 2024 23:16:18 +0000 (GMT) X-AuditID: cbfec7f5-853ff70000002550-cd-65d92743b7d0 Received: from eusmtip1.samsung.com ( [203.254.199.221]) by eusmgms2.samsung.com (EUCPMTA) with SMTP id A2.60.10702.14729D56; Fri, 23 Feb 2024 23:16:18 +0000 (GMT) Received: from CAMSVWEXC01.scsc.local (unknown [106.1.227.71]) by eusmtip1.samsung.com (KnoxPortal) with ESMTPA id 20240223231617eusmtip1eca7b8b0ff390f43e9b0dbe7077626a9~2oQsnma271598015980eusmtip1G; Fri, 23 Feb 2024 23:16:17 +0000 (GMT) Received: from CAMSVWEXC02.scsc.local (106.1.227.72) by CAMSVWEXC01.scsc.local (106.1.227.71) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Fri, 23 Feb 2024 23:16:17 +0000 Received: from CAMSVWEXC02.scsc.local ([::1]) by CAMSVWEXC02.scsc.local ([fe80::3c08:6c51:fa0a:6384%13]) with mapi id 15.00.1497.012; Fri, 23 Feb 2024 23:16:17 +0000 From: Daniel Gomez To: "lsf-pc@lists.linux-foundation.org" , "hughd@google.com" , "willy@infradead.org" , "david@redhat.com" , "mcgrof@kernel.org" , "akpm@linux-foundation.org" , "brauner@kernel.org" , "yosryahmed@google.com" , "jack@suse.cz" , Pankaj Raghav CC: "linux-fsdevel@vger.kernel.org" , "linux-mm@kvack.org" Subject: [LSF/MM/BPF TOPIC] shmem/tmpfs: large folios adoption, regression tracking and performance testing Thread-Topic: [LSF/MM/BPF TOPIC] shmem/tmpfs: large folios adoption, regression tracking and performance testing Thread-Index: AQHaZq5MxcWH2k38q0iOhcLY4+el5w== Date: Fri, 23 Feb 2024 23:16:16 +0000 Message-ID: <4ktpayu66noklllpdpspa3vm5gbmb5boxskcj2q6qn7md3pwwt@kvlu64pqwjzl> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [106.210.248.59] Content-Type: text/plain; charset="us-ascii" Content-ID: <24B3A54AD78420489D7788D68E98FAAE@scsc.local> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Brightmail-Tracker: H4sIAAAAAAAAA02SfUwTdxjH9+tdr9c6wtEaeYJsZjVoREQnGq8JumUydv/o2F++xegBJxAp YEuddcl0SAigUdQxsbhRMZQX3+AEaVooSa1CZQSYK0KtbiousYjOljZqhY1yavrf5/t7Xr7f PPmRmHxIHEfmFRRzmgI2X0nI8Ou3Xg+u2Lh0jFvVWqKgz129RNATN3yIDlx9g9FPfMdxuvbM ERHd1e3E6QeX/hPTtolujB6teoLo0KtzBN1p2fblPMbI65hrTYkM31JBMLzvlITpqwnhzOnR RsS8sLkI5nejQ8L4+U8zpNtlqdlcft5+TrNyw25ZrrPejYpcCw6UvbiIDqNpeSWSkkCtAauf x8Msp5oQNDYTlUg2y1MIXGV+iSD8CNru/ix+P+G+/AAXCo0IrHwv9qHruGdYJAgewU3rJBJE M4Ixo0kSnieoZWBz8nM8n3Jh8NOzpDBjVBG0hapRmBWUGkbv3MSFHg2U9vXNvpOznAzlZggj TiXAWfeP4Y4oahP0+J7PpUPUJ/Co+Y1E2BgL7vE6kZA6BupruzCBF8CM5SEhcBIM3B1HAq+C jgYbHl4PlBJann4trEkCo9VHCKyCk16rWODlYDo/gQkRYsB5dnzuKEAFpXC0sv3dtdKg3HP/ na8CvL3tEoHjof/0MbwKLTdERDVE+Bki/AwRfoYIPyMSt6BYTqdV53DalALu+2Qtq9bqCnKS swrVPJr9dP0zvQEzavK+TLYjEYnsCEhMOT9qS/wYJ4/KZvUHOU3hLo0un9Pa0UISV8ZGJWQv 4uRUDlvM7eW4Ik7zvioipXGHRVlJkysy+rZKltTlZf3pzd6z5g/by9CpLzY3RA+kXVysil6c NjKll/n1f+187Vqavum5qfrVD4XtrSPTMROTPQGlflj1XeltT+aytVc+oy/kGk44Qvw/7Mpf qMzOMbNlR7wu3c3Xlc17WBGMTmlY+/HOLdelbNWIKHOhuti8v3ufKtD1t1NZEnLMlJRfOHDD VTuoq9TvCKai36Y852ve+v0H02sOSafPmL6p5nv0JYrB5kMOgyPtK49F9WySHJwxDQyNdvxb kSARy7l1eRlHAnSHffjoam+/4tfgHU+KJW79rnutpZ2p9vX1iW1mnWVg+KOKnM3Bb0WP7w3V sLXj1n1KXJvLfp6IabTs/zpx1iLjAwAA X-Brightmail-Tracker: H4sIAAAAAAAAA02Sa0wTaRSG/TrToXUXHQuVT9ZrEyUgTltocYqIl4Rk+kOj0c0G742MFKQU p614iRtvawoqURDFgpGioNzUjqJGajV4QRRtjFag0W6iaAJFwYKhArLbOrtJ/z3JOc85b06O ABE5+NGCrFwjzeRqciTYRPTZeOu7BctjumjZcAMgK642YKT3gQ+Q366OIORHXxFKlp85xCPt d9tQ0tPwD590eO8iZOeJj4Ac9Vdg5K076Ut/oSpZE3X9chzF1hVgFOsrDqOelI2iVEnnJUD1 O1wY1V75MIwaZGeuEq4jUhi9yUjP1uoNxsWS9XIygZCrSCJBoSLkiQs3JicoJdLUlAw6J2sn zUhTtxDatio3yHNN3XWkvx7sBz9EhUAogLgCuhs9aCGYKBDh1QCWVxejXGE6tA25+BxHwLE3 hViQRfhXAK+NKDmBBdAz3IpwhVoA24+vDjKGx0JHGxsW5EjchcADffFBRvA8aBstBUGOwHWw 89UjlOth4Cn2ZWCZIMAENN+GQUTxufCs+89gRzi+At7zffkZB+Az4PvakTBuYhR0d5/ncTFx eNHuRDgWw54P4//Fj4fPO7oBxzLYVO1Ag+MhLoF1PWncmHhY2ezDOFbBk73NfI7nwxqrF+Ei TIFtZ7vREyDaErLZEqJbQnRLiG4J0SsBvw5E0iaDLlNnSCAMGp3BlJtJbNXrWBB4pJuPv9+4 DWp7vxItgCcALQAKEElk+B/Tu2hReIZm9x6a0W9mTDm0oQUoAxc6iUSLt+oDn5hr3CxPkinl iiSVTKlKSpREhavzzBoRnqkx0ttpOo9m/vd4AmH0fp46w2mKbVwoXRaltt1PXPrM9YJ/UGF/ 6E3WDz5PP1pExplvbCqy/t16vUM94zTMUBR/mDc4NmfalJufyrIGbBXJO2qUTd9Y2yJlylqx a1sdk3N0Wtri/Nezog7fpz2lh485Np5b04Q1S2v6xn9NF+/LzHbKfwg1W2JaqOHfJ8mzXlzJ VneXn5r/qMc8YOL/5mlPZdFIrXuXtG+dvX+oeiDef6xs71/trvxLaW+7si+IhCXKoSUdk2sn +JNWOpfs2ECVGEf8Xtmg9eU9cUGhyvJaS694U19fFZsf0ejoXNDjf0q9t45e460s/WwR2e+c PmC2FvBUTK9TF7P8U39D1ZgENWg18jiEMWj+BU8fgvrRAwAA X-CMS-MailID: 20240223231618eucas1p1a885347603558c5d6185274b6bd7fc31 X-Msg-Generator: CA X-RootMTR: 20240223231618eucas1p1a885347603558c5d6185274b6bd7fc31 X-EPHeader: CA CMS-TYPE: 201P X-CMS-RootMailID: 20240223231618eucas1p1a885347603558c5d6185274b6bd7fc31 References: X-Rspam-User: X-Stat-Signature: yiwwzugdzfnuubd6o3kq1cmb9g9y5acy X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: C8C30100013 X-HE-Tag: 1708730182-714579 X-HE-Meta: U2FsdGVkX1+IDsHzxOe8PZnx/rI7Yl9gnLvVpI8v/WHAQk6QByZ8DoBRQ6ME+hMiQPf+/wWcz4Jt2y2j6S9SN1WspTlg3dW9xUmLNAJVRWSBsIlXhAQNrjGXM0y0Y8LiPkCwAihbhbsyFl7JNcGoz8f3OosTAcleHz+hu9pkoIAdkR+CM++JJzNbiaWn35o0+SP/S4SRrTwTjijRrzG+Klu+NZnjOBm4HNLXwKBrhf6XaddHbngXUBvLAG+RklZF0p7YEZ7V2yA6dDGlBSX0TvG6OPlm1f7GE874Jew9Xz9w8TEkZf/TEupy4d4G8XO42IINFDK3uC3bE5WTFRX1j1fKiB4GWQKtghe/+F1z6A2Xr/oMoMtKQQhI+i6P8KjinNFXBJXrT1OSBvQqnQ72Bi1n3Mek3sWKlf3QrcktDtyF+oaXe7StsH+fJXvrgQa1Lpa68xFmC8lDgYwLo7BjCn5wO9+1tprMvxTqFgkht3TBw16sSuvUd7+fELm3R5VFpH53YshO1BUWXn2rSCBl9Os7wHHDUvdEWxtRycuuJcNF4oTbarqXDUH92Z99LfhTq6ciSLXSKWhw9V58eMdJaKYM7HX1pv5vV31LiJNpYcYDxjJNTCL9v5qu+MlUlk6ZkFjSUPkcS10Gw1hXVRoarIkgJXq+7ihYqTU9ZyOUOaqrFJ8REsg1toZ7CO80W46aowUKWiI3DcBZ1lxVuUBadPGZYgTGg/okW300A9JnhenUY8IXLHRMCvvZWpjbGeZZn0KThyfd+VaODudS72h/5c663YhqUxIFIGPT1iqFQq4xsjvrTRJbjlNv/5ThS7EcFd3OnsiWAWAJyfk6fdSaC/GspW8wso0xpEJ3hJRRO8yJmXKclI2h8O/Gq69ClmfzaDCmYuF5rf2UzHWMVWgBg6VsGa2DJhwZ2bLKT1OG1EO4qU3Hj2JbRFyj+n2q5LwsAblznGh+Xs253m/GNqR MLrtgoJj LPxmELM4ADaRstl6kM0RAIDnnyO3UI9NC96j/FWB7pInJaiJjmg8LdP857ZLYoAgiT3wcSpaNKGd9hXYra9gsWXy6hngeOhWZEn7XZ95nWLLyOOsc2Wnh1AsgBpRgNLhNtrixSVWxF8HPKYRV5NCb5kVDAy2nEUOI7Ht2 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hi, I want to propose a session to discuss how we should address large folios i= n shmem. I have explored the write and fallocate paths [1] (which I will soon= post an updated version), but there are additional aspects that need to be cover= ed, such as read and swap paths. I have started an RFC to track blocks for huge pages (aiming to avoid any regressions with large folios) that seems to be going in the wrong directio= n, according to Hugh's comments. However, there are still some open questions = for which I have not yet received a clear answer. In addition, I've been testing tmpfs with kdevops using recent kernels and have encountered some known issues. However, I have not found a clear way t= o identify them other than through these [3][4] threads. Therefore, having a = clear and updated status of all the test profiles and the list of issues would he= lp to provide a better understanding. Note that this aligns with kdevops' goal= . Additionally, I recently received some patches from Hugh [5] aimed at addre= ssing the issues in xfstest-dev. Luis has also initiated a thread [6] to collaborate with the 0-day team to = track regressions in tmpfs (among other efforts). It would be beneficial to discu= ss the progress made thus far, potential next steps, and gather insights on th= is collaborative effort between 0-day and kdevops. Finally, I would like to explore alternative methods for performance testin= g in tmpfs aside from using fio and/or running kernel build benchmarks. What are the possible approaches for this? Luis recently reported some findings = in the last LBS cabal, where XFS on pmem DAX showed significantly better resul= ts compared to tmpfs, regardless of whether huge pages were utilized or not. I= t would be beneficial to share these latest findings and consider implementin= g methods, possibly integrated into kdevops, to continuously monitor any pote= ntial regressions. [1] shmem: high order folios support in write path v1: https://lore.kernel.org/all/20230915095042.1320180-1-da.gomez@samsung.c= om/ v2: https://lore.kernel.org/all/20230919135536.2165715-1-da.gomez@samsung.c= om/ v3 (RFC): https://lore.kernel.org/all/20231028211518.3424020-1-da.gomez@sam= sung.com/ [2] shmem: fix llseek in hugepages RFC: https://lore.kernel.org/all/20240209142901.126894-1-da.gomez@samsung.c= om/ [3] https://lore.kernel.org/all/alpine.LSU.2.11.2104211723580.3299@eggly.an= vils/ [4] https://lore.kernel.org/all/20230713-mgctime-v5-3-9eb795d2ae37@kernel.o= rg/ [5] xfstests-dev patches from Hugh: https://gitlab.com/dagmcr/xfstests-dev/-/commits/hughd/tmpfs-fixes/?ref_typ= e=3Dheads [6] https://lore.kernel.org/all/CAB=3DNE6VRZFn+jxmxADGb3j7fLzBG9rAJ-9RCddEw= z0HtwvtHxg@mail.gmail.com/ Are there any other related topics that folks would like to discuss further= ? Daniel=