From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C622EC5B552 for ; Wed, 4 Jun 2025 09:22:50 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 637608D0009; Wed, 4 Jun 2025 05:22:50 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 60F148D0007; Wed, 4 Jun 2025 05:22:50 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 524DF8D0009; Wed, 4 Jun 2025 05:22:50 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 398628D0007 for ; Wed, 4 Jun 2025 05:22:50 -0400 (EDT) Received: from smtpin03.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id A8DDBBDFC1 for ; Wed, 4 Jun 2025 09:22:49 +0000 (UTC) X-FDA: 83517178458.03.B1AFB10 Received: from mail-ej1-f43.google.com (mail-ej1-f43.google.com [209.85.218.43]) by imf12.hostedemail.com (Postfix) with ESMTP id BA86440003 for ; Wed, 4 Jun 2025 09:22:47 +0000 (UTC) Authentication-Results: imf12.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=FKyCH5B8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf12.hostedemail.com: domain of kundanthebest@gmail.com designates 209.85.218.43 as permitted sender) smtp.mailfrom=kundanthebest@gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1749028967; a=rsa-sha256; cv=none; b=CEOWX7LTXr5ekrSXovgzCaKPIicuMUg2HdFZXh+DpPwXMpkWAYCrDySzfUvT+SjmcuEPLE 5k4ZoqMdiQbuiNSCf2caZFPw7Ka8SwmkGlDV7T0Q1lz6NQ9dyreYe3tYPz8JpCQiPT1Je3 VGKGewpm4gxi1utW4diO5mPlkWQRW0Q= ARC-Authentication-Results: i=1; imf12.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=FKyCH5B8; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf12.hostedemail.com: domain of kundanthebest@gmail.com designates 209.85.218.43 as permitted sender) smtp.mailfrom=kundanthebest@gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1749028967; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=kxD+BS5BNW9JlEJcYvio44SXpqyv8Wmatgad1UAi7lM=; b=TaQQh3v8b5k9AnlAQKbaz2ueZZCJtU/C83CBX/Y9cfR4QpZ9NQJ2I30wpZSq+2Mj9Es7mt FCYDycwp9kk+EH82P//+aJNU/X4yzYlazLSKoARFlQmbS1gXn7BmL6W0hlVTZlequN64eq 0BRmesKewtHQy4FjfgnY8uVDoi2qI14= Received: by mail-ej1-f43.google.com with SMTP id a640c23a62f3a-ad1b94382b8so1154859366b.0 for ; Wed, 04 Jun 2025 02:22:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1749028966; x=1749633766; darn=kvack.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=kxD+BS5BNW9JlEJcYvio44SXpqyv8Wmatgad1UAi7lM=; b=FKyCH5B8swdbBBr95LMkcC/juFcSUJiq/xLli3j4vv2BpHvJgmKWZN67Gdi/gphNZU 1OsDePJYRJNiduaiQYEYYHh1gyniFLaO0+LI0UviW8TPDELcaYvRJ6gjWEUcrmju8fi0 uOHtgLKG/EJIEUSFim8E0JTno+XY16Z2NA9EDN9Al/1HLgbRtsX7H8mQl59L9xa3Hx/N 0kwD/UyMoqgs83SVQO+Y3SPkVSj5GNIsqQl75jhF2wHUM/Mtc1WUWZwJD2dFeeGDZM6Z PHfyqqkBcHk8i+CRON/4cJV9iTBT1dGrz4rg+E8yY/XXkXBs8owGdutzxjiK7PE2IS7W l1qw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1749028966; x=1749633766; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=kxD+BS5BNW9JlEJcYvio44SXpqyv8Wmatgad1UAi7lM=; b=qVrloVXSpx9IE88O5Cxo8sGBui91brPmNmirInV7omBsbUM3UoZ0Yh42vUd/r+aMqy iF/YT2lWXbxUuIyKECZJ+jtN2bcO8zF+EG9yCi96PtzNxEgH38FQSLvyUwOgFEp7M76w 8ug5gqS/Kne2EvOw3LZfkGpOjePp7tph7r01JOLRclaXlw30Qq/IHde/KEz/oriZims1 eNlXFnAhlNfpm505JwzN1xMd+WkIYqRuTi2ggO8aIl2JHcmtPMdvII0us7PGYv6J80mX AF87uadXm/onVdZPpaXPJJ4GSOpLH3Za21PT+FSd/g4+48gaxkrhiO7jfsFDxLkWUBLA vjsw== X-Forwarded-Encrypted: i=1; AJvYcCVAt4DGlkVzlcqrqA30o/dGgg0OUc+zHgwH7qYVIQ+sL+Uos2AFkF19mYkP0OvfEIaecQCmw94pfw==@kvack.org X-Gm-Message-State: AOJu0YyxJydLIiW6zUA0IMsgJdVkSB3eE7ZYQ4mQn6EK9y0CTsJdJH/M fwImnR2J4n5vNZHXFc9ZYNLt3qiG2VD8BYlEeV9ncaW9zXTa4ULI8kBCfGUvjNGPhVdIE5sIi+I c0Vz26zC7woeGesIwNiyLQWMJDWEwkjg= X-Gm-Gg: ASbGncuhwQsR6RkjByWcg90cDZSjV0vQhbYoUyrNP4y2Mnr7N/dzgz3k1T1r9nRmk2J UWDf54uAC3wICnYN/uMxD6PdDRmFMhC2ydRwCWNzATlIyu/+N8J2JGYn0QLHrzyV2xhw1M1SPhI ZRexTIA1PJdAa1wOIStuB2Yb8dwzPsqapd17fkfEZ16nwcpmeKTDPybxZgWwm0edAGaSwfUBrpm LUM X-Google-Smtp-Source: AGHT+IFtmWSVIfRymSX8p9O1DuQ9uGU3imVuqryH0lzpbx4dWpXx940NayRL5XU/iX+3A15SSf0ibjMq2HLSlqBsVEw= X-Received: by 2002:a17:906:a995:b0:add:fa4e:8a61 with SMTP id a640c23a62f3a-addfa4e8f2bmr123364566b.38.1749028965818; Wed, 04 Jun 2025 02:22:45 -0700 (PDT) MIME-Version: 1.0 References: <20250529111504.89912-1-kundan.kumar@samsung.com> <20250602141904.GA21996@lst.de> <20250603132434.GA10865@lst.de> In-Reply-To: From: Kundan Kumar Date: Wed, 4 Jun 2025 14:52:34 +0530 X-Gm-Features: AX0GCFsIp4hEknwUTt7cvxyvZfmfYSDQ8XVwMfEKcuya3JVRf5uqzsLfTt2zwvo Message-ID: Subject: Re: [PATCH 00/13] Parallelizing filesystem writeback To: Anuj gupta Cc: Christoph Hellwig , "Anuj Gupta/Anuj Gupta" , Kundan Kumar , jaegeuk@kernel.org, chao@kernel.org, viro@zeniv.linux.org.uk, brauner@kernel.org, jack@suse.cz, miklos@szeredi.hu, agruenba@redhat.com, trondmy@kernel.org, anna@kernel.org, akpm@linux-foundation.org, willy@infradead.org, mcgrof@kernel.org, clm@meta.com, david@fromorbit.com, amir73il@gmail.com, axboe@kernel.dk, ritesh.list@gmail.com, djwong@kernel.org, dave@stgolabs.net, p.raghav@samsung.com, da.gomez@samsung.com, linux-f2fs-devel@lists.sourceforge.net, linux-fsdevel@vger.kernel.org, gfs2@lists.linux.dev, linux-nfs@vger.kernel.org, linux-mm@kvack.org, gost.dev@samsung.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: BA86440003 X-Stat-Signature: 5mgqu5z4mgam87s6puog7yokwkpm13ej X-Rspam-User: X-HE-Tag: 1749028967-44358 X-HE-Meta: U2FsdGVkX1+V+ILsyURveUaFNv+Ovr+t7p5gFkL7xK6+ieTI6TZc5/Gqz6dj2o7TruuDn9FscEJapTHnw3BPG1vjvoKjTshaNZLdRnMuYqczsqqYGSdIOXSHq2fgflrN7+75ubJJXSvGJvFNgn7NbQ98/mWgnrVPX8Skf2jQzEC8MlpUUsB+lY2+Is2RUfcwdBifcaayQobIh6hLZxmzK5zNYiD1dSbvXxA3tAqipH5Q1iuf9/R6FHfVn6spxejYqLCASBdSruaY7HxVwSZyJyjfjbAAb9fMNbE4NeP4xLA9Vzn527chc8SlLqTs+YntBj5h/HlhxKrIU5H2bE3CSEMajLCXIiHBYYZ7nZbUAC3Y4lpF3TudkX3RVXxK7j3KrLKdmDI7BTnJmLfL9lIx8BAKBhlZA2pFEaiJd0k1zGHh45o6Os4FWohVpXn8o3QTce0/sgyBrNMfhp2t/PiP9R3nRjSCq7skDtRuZ81KCUlHTOLFefYI888v2huED555zF8kCsCKdlZmJo0ZmAeQqZH9eVQfB7jyZPZ8N+MqiYGj63xcZ9Nr8cJm5v/fFpeMEQ77Nd84AAIREsgrfJDSGX16U7r9EVjeMOXYzv0nkd8xcitdNyY6zc8bSS6k2dvAcrDGeeu4Ug4xNFsBv+B4HiUoV5rpv64lyCnmcLG0hS7ExJR7q/6tiohOtmqmulQMkiLrl7jcR6/Slf7TotrtCC5zucx4CLlLqfxtsu7q/oohoZuZt8CIlpo2c/H9cSj29BEq5Zf1p1q/KGi9fVO/6C6CPcwc97he4CuLSSyAhM60spzsxp1dh8Bd9CckCiu3EGDyOdX3bqPrAC1+i60zZ5bJNgslus192ds4GtaSoK7muMs1HPHoylkPczDepe5uZloHXdRtEIypNhdaGFBEHo/2t7LVOufMYj34ZliXYOihHtLnf32BihVK6FsnMxM+8F+CE0PiKRSXw+V6AdP FJ7oE7lt dbCv2soEthOIgb/BxYrcKOG0kDTsuVCrLzgq8HSrpKOiie5aYQaOghdtHi+oUdK0sBShZxoPW25mikBX7Vgoh0idTsQPP2LyU/WRR0dojUFwLuJ8Mu2d15MQBjnIFeTDElf69bvFRKdh1mbKgFEZfpeZoOF1Y9K3v0hq+jhdXk7UZmVHJXEkAIBrXQ/1dWxbfWE4FxHKztNr4DsCq/fMJgqk8jWGgY6aTYnpcGZd2rkCa5Z4tTt+VdMVN7KSdCOTrwKTjmQLmMMuvqO0nNEGS74nVuQ+HGCwIZNpFcyT6u5xvV6W6be2BOMoj0PfRWkmSJcJqPWL9gfRvLLqcqKayo4gpMiVwpId5rnPUqSNIz+u/3G2IjYJp736YFa6kzYCzrn9ay1VnDqLDTNI= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: > > > For xfs used this command: > > > xfs_io -c "stat" /mnt/testfile > > > And for ext4 used this: > > > filefrag /mnt/testfile > > > > filefrag merges contiguous extents, and only counts up for discontiguou= s > > mappings, while fsxattr.nextents counts all extent even if they are > > contiguous. So you probably want to use filefrag for both cases. > > Got it =E2=80=94 thanks for the clarification. We'll switch to using file= frag > and will share updated extent count numbers accordingly. Using filefrag, we recorded extent counts on xfs and ext4 at three stages: a. Just after a 1G random write, b. After a 30-second wait, c. After unmounting and remounting the filesystem, xfs Base a. 6251 b. 2526 c. 2526 Parallel writeback a. 6183 b. 2326 c. 2326 ext4 Base a. 7080 b. 7080 c. 11 Parallel writeback a. 5961 b. 5961 c. 11 Used the same fio commandline as earlier: fio --filename=3D/mnt/testfile --name=3Dtest --bs=3D4k --iodepth=3D1024 --rw=3Drandwrite --ioengine=3Dio_uring --fallocate=3Dnone --numjobs=3D1 --size=3D1G --direct=3D0 --eta-interval=3D1 --eta-newline=3D1 --group_reporting filefrag command: filefrag /mnt/testfile