From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3362CC369AB for ; Tue, 15 Apr 2025 16:18:17 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id E7A77280091; Tue, 15 Apr 2025 12:18:15 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E002128008F; Tue, 15 Apr 2025 12:18:15 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C7948280091; Tue, 15 Apr 2025 12:18:15 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id A6B9728008F for ; Tue, 15 Apr 2025 12:18:15 -0400 (EDT) Received: from smtpin23.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 21EC31216DF for ; Tue, 15 Apr 2025 16:18:16 +0000 (UTC) X-FDA: 83336785392.23.A8F67BA Received: from sea.source.kernel.org (sea.source.kernel.org [172.234.252.31]) by imf17.hostedemail.com (Postfix) with ESMTP id 4185940017 for ; Tue, 15 Apr 2025 16:18:14 +0000 (UTC) Authentication-Results: imf17.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=lLZ6pla5; dmarc=pass (policy=quarantine) header.from=kernel.org; spf=pass (imf17.hostedemail.com: domain of mcgrof@kernel.org designates 172.234.252.31 as permitted sender) smtp.mailfrom=mcgrof@kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1744733894; a=rsa-sha256; cv=none; b=ixj10PS661HxkW8oJJW77muE2JDWJbYvJrCqYvk8U4jcpia55SmrMwHr+6JUL+GjOPic+r d9C4Q+NUOk3bVxdsUNflNKrWucf080TSOF7bzNiaWUt4Sg3AeBPGP7PRuOkrmofIrj9/De fwGdnUbwL32hYzKNbY7AY/o50SBoDj4= ARC-Authentication-Results: i=1; imf17.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=lLZ6pla5; dmarc=pass (policy=quarantine) header.from=kernel.org; spf=pass (imf17.hostedemail.com: domain of mcgrof@kernel.org designates 172.234.252.31 as permitted sender) smtp.mailfrom=mcgrof@kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1744733894; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=+zhaHMNjO5Fz3gm8ETWcltL3ra7017JROjoahcqX/HE=; b=brYevUssBTakOuUttMGgPfqwddg+FcTahroYeqgiphcRk1PHmx63oSbzaqIvv91VVotoyr CVPJSsk8dS9xGDXexG/qnziC8ox7Ap58URTdLDPLCgiXge5csEl9uydQV3IL01URAh2VWJ ZeNEjB5gHrn+PEIWd0iBCHdHl/qZXa8= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by sea.source.kernel.org (Postfix) with ESMTP id D279C45305; Tue, 15 Apr 2025 16:18:11 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 279FAC4CEEB; Tue, 15 Apr 2025 16:18:12 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1744733892; bh=TTzt00DG4m8YTP79xAQ6Vc0Czj8pe4Ekm0GuBijqACM=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=lLZ6pla5ACcnqulLMEDJOTd+4m63v1IVlXP4x6W6/Du6+HgglgLZiCuu+l9IVB45n n0+A4YSLy+MiLY4FfYjs4K5TT/CfXl1GzdOyxFWRjoYScuXo3MS0BqD/nCeudDVLlf lmfdFLOM2M2sBQu8EOFLStlwmt6eQbENfKRb2Q/YP64GOdwfChLhHFhDbtkvOwdzhP Hs9rEyYKXwOZhSs6qXnPJ36TiWBBTGoSaAiIEJd9a9LfXgp1oLssjRTL2BHPnzupMP p/rS+6A54oUZyEzs2rdrm0/9mYGDI1rWuqXztTs9qIvtb6yJm6TfuNw0t36NBuTIKf hEBy1DNx3NQEQ== Date: Tue, 15 Apr 2025 09:18:10 -0700 From: Luis Chamberlain To: Jan Kara Cc: brauner@kernel.org, tytso@mit.edu, adilger.kernel@dilger.ca, linux-ext4@vger.kernel.org, riel@surriel.com, dave@stgolabs.net, willy@infradead.org, hannes@cmpxchg.org, oliver.sang@intel.com, david@redhat.com, axboe@kernel.dk, hare@suse.de, david@fromorbit.com, djwong@kernel.org, ritesh.list@gmail.com, linux-fsdevel@vger.kernel.org, linux-block@vger.kernel.org, linux-mm@kvack.org, gost.dev@samsung.com, p.raghav@samsung.com, da.gomez@samsung.com, syzbot+f3c6fda1297c748a7076@syzkaller.appspotmail.com Subject: Re: [PATCH v2 1/8] migrate: fix skipping metadata buffer heads on migration Message-ID: References: <20250410014945.2140781-1-mcgrof@kernel.org> <20250410014945.2140781-2-mcgrof@kernel.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: 4185940017 X-Stat-Signature: u9dxpqq4zopyjwga7hxb4aorbhbbp5xi X-Rspam-User: X-HE-Tag: 1744733894-926083 X-HE-Meta: U2FsdGVkX19neLZxVay91msQCkB3v8dUcnBSuzZby5Wn4VqjhHuq0F0FH4F9rJaO1C4WtWBBH1+LAllwhc59MjloLlsfAZnLATPUdl2CjcRNOD+yPsCPhUW0Rz9lz9kj2ci8YRZ5cY/rOMMeqD37t6702GbvStIZm+2eugP0rr3eotFDEuTj/rkHmstry39hk7j232Mfuhn8iF1ZidS9ne4d9Luai5jKPrOzx8qSdwM6/uIYo1QOFUhtOB8CiWR/N7zS+mdEIXcwl90k+F8LlFtyyweFARD0MWcFBp3dcfytUMmQ81Wdz65j6hqzi/07dYpFRbyTo+oj5KeSJQ20iLWB1zMNhdm7Vqfr61fe/e7Q6PbZ59PFJ5g8nUO+e/KamAlvdeZZ80o/B88NqoUe1FYFdajQCYyM7/Cb85K9qYE69OtTUPsM8t1PHal003DkkD6cgPLOPgAInecik77A1IKKfJHi3qsoWvPGg9LLsPrN6pw3ZeEjK1p3MdZTmEc/90K8Tfcb3rS00XnLZFUH0wa2czUrvq1Y506AhqxUMJ+EWyOZ3DdtDVG713JmdO0QoUvANNnEvKRuedMCYKDyjgcj4SrW5shX9I8678MzKVGIS4ghy0A4EijFBDtH1Wg1yI99UcATWQBDCyNbdAz80/GJkmgkAc44pxh8vaxPYbbwhlmBSP+qBjU+y9G0oDAy4wt7wzIuLy50W4PIMJP0PN38/5rUXRtTFhOfIutFrMs1s0/ATmofkWF3O2XTtS4pwDajzdNyj30yQHpQGbrkJJ1pUdCttiBa6nsWSuKhBQmeEZljxh8dDtfjpMCHkaVCQJ/LDlfUr4svLSAOaYnMnh46HZ3Yh56NLb2SgNkN/OKif2Zlc0DLRO0nntygogxlejcQmVQ9JY4uFYZLGJwzt31h2WsZo2K6bzPB2moA01EXN/S6ho3tyfsTZGW0zz//W+5Ehpf8WsLs4WnUM9e sbn2uboS fSV9Emw6RgCGF7VOapr2mJt5DitvDi+VFG0g7A1DrhoBP9l8zuA5v+BaWM03z0hjORgZCBMA6K4dIu8smgdDg6TjrvL5R+f3mBy/61zyjCA9FaALvbiFk3uhJbLdJil4HyTjNf8CW2qGkWAovf6mAYgF1ybjvGIWl+YTSRLHstrSpAbrCcWWP/KvkuD/96X2E0ASEMZaWtheRIobMhP1gUKIaWAE8hJMAcNcerTv9aBTCngBd21rb2wYJrY6StvQRvW30VWa2AbMO7bhiTdEtvJjiY/8TYE7tZ2krGQGR9Dffpjk= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Thu, Apr 10, 2025 at 02:05:38PM +0200, Jan Kara wrote: > On Wed 09-04-25 18:49:38, Luis Chamberlain wrote: > > ** Reproduced on vanilla Linux with udelay(2000) ** > > > > Call trace (ENOSPC journal failure): > > do_writepages() > > → ext4_do_writepages() > > → ext4_map_blocks() > > → ext4_ext_map_blocks() > > → ext4_ext_insert_extent() > > → __ext4_handle_dirty_metadata() > > → jbd2_journal_dirty_metadata() → ERROR -28 (ENOSPC) > > Curious. Did you try running e2fsck after the filesystem complained like > this? This complains about journal handle not having enough credits for > needed metadata update. Either we've lost some update to the journal_head > structure (b_modified got accidentally cleared) or some update to extent > tree. Just tried it after pkill fsstress and stopping the test: root@e1-ext4-2k /var/lib/xfstests # umount /dev/loop5 root@e1-ext4-2k /var/lib/xfstests # fsck /dev/loop5 fsck from util-linux 2.41 e2fsck 1.47.2 (1-Jan-2025) /dev/loop5 contains a file system with errors, check forced. Pass 1: Checking inodes, blocks, and sizes Inode 26 extent tree (at level 1) could be shorter. Optimize? yes Inode 129 extent tree (at level 1) could be shorter. Optimize? yes Inode 592 extent tree (at level 1) could be shorter. Optimize? yes Inode 1095 extent tree (at level 1) could be shorter. Optimize? yes Inode 1416 extent tree (at level 1) could be shorter. Optimize? yes Inode 1653 extent tree (at level 1) could be shorter. Optimize? yes Inode 1929 extent tree (at level 1) could be shorter. Optimize? yes Inode 1965 extent tree (at level 1) could be shorter. Optimize? yes Inode 2538 extent tree (at level 1) could be shorter. Optimize? yes Inode 2765 extent tree (at level 1) could be shorter. Optimize? yes Inode 2831 extent tree (at level 1) could be shorter. Optimize? yes Inode 2838 extent tree (at level 1) could be shorter. Optimize? yes Inode 3595 extent tree (at level 1) could be shorter. Optimize? yes Inode 4659 extent tree (at level 1) could be shorter. Optimize? yes Inode 5268 extent tree (at level 1) could be shorter. Optimize? yes Inode 6400 extent tree (at level 1) could be shorter. Optimize? yes Inode 6830 extent tree (at level 1) could be shorter. Optimize? yes Inode 8490 extent tree (at level 1) could be shorter. Optimize? yes Inode 8555 extent tree (at level 1) could be shorter. Optimize? yes Inode 8658 extent tree (at level 1) could be shorter. Optimize? yes Inode 8754 extent tree (at level 1) could be shorter. Optimize? yes Inode 8996 extent tree (at level 1) could be shorter. Optimize? yes Inode 9168 extent tree (at level 1) could be shorter. Optimize? yes Inode 9430 extent tree (at level 1) could be shorter. Optimize? yes Inode 9468 extent tree (at level 1) could be shorter. Optimize? yes Inode 9543 extent tree (at level 1) could be shorter. Optimize? yes Inode 9632 extent tree (at level 1) could be shorter. Optimize? yes Inode 9746 extent tree (at level 1) could be shorter. Optimize? yes Inode 10043 extent tree (at level 1) could be shorter. Optimize? yes Inode 10280 extent tree (at level 1) could be shorter. Optimize? yes Inode 10623 extent tree (at level 1) could be shorter. Optimize? yes Inode 10651 extent tree (at level 1) could be shorter. Optimize? yes Inode 10691 extent tree (at level 1) could be shorter. Optimize? yes Inode 10708 extent tree (at level 1) could be shorter. Optimize? yes Inode 11389 extent tree (at level 1) could be shorter. Optimize? yes Inode 11564 extent tree (at level 1) could be shorter. Optimize? yes Inode 11578 extent tree (at level 1) could be shorter. Optimize? yes Inode 11842 extent tree (at level 1) could be shorter. Optimize? yes Inode 11900 extent tree (at level 1) could be shorter. Optimize? yes yInode 12721 extent tree (at level 1) could be shorter. Optimize? yes Inode 12831 extent tree (at level 1) could be shorter. Optimize? yes yInode 13531 extent tree (at level 1) could be shorter. Optimize? yes yyyyInode 16580 extent tree (at level 1) could be shorter. Optimize? yes Inode 16740 extent tree (at level 1) could be shorter. Optimize? yes yInode 17123 extent tree (at level 1) could be shorter. Optimize? yes yInode 17192 extent tree (at level 1) could be shorter. Optimize? yes Inode 17412 extent tree (at level 1) could be shorter. Optimize? yes Inode 17519 extent tree (at level 1) could be shorter. Optimize? yes yyInode 18730 extent tree (at level 1) could be shorter. Optimize? yes Inode 18974 extent tree (at level 1) could be shorter. Optimize? yes Inode 19118 extent tree (at level 1) could be shorter. Optimize? yes yyInode 19806 extent tree (at level 1) could be shorter. Optimize? yes Inode 19942 extent tree (at level 1) could be shorter. Optimize? yes Inode 20303 extent tree (at level 1) could be shorter. Optimize? yes Inode 20323 extent tree (at level 1) could be shorter. Optimize? yes Inode 21047 extent tree (at level 1) could be shorter. Optimize? yes Inode 21919 extent tree (at level 1) could be shorter. Optimize? yes Inode 22180 extent tree (at level 1) could be shorter. Optimize? yes Inode 22856 extent tree (at level 1) could be shorter. Optimize? yes Inode 23462 extent tree (at level 1) could be shorter. Optimize? yes Inode 23587 extent tree (at level 1) could be shorter. Optimize? yes Inode 23775 extent tree (at level 1) could be shorter. Optimize? yes Inode 23916 extent tree (at level 1) could be shorter. Optimize? yes Inode 24046 extent tree (at level 1) could be shorter. Optimize? yes Inode 24161 extent tree (at level 1) could be shorter. Optimize? yes yInode 25576 extent tree (at level 1) could be shorter. Optimize? yes Inode 25666 extent tree (at level 1) could be shorter. Optimize? yes Inode 25992 extent tree (at level 1) could be shorter. Optimize? yes Inode 26404 extent tree (at level 1) could be shorter. Optimize? yes Inode 26795 extent tree (at level 1) could be shorter. Optimize? yes Inode 26862 extent tree (at level 1) could be shorter. Optimize? yes Inode 26868 extent tree (at level 1) could be shorter. Optimize? yes yInode 27627 extent tree (at level 1) could be shorter. Optimize? yes Inode 27959 extent tree (at level 1) could be shorter. Optimize? yes Inode 28014 extent tree (at level 1) could be shorter. Optimize? yes yInode 29120 extent tree (at level 1) could be shorter. Optimize? yes Inode 29308 extent tree (at level 1) could be shorter. Optimize? yes yyyyInode 30673 extent tree (at level 1) could be shorter. Optimize? yes yInode 31127 extent tree (at level 1) could be shorter. Optimize? yes Inode 31332 extent tree (at level 1) could be shorter. Optimize? yes Inode 31547 extent tree (at level 1) could be shorter. Optimize? yes yyInode 32727 extent tree (at level 1) could be shorter. Optimize? yes Inode 32888 extent tree (at level 1) could be shorter. Optimize? yes Inode 33062 extent tree (at level 1) could be shorter. Optimize? yes yyyInode 34421 extent tree (at level 1) could be shorter. Optimize? yes Inode 34508 extent tree (at level 1) could be shorter. Optimize? yes yyyyInode 35996 extent tree (at level 1) could be shorter. Optimize? yes Inode 36258 extent tree (at level 1) could be shorter. Optimize? yes yyInode 36867 extent tree (at level 1) could be shorter. Optimize? yes Inode 37166 extent tree (at level 1) could be shorter. Optimize? yes Inode 37171 extent tree (at level 1) could be shorter. Optimize? yes Inode 37548 extent tree (at level 1) could be shorter. Optimize? yes Inode 37732 extent tree (at level 1) could be shorter. Optimize? yes yInode 38028 extent tree (at level 1) could be shorter. Optimize? yes Inode 38099 extent tree (at level 1) could be shorter. Optimize? yes .... So I tried: root@e1-ext4-2k /var/lib/xfstests # fsck /dev/loop5 -y 2>&1 > log e2fsck 1.47.2 (1-Jan-2025) root@e1-ext4-2k /var/lib/xfstests # wc -l log 16411 log root@e1-ext4-2k /var/lib/xfstests # tail log Free blocks count wrong for group #609 (62, counted=63). Fix? yes Free blocks count wrong (12289, counted=12293). Fix? yes /dev/loop5: ***** FILE SYSTEM WAS MODIFIED ***** /dev/loop5: 1310719/1310720 files (10.7% non-contiguous), 10473467/10485760 blocks Luis