From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2BB33C54E67 for ; Thu, 28 Mar 2024 05:48:22 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id A57CC6B008C; Thu, 28 Mar 2024 01:48:21 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id A079B6B0096; Thu, 28 Mar 2024 01:48:21 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 8F6096B009A; Thu, 28 Mar 2024 01:48:21 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 733486B008C for ; Thu, 28 Mar 2024 01:48:21 -0400 (EDT) Received: from smtpin15.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id 2E43D1606A5 for ; Thu, 28 Mar 2024 05:48:21 +0000 (UTC) X-FDA: 81945367602.15.FA47D4B Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by imf15.hostedemail.com (Postfix) with ESMTP id ADC17A0005 for ; Thu, 28 Mar 2024 05:48:19 +0000 (UTC) Authentication-Results: imf15.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=XXAd+8Rt; dmarc=pass (policy=none) header.from=kernel.org; spf=pass (imf15.hostedemail.com: domain of chandanbabu@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=chandanbabu@kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1711604899; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=2srLN07mArUuhCUw5bHAlyNgOa632ihVmGyY/b/mqHY=; b=FR3qlnZD1ehH9OWbfSHBn2MtoLewWPcHlg9yJJmNo3pmlD2T7EUov+5LEO8QnNgl2BVsVO 8YPy3o/UOmFBDGu6WqFUAyxuTuRn0zHMY6X4mJTa1tLrwbE/oGmSjzlaxxkWdHg4P7EoGq Re7UZECjDncJF74HBcPontq/qQkQ5Hw= ARC-Authentication-Results: i=1; imf15.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=XXAd+8Rt; dmarc=pass (policy=none) header.from=kernel.org; spf=pass (imf15.hostedemail.com: domain of chandanbabu@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=chandanbabu@kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1711604899; a=rsa-sha256; cv=none; b=gLYU8XrZmB/ExzqGIf0C4PuebwhP1/88ri5ieO311A8uxCOtrn9q4fiqSzD82dqSIGvc+W n31LdEEcF++hBElymYrYYOSXGm7m6HPbwat2CjI1j8PYizAmROJ280iuiZ+Tyt0eiNIxE9 g8T1GkR6wU1kdbRwysW0r++q7c82HI0= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id B1796614CE for ; Thu, 28 Mar 2024 05:48:18 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id DE04FC433C7; Thu, 28 Mar 2024 05:48:17 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1711604898; bh=qKzbioJcQxk58EFZG1By9qByXS7nGV3/3djdeQxcY0U=; h=From:To:Cc:Subject:Date:From; b=XXAd+8RtSYyAelINtYxd+EAv++T5edxWY6mKiA19qx5Sx86ko0gzupZeykCgglg11 vhvuIat9QsrrQUKlfG6uco/wk2QnSUQEdhDs6M0XqrTr0tsOJi8vnmMYiljSEg2zKd aU5b5HtEsjaaTNsSdcnMkJQdTsCWy+KfgdqqRNFv+WJd4MTx94zSG1Ln3cd4TfMnNW 60kTXu52MUGsHC826oEfddsUEexEr0BtBtRBLOPk0b/v9+WngXcqu6zAtu/pUhtjhL S99D0i7MqLjIDA5nYTeOACjqO/I0hcnrtOqH4KWt2G0tyglCrpCRyJ9wrxp2wSkE1g fQb80uE4mMbPw== User-agent: mu4e 1.10.8; emacs 27.1 From: Chandan Babu R To: linux-mm@kvack.org Cc: linux-xfs@vger.kernel.org Subject: [BUG REPORT] writeback: soft lockup encountered on a next-20240327 kernel Date: Thu, 28 Mar 2024 11:11:05 +0530 Message-ID: <8734sa3o0x.fsf@debian-BULLSEYE-live-builder-AMD64> MIME-Version: 1.0 Content-Type: text/plain Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: ADC17A0005 X-Rspam-User: X-Rspamd-Server: rspam02 X-Stat-Signature: qtcs6ewj8o4w1srzoz1ogyjfpea6bumj X-HE-Tag: 1711604899-819405 X-HE-Meta: U2FsdGVkX194NeXOXbwx/w5I+2us5LWCgQiB55PvIDndymIR1B1mXEBZLrcXpNKyGbuEsR/nWOkpVhvLsW7aiw/0U2F8tY+rzH1IPAp2NXiRS3gzL8tO3NbBxBiAienzW7Va3dplwxNRTnso3+AxzPoJzW03z4ngvDFrm7WVlu48rIDh2/c9XEwNIuZJ1itaQ7G4hXx1U3+enww6YBx/yW2jDEkQVoMNvu45qMArvpBeCLW6JYseH68aDILK9EVfVrLgWb44J2U6pGvgAeJDmz/KVAHYGLZVeFNfsuwIkffkNZQ04Hkx3amHmtH6ajFCB/LmLc24zZmbNtp5JQb9QC6C+/dRt34LCKZwE2UAXCWE/ZH6bH2mEriS9bWeGzJ6rHCiNzSjulhZrGhIAg4vtz4xlmsre+Se/WGJz3uQN+HUTKzRhw25Al4sCfW1LfRMkRSuAPQOSUrbFWar3xmD1wWBIZtYb+6P+l13zxkAY9rYCT1YDKvl/uPDgJyE4ACN1yhLpAhvvVlZRpeju6IdASj28AINeLY/8hPkC7uTZX6tixvAvWRhMUA/2AbzT5PqbJtvSbTput56ZCvbVinQ2fo0uvZB7wcjt070qKxhDr1HLw4jcLC0aWBd+ippi/4YQJnDPtaArbTeUleccycj5TYVqJPaY5N1XLIkWlUMpftBh1aDQHaKGYOpPIm7wLnmP2fE722sPL+UTlzpdDFD+3rxebKiJMOIN6BzvhgeKcfUG3dWuujufIyx11kDqHcX92Z79kdjDU0ryc5SPc9ugabVJRW99DNUyNitg7yvORe597L2oCRFa0HVqNR/1xuTYB5wAT04zD5g+eI5fn9PpkF7x0FCPY5MSoimIt9qtLT8w5uM8moSb+7udW4yKiyckDxTBVGZTVWzkK7t2vjamBe/+1gT81AroUNzmWRsIzkZlRrlsyHOVff7TRfVQRPlpSYzfhrTiC5JnRosUB6 UHpwz/E0 4rSSycV0JVp4uu5hRmItY9LCODk9jfMkIR/gkShvXMy8Lq0g0CBtbBsHfAw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hi, Executing fstest on XFS on a next-20240327 kernel resulted in two of my test VMs getting into soft lockup state. watchdog: BUG: soft lockup - CPU#0 stuck for 64383s! [kworker/u16:8:1648676] Modules linked in: overlay dm_zero dm_thin_pool dm_persistent_data dm_bio_p= rison dm_snapshot dm_bufio dm_flakey loop nft_redir ipt_REJECT xt_comment x= t_owner nft_compat nft_fib_inet nft_fib_ipv4 nft_fib_ipv6 nft_fib nft_rejec= t_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct nft_chain_nat nf_nat= nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 rfkill ip_set cuse vfat fat ext= 4 mbcache jbd2 intel_rapl_msr intel_rapl_common kvm_amd ccp bochs drm_vram_= helper drm_kms_helper kvm drm_ttm_helper pcspkr pvpanic_mmio ttm pvpanic i2= c_piix4 joydev sch_fq_codel drm fuse xfs nvme_tcp nvme_fabrics nvme_core sd= _mod t10_pi crc64_rocksoft_generic crc64_rocksoft sg virtio_net net_failove= r failover virtio_scsi crct10dif_pclmul crc32_pclmul ata_generic pata_acpi = ata_piix ghash_clmulni_intel sha512_ssse3 sha256_ssse3 sha1_ssse3 libata vi= rtio_pci virtio_pci_legacy_dev virtio_pci_modern_dev serio_raw dm_multipath= btrfs blake2b_generic xor zstd_compress raid6_pq sunrpc dm_mirror dm_regio= n_hash dm_log dm_mod be2iscsi bnx2i cnic uio cxgb4i cxgb4 tls cxgb3i cxgb3 mdio libcxgbi libcxgb qla4xxx iscsi_boot_sys= fs iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi qemu_fw_cfg aesni_i= ntel crypto_simd cryptd [last unloaded: scsi_debug] CPU: 0 PID: 1648676 Comm: kworker/u16:8 Kdump: loaded Tainted: G = L 6.9.0-rc1-next-20240327+ #1 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.6.6 08/22/2023 Workqueue: writeback wb_update_bandwidth_workfn RIP: 0010:__pv_queued_spin_lock_slowpath+0x4d5/0xc30 Code: eb c6 45 01 01 41 bc 00 80 00 00 48 c1 e9 03 83 e3 07 41 be 01 00 00 = 00 48 b8 00 00 00 00 00 fc ff df 4c 8d 2c 01 eb 0c f3 90 <41> 83 ec 01 0f 8= 4 82 04 00 00 41 0f b6 45 00 38 d8 7f 08 84 c0 0f RSP: 0018:ffffc90007167b18 EFLAGS: 00000206 RAX: 0000000000000003 RBX: 0000000000000000 RCX: 1ffff110211bda18 RDX: 0000000000000001 RSI: 0000000000000003 RDI: ffff888108ded0c0 RBP: ffff888108ded0c0 R08: 0000000000000001 R09: ffffed10211bda18 R10: ffff888108ded0c0 R11: 000000000000000a R12: 0000000000005218 R13: ffffed10211bda18 R14: 0000000000000001 R15: ffff8883ef246bc0 FS: 0000000000000000(0000) GS:ffff8883ef200000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f9fa7534500 CR3: 0000000146556000 CR4: 0000000000350ef0 Call Trace: ? watchdog_timer_fn+0x2e2/0x3b0 ? __pfx_watchdog_timer_fn+0x10/0x10 ? __hrtimer_run_queues+0x300/0x6d0 ? __pfx___hrtimer_run_queues+0x10/0x10 ? __pfx___raw_spin_lock_irqsave+0x10/0x10 ? srso_return_thunk+0x5/0x5f ? srso_return_thunk+0x5/0x5f ? ktime_get_update_offsets_now+0x73/0x280 ? hrtimer_interrupt+0x2ce/0x770 ? __sysvec_apic_timer_interrupt+0x90/0x2c0 ? sysvec_apic_timer_interrupt+0x69/0x90 _raw_spin_lock+0xd0/0xe0 __wb_update_bandwidth+0x72/0x600 wb_update_bandwidth+0x97/0xd0 process_one_work+0x60d/0x1020 worker_thread+0x795/0x1290 kthread+0x2a9/0x380 ret_from_fork+0x34/0x70 ret_from_fork_asm+0x1a/0x30 I am unable to retrieve any other debug information since the machines are = not accessible. Hence, I am not sure about the exact test which caused the above issue. --=20 Chandan