From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0088DC05027 for ; Wed, 15 Feb 2023 01:52:50 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 6FFF46B0072; Tue, 14 Feb 2023 20:52:50 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 6B05A6B0073; Tue, 14 Feb 2023 20:52:50 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 59ED76B0074; Tue, 14 Feb 2023 20:52:50 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 485796B0072 for ; Tue, 14 Feb 2023 20:52:50 -0500 (EST) Received: from smtpin21.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 15F51C09AE for ; Wed, 15 Feb 2023 01:52:50 +0000 (UTC) X-FDA: 80467852500.21.8B66EAF Received: from mail3-165.sinamail.sina.com.cn (mail3-165.sinamail.sina.com.cn [202.108.3.165]) by imf26.hostedemail.com (Postfix) with ESMTP id 7A923140007 for ; Wed, 15 Feb 2023 01:52:46 +0000 (UTC) Authentication-Results: imf26.hostedemail.com; dkim=none; spf=pass (imf26.hostedemail.com: domain of hdanton@sina.com designates 202.108.3.165 as permitted sender) smtp.mailfrom=hdanton@sina.com; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1676425968; a=rsa-sha256; cv=none; b=w3fXzxKF1j5ZgYi0RxPN7Imn3IZJ+ExAOYjdxHnmvHwsADV0hCRZWhVUEOxcnKxruzWszJ KYHyHEbOhDk+wm88FmpiUGu2S9kUQDYld3DNdJP7tlkJe6E8Viw8k1tHGJnZW4uNDEMlQf ZLMiwkczXn5u7NaOKp+JLQafBe1eDZM= ARC-Authentication-Results: i=1; imf26.hostedemail.com; dkim=none; spf=pass (imf26.hostedemail.com: domain of hdanton@sina.com designates 202.108.3.165 as permitted sender) smtp.mailfrom=hdanton@sina.com; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1676425968; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jaq3kpF5NVPvVuFf/gHclWj8L5IE86qeZiIqgf6d65k=; b=KTS93atxiMmqI55+4/YnEiLnoCfBGgdIpb9PdyuJE7prvnVeE66h1ykC5TrNhbLv9nqaHc /MyQhuRE6o2FAORlt2bGf5R1ijeN3x2RahkYrgQIRHs+tLYQImuMRIst1ZZgL/wqdI9NVa VMRGBB2WQo/FmBf8SrggSdd4+yk2Ugg= Received: from unknown (HELO localhost.localdomain)([114.249.61.130]) by sina.com (172.16.97.32) with ESMTP id 63EC39E40001999F; Wed, 15 Feb 2023 09:48:22 +0800 (CST) X-Sender: hdanton@sina.com X-Auth-ID: hdanton@sina.com X-SMAIL-MID: 366550676053 From: Hillf Danton To: Dmitry Vyukov Cc: konishi.ryusuke@gmail.com, linux-kernel@vger.kernel.org, Yu Zhao , Andrew Morton , syzbot , linux-mm@kvack.org, syzkaller-bugs@googlegroups.com Subject: Re: [syzbot] [nilfs2?] INFO: task hung in nilfs_segctor_thread Date: Wed, 15 Feb 2023 09:52:31 +0800 Message-Id: <20230215015231.3646-1-hdanton@sina.com> In-Reply-To: <0000000000004e1dfa05f4a48e6b@google.com> References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspam-User: X-Rspamd-Queue-Id: 7A923140007 X-Rspamd-Server: rspam01 X-Stat-Signature: 44w3dy8aianxc49ed1nfrn1y8w8kh8ma X-HE-Tag: 1676425966-941849 X-HE-Meta: U2FsdGVkX18auS8LCQxruTFcTk8acBMzlB3q9plzLsy7CUTfKp1UhrtC66UbAXESIY/LnDNDijjkuTdjgseQKxsrd9xRminb51HuND+mO7JqY9HhMxd///jmW6PqoWMT+gKWTGICH/l8vs1l8TcY40iLBmT+ErhBoj4Px2gsVwQtoh0V2YrvD1/ZGLdWBW7IfrVYVfyAJlEV/D1gNMbyXRn0uMvRib/hL2jI01QQfImM7FGdZEtl8CC8DGjn2sJ0pmr05+9sN3X+5CBteRTk7QJsR1pE7wwmAUVgoWXh0NkO7LklL9NRn1YrXnxQWEmGF92McEv3P/FQDzbZDT3V0GVFA6dZ4kV4hClLp+dJxs4S7ojTF+WDn6rayhZKTHQr1IsWmSI/xnMzWlawKTZ845f6yS+ReftKWg2B5V1nY0uJvADiGzjWroZBy7HhO9q8QM0yPjOknu+FRaPuv2Psuhoqq4htZky7NWJUFO7q2sDRWLksrmBrWZ0vq50e2AV/K4SLOiPxzwkCaoIJfOxOxxbPhiG8IOIGaB6GUSONrHkrVS1UfHqtSyf47/VXTGkC1+aHCVqt9/zhtO5HJyetTcKcOqxIa7gRJbuG1sEX/cfRfjtWYDfNVcYb2YJppBZOtFhl3RKQX3dZy8jhpcVWr3hnqZd6GKEzdJiSGdaLokM3YPcvmxIVjmrz+jSp883jmHkF7UWyqmIiFdwv+dmySUvgSUGRrIrWE/uACDfn74YlKeM67+QnTIi64N8+zPf2NKzUcwjvey2m/bdjmNXI2mCqdbmz82qBh5Kpb6rEk+T9zGtpYQCYhH/MHCXh2a4Aejtn56rlBMuFjHWEPC6WfD8Iif602zyjEIKoQFDDC5C5nki4iKlhyTVDARtiRqBuD0KYo05pLPMkFwxz6+pcmsWmdTh6ELHS+WZUrKgx67bHL0a4yPt7GWfbnUJKhG8A67EVNHMKSzWlR4HLgdi OWfapgJg V56s3J4qZBYn/C/M3gaxAvo7C/Id8M/fmGwcRog46OOQsBl94FM4q6TM/XoNXU70Vglr3368CbBObTnQVbFwzhxWjlxz12r3mk0Owb5WAd8L3K0269eIHGPVSTBNslnXxwlwR7Omp8Un0JGYOlob1xNimibOoLfU8cvnW3k1tLGt5g4FWskakmTIshCk8TXrRVjDEBAbwkKQcLwimzCKeAAPXbI0/b4pnGKQhJ2lilKQ1ZGeOymjJQ9K0ZYUJk2KVGcrCzJ0r/NoCR0rkYUY6P/orYYHDVMGoDiusOnJEVSpIFrbZs5IbjiXIC4qCHDUMF7tFyRNVzD9GHiYe6E+xOuBYqI9aD8VD1ZZOoGQwQDGBHu6EQ41YWDlaDmxWAYwnolcf5DB1+iYJAcTgCEormcVBZZm801ED2JttO5fbYhHLXed3CoK7sBcG+ClNSOlaubEhjKWORDekKlTpxq/yTAWaySIpl9QXwDVAmxsdfjElweeV7KWqE/fPA0puxi0zY9tVsw9jFuQ/DIGnfiaOyf9P5/T/MHqr2imuYCbZL1Z/D8DZUTw9bsLP4ECxtsBuWv0YALE0f3hdiVxWULwJaJKA12bHp/Up2l1UYhEBLVZslpGQJkCwKLPbgWzl9RvQdn95XxBS14tKVrXW53OFO6qluCRhAa+AO12YGlGsmbtoLOpS/UCkXEjwgRZtuJ/Qjx/SqXWudZoE7XCDuL8n3hEAInzOf7P+laU39ET7cRh0kbFoZbZ02FC/eirm5Er7cDIhOZpV+OKRiOh8ZTcoXp8YjQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Tue, 14 Feb 2023 00:14:42 -0800 > syzbot has found a reproducer for the following issue on: > > HEAD commit: f6feea56f66d Merge tag 'mm-hotfixes-stable-2023-02-13-13-5.. > git tree: upstream > console+strace: https://syzkaller.appspot.com/x/log.txt?x=165ee62b480000 > kernel config: https://syzkaller.appspot.com/x/.config?x=42ba4da8e1e6af9f > dashboard link: https://syzkaller.appspot.com/bug?extid=f0c4082ce5ebebdac63b > compiler: Debian clang version 15.0.7, GNU ld (GNU Binutils for Debian) 2.35.2 > syz repro: https://syzkaller.appspot.com/x/repro.syz?x=14ba7207480000 > C reproducer: https://syzkaller.appspot.com/x/repro.c?x=15fd30d0c80000 > > Downloadable assets: > disk image: https://storage.googleapis.com/syzbot-assets/1ae0143f08d5/disk-f6feea56.raw.xz > vmlinux: https://storage.googleapis.com/syzbot-assets/18b8a23fa0cb/vmlinux-f6feea56.xz > kernel image: https://storage.googleapis.com/syzbot-assets/d915f4c5c8c0/bzImage-f6feea56.xz > mounted in repro: https://storage.googleapis.com/syzbot-assets/1acd3b288433/mount_0.gz > > IMPORTANT: if you fix the issue, please add the following tag to the commit: > Reported-by: syzbot+f0c4082ce5ebebdac63b@syzkaller.appspotmail.com > > INFO: task segctord:5067 blocked for more than 143 seconds. > Not tainted 6.2.0-rc8-syzkaller-00015-gf6feea56f66d #0 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > task:segctord state:D stack:23456 pid:5067 ppid:2 flags:0x00004000 > Call Trace: > > context_switch kernel/sched/core.c:5293 [inline] > __schedule+0x1409/0x43f0 kernel/sched/core.c:6606 > schedule+0xc3/0x190 kernel/sched/core.c:6682 > rwsem_down_write_slowpath+0xfcf/0x14a0 kernel/locking/rwsem.c:1190 > nilfs_transaction_lock+0x25c/0x4f0 fs/nilfs2/segment.c:357 > nilfs_segctor_thread_construct fs/nilfs2/segment.c:2486 [inline] > nilfs_segctor_thread+0x52f/0x1140 fs/nilfs2/segment.c:2570 > kthread+0x270/0x300 kernel/kthread.c:376 > ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308 > > > Showing all locks held in the system: > 1 lock held by rcu_tasks_kthre/12: > #0: ffffffff8cf258d0 (rcu_tasks.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x26/0xce0 kernel/rcu/tasks.h:507 > 1 lock held by rcu_tasks_trace/13: > #0: ffffffff8cf260d0 (rcu_tasks_trace.tasks_gp_mutex){+.+.}-{3:3}, at: rcu_tasks_one_gp+0x26/0xce0 kernel/rcu/tasks.h:507 > 1 lock held by khungtaskd/28: > #0: ffffffff8cf25700 (rcu_read_lock){....}-{1:2}, at: rcu_lock_acquire+0x0/0x30 > 2 locks held by getty/4745: > #0: ffff88802c2eb098 (&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x25/0x70 drivers/tty/tty_ldisc.c:244 > #1: ffffc900015b02f0 (&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0x6ab/0x1db0 drivers/tty/n_tty.c:2177 > 3 locks held by syz-executor996/5065: > 1 lock held by segctord/5067: > #0: ffff888017ce92a0 (&nilfs->ns_segctor_sem){++++}-{3:3}, at: nilfs_transaction_lock+0x25c/0x4f0 fs/nilfs2/segment.c:357 > > ============================================= > > NMI backtrace for cpu 1 > CPU: 1 PID: 28 Comm: khungtaskd Not tainted 6.2.0-rc8-syzkaller-00015-gf6feea56f66d #0 > Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/21/2023 > Call Trace: > > __dump_stack lib/dump_stack.c:88 [inline] > dump_stack_lvl+0x1e7/0x2d0 lib/dump_stack.c:106 > nmi_cpu_backtrace+0x4e5/0x560 lib/nmi_backtrace.c:111 > nmi_trigger_cpumask_backtrace+0x1b4/0x3f0 lib/nmi_backtrace.c:62 > trigger_all_cpu_backtrace include/linux/nmi.h:148 [inline] > check_hung_uninterruptible_tasks kernel/hung_task.c:220 [inline] > watchdog+0xf70/0xfb0 kernel/hung_task.c:377 > kthread+0x270/0x300 kernel/kthread.c:376 > ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308 > > Sending NMI from CPU 1 to CPUs 0: > NMI backtrace for cpu 0 > CPU: 0 PID: 5065 Comm: syz-executor996 Not tainted 6.2.0-rc8-syzkaller-00015-gf6feea56f66d #0 > Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/21/2023 > RIP: 0010:__lock_release kernel/locking/lockdep.c:5372 [inline] > RIP: 0010:lock_release+0x333/0xaa0 kernel/locking/lockdep.c:5688 > Code: 00 f0 ff 42 0f b6 04 3b 84 c0 0f 85 7e 05 00 00 45 89 2e 41 81 fd ff ff 0f 00 0f 87 ff 02 00 00 48 8b 44 24 40 42 0f b6 04 38 <84> c0 0f 85 34 05 00 00 89 16 4c 89 e0 48 c1 e8 03 42 80 3c 38 00 > RSP: 0018:ffffc90003def1c0 EFLAGS: 00000087 > RAX: 0000000000000000 RBX: 1ffff11004d808aa RCX: ffffc90003def203 > RDX: 0000000000000003 RSI: ffff888026c044b0 RDI: ffff888026c04530 > RBP: ffffc90003def2f0 R08: dffffc0000000000 R09: fffffbfff1ca4ece > R10: 0000000000000000 R11: dffffc0000000001 R12: ffff888026c04530 > R13: 0000000000020021 R14: ffff888026c04550 R15: dffffc0000000000 > FS: 0000555556f2e300(0000) GS:ffff8880b9800000(0000) knlGS:0000000000000000 > CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > CR2: 000056435c9b6680 CR3: 000000001e10a000 CR4: 00000000003506f0 > DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 > DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 > Call Trace: > > folio_mark_accessed+0x51c/0xf00 mm/swap.c:515 Syzbot was launched without MGLRU enabled [1]. Dmitry could you turn it on by default? Thanks Hillf [1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/mm/swap.c?id=f6feea56f66d#n490 > __nilfs_get_page_block fs/nilfs2/page.c:42 [inline] > nilfs_grab_buffer+0x3d3/0x540 fs/nilfs2/page.c:61 > nilfs_mdt_submit_block+0xd7/0x8f0 fs/nilfs2/mdt.c:121 > nilfs_mdt_read_block+0xeb/0x430 fs/nilfs2/mdt.c:176 > nilfs_mdt_get_block+0x12d/0xbb0 fs/nilfs2/mdt.c:251 > nilfs_sufile_get_segment_usage_block fs/nilfs2/sufile.c:92 [inline] > nilfs_sufile_truncate_range fs/nilfs2/sufile.c:679 [inline] > nilfs_sufile_resize+0x7a3/0x12b0 fs/nilfs2/sufile.c:777 > nilfs_resize_fs+0x20c/0xed0 fs/nilfs2/super.c:422 > nilfs_ioctl_resize fs/nilfs2/ioctl.c:1033 [inline] > nilfs_ioctl+0x137c/0x2440 fs/nilfs2/ioctl.c:1301 > vfs_ioctl fs/ioctl.c:51 [inline] > __do_sys_ioctl fs/ioctl.c:870 [inline] > __se_sys_ioctl+0xf1/0x160 fs/ioctl.c:856 > do_syscall_x64 arch/x86/entry/common.c:50 [inline] > do_syscall_64+0x41/0xc0 arch/x86/entry/common.c:80 > entry_SYSCALL_64_after_hwframe+0x63/0xcd > RIP: 0033:0x7fada4f355f9 > Code: Unable to access opcode bytes at 0x7fada4f355cf. > RSP: 002b:00007ffdc80a3908 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 > RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007fada4f355f9 > RDX: 0000000020000040 RSI: 0000000040086e8b RDI: 0000000000000006 > RBP: 0000000000000000 R08: 00007fada4fa3ec0 R09: 00007fada4fa3ec0 > R10: 00007fada4fa3ec0 R11: 0000000000000246 R12: 00007ffdc80a3930 > R13: 0000000000000000 R14: 431bde82d7b634db R15: 0000000000000000 > > INFO: NMI handler (nmi_cpu_backtrace_handler) took too long to run: 1.549 msecs