From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id CAA81C3DA7D for ; Thu, 29 Dec 2022 22:01:41 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C07248E0002; Thu, 29 Dec 2022 17:01:40 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id BB68F8E0001; Thu, 29 Dec 2022 17:01:40 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id AA6938E0002; Thu, 29 Dec 2022 17:01:40 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 9DB6F8E0001 for ; Thu, 29 Dec 2022 17:01:40 -0500 (EST) Received: from smtpin17.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 6B65E120E1C for ; Thu, 29 Dec 2022 22:01:40 +0000 (UTC) X-FDA: 80296716360.17.9ACCE83 Received: from casper.infradead.org (casper.infradead.org [90.155.50.34]) by imf06.hostedemail.com (Postfix) with ESMTP id DDD65180013 for ; Thu, 29 Dec 2022 22:01:37 +0000 (UTC) Authentication-Results: imf06.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b=qV4Qk4gZ; spf=none (imf06.hostedemail.com: domain of willy@infradead.org has no SPF policy when checking 90.155.50.34) smtp.mailfrom=willy@infradead.org; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1672351298; a=rsa-sha256; cv=none; b=XZOu0GWcu+FIjGaGuiWf9p6ni2N6neFkZARuuCdAHD7aFVlkPssqNAOYther65VcrSqmc4 BwB5KiVjh44xC8anAWxG+lDIghK+lLRu1g9EF8BJUBgJasUQ/qmRenDJwmJ3VHjM4EqJLk sTaE1ALFhSqafkpc4eu4xTNnveQENDo= ARC-Authentication-Results: i=1; imf06.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b=qV4Qk4gZ; spf=none (imf06.hostedemail.com: domain of willy@infradead.org has no SPF policy when checking 90.155.50.34) smtp.mailfrom=willy@infradead.org; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1672351298; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=71ak5DlLjqSfR20yVQ7y5XOXC9hkAGkrWLM+CHpcQgg=; b=bva97lwIRncImiL7mXR6d6zjrtS9PDQF1BPyQHCM+og5QXFnmdeLowgDOt1y7bYuTMoFN3 eACmmv7KK9aWqzlW/vLp7L/LcfE1Y0GOstwPzKouVZlFPtsKKDJa6WE7JGcghntH48O79X b0zLzNnVQadiF8XY6PGG8h4mg6eTe54= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=71ak5DlLjqSfR20yVQ7y5XOXC9hkAGkrWLM+CHpcQgg=; b=qV4Qk4gZyAcvKE830nfXFxPEIU fX1FThun24ssMt/swQAohcn8rfySf7aqky46NiShyMKvVmPtU1m8rC5bonY+R5k+Iz/utrNM3/Qwx 2n63kT0EaHDbV7XqeWV8K38b2d/pbM/QGohtaruP+B4QJwrEEvHA+jLGd/jeVsh1xj9eA8Tp7OI+t GE4XaUhH7eu+O2BQ/LPWJ71kuRPFdzCO9Z+9LS9wVAeuxFuxIpWlv4QGIIxGrPJvvjAJLi3Lb4+/J jZjODdZjerCyuD3b18A3W7UGratRKQhbKXrcnxRU+W59d4gEl5vdXKOSLDfiwRHnWz4GXSqWq/XK0 qL8yb4bw==; Received: from willy by casper.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1pB0y6-00A9CE-9d; Thu, 29 Dec 2022 22:01:42 +0000 Date: Thu, 29 Dec 2022 22:01:42 +0000 From: Matthew Wilcox To: syzbot Cc: akpm@linux-foundation.org, linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, syzkaller-bugs@googlegroups.com Subject: Re: [syzbot] INFO: task hung in __unmap_and_move (4) Message-ID: References: <000000000000e5738d05f0f46309@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <000000000000e5738d05f0f46309@google.com> X-Rspam-User: X-Rspamd-Queue-Id: DDD65180013 X-Rspamd-Server: rspam01 X-Stat-Signature: f3tte7pi6dku5tnabjqo87zr94nisnsn X-HE-Tag: 1672351297-384619 X-HE-Meta: U2FsdGVkX1/K3NZhdcj5jEABi8vceAGCOQP8cGJTmeVw9MxuuKNXmA8AkpGabEz7SGrDuBjWH47Ua470WOJv+CbKgSxWWR2f6VJqHemx9+A8ZPzFwpHXYXL/Y8nKwHt0Q5WNC3m3S9WmR7D+a4SwmV4rVXqjhrskIZbD4J8z8cK9vGcPWxdo1BVEo7VZg9o6KfMO1QA2I2oaSkyrKWZD/4ufGn23ipyrtgJsxwGK2rXZFFUw0IXZoLznzUtTksRq4kcXrm9vQs+nue502KEAIF+dbJOCn1qaKdBUFsq3PQ8nA0x8nzgJ6SU9Q2W6pnGgszhPqh94Tfnl1XYnrPnnl54TiHSAadG5Cr5CjwuiFORu4CeSjhXFqQDhUp9LiIjtR/eH189gWoG6WtaUbjOxFmCytAKYHyOJWhvcXXgO1ovdegxnXO93wEmsy9OcSl+c0ZcVkFEKEMI1pqTJQjOeRDIapSOZcnT3zv1HdxcQ5iLQBJUOJqQmTQhSXbGWvIQqBup8bAtknOnaI5feEQGr3GWZZJIyo1wKRQff0PokeO77xM+7sE7juDQLMKjiAJm/cSeDnkLUyf9bqx8xQ2v7lQCnkN9ymfMcTBMRkkPSiVZGhn/z0YIHQ2mJjSoBqOYpixD2DTNNJp6cQohKZVwnuZqh/i0CX67hYg9V32FtnwyYcNxP7i+qBuzVWx8fRv4laZoTsZYdbwhQwRYs7fDwV4cX7Z8Ph4v23vXWRWcyc/R5qmnA7tGjFJl8WAh5R42Y0wFiYxCsnbLF9IOF8L10moLle/MaB2LirC09T12F0yPyXJFe4vv+JyIeDyHjPWCKvSvIg6zgAq1iz2+wGYwurGxWqRFcj5nu7GgB8ZASlShIxdRIVrdvTimZZb+cRqNqCUc4APOOeZYmpYWTsnyF6KWGHX9k1aFU28bfd8TGXhtCnhCLQPJPZMhdhDphFk8KfNXYgsyuYXyUg6adTfY pTlsf6jm MeHdpbwYHWY70X8Jpvwa84f4J3w== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Thu, Dec 29, 2022 at 01:48:42AM -0800, syzbot wrote: > INFO: task kcompactd1:32 blocked for more than 143 seconds. > Not tainted 6.1.0-syzkaller-14594-g72a85e2b0a1e #0 > "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > task:kcompactd1 state:D stack:26360 pid:32 ppid:2 flags:0x00004000 > Call Trace: > > context_switch kernel/sched/core.c:5244 [inline] > __schedule+0x9d1/0xe40 kernel/sched/core.c:6555 > schedule+0xcb/0x190 kernel/sched/core.c:6631 > io_schedule+0x83/0x100 kernel/sched/core.c:8811 > folio_wait_bit_common+0x8ca/0x1390 mm/filemap.c:1297 > folio_lock include/linux/pagemap.h:938 [inline] > __unmap_and_move+0x835/0x12a0 mm/migrate.c:1040 > unmap_and_move+0x28f/0xd80 mm/migrate.c:1194 > migrate_pages+0x50f/0x14d0 mm/migrate.c:1477 > compact_zone+0x2893/0x37a0 mm/compaction.c:2413 > proactive_compact_node mm/compaction.c:2665 [inline] > kcompactd+0x1b46/0x2750 mm/compaction.c:2975 OK, so kcompactd is trying to compact a zone, has called folio_lock() and whoever has the folio locked has had it locked for 143 seconds. That seems like quite a long time. Probably it is locked waiting for I/O. > NMI backtrace for cpu 1 [...] > lock_release+0x81/0x870 kernel/locking/lockdep.c:5679 > rcu_read_unlock include/linux/rcupdate.h:797 [inline] > folio_evictable+0x1df/0x2d0 mm/internal.h:140 > move_folios_to_lru+0x324/0x25c0 mm/vmscan.c:2413 > shrink_inactive_list+0x60b/0xca0 mm/vmscan.c:2529 > shrink_list mm/vmscan.c:2767 [inline] > shrink_lruvec+0x449/0xc50 mm/vmscan.c:5951 > shrink_node_memcgs+0x35c/0x780 mm/vmscan.c:6138 > shrink_node+0x299/0x1050 mm/vmscan.c:6169 > shrink_zones+0x4fb/0xc40 mm/vmscan.c:6407 > do_try_to_free_pages+0x215/0xcd0 mm/vmscan.c:6469 > try_to_free_pages+0x3e8/0xc60 mm/vmscan.c:6704 > __perform_reclaim mm/page_alloc.c:4750 [inline] > __alloc_pages_direct_reclaim mm/page_alloc.c:4772 [inline] > __alloc_pages_slowpath+0xd5c/0x2120 mm/page_alloc.c:5178 > __alloc_pages+0x3d4/0x560 mm/page_alloc.c:5562 > folio_alloc+0x1a/0x50 mm/mempolicy.c:2296 > filemap_alloc_folio+0xca/0x2c0 mm/filemap.c:972 > page_cache_ra_unbounded+0x212/0x820 mm/readahead.c:248 > do_sync_mmap_readahead+0x786/0x950 mm/filemap.c:3062 > filemap_fault+0x38d/0x1060 mm/filemap.c:3154 So dhcpd has taken a page fault, missed in the page cache, called readahead, is presumably partway through the readahead (ie has folios locked in the page cache, not uptodate and I/O hasn't been submitted on them). It's trying to allocate pages, but has fallen into reclaim. It's trying to shrink the inactive list at this point, but is not having much luck. For one thing, it's a GFP_NOFS allocation. So it was probably the one who woke kcompactd. Should readahead be trying less hard to allocate memory? It's already using __GFP_NORETRY.