From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 62B0FC35FFC for ; Sat, 22 Mar 2025 23:14:51 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EF80D280002; Sat, 22 Mar 2025 19:14:48 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id EA8BC280001; Sat, 22 Mar 2025 19:14:48 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D4929280002; Sat, 22 Mar 2025 19:14:48 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id B52DB280001 for ; Sat, 22 Mar 2025 19:14:48 -0400 (EDT) Received: from smtpin05.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 8DF73C0329 for ; Sat, 22 Mar 2025 23:14:49 +0000 (UTC) X-FDA: 83250743898.05.38C4784 Received: from mail-qt1-f173.google.com (mail-qt1-f173.google.com [209.85.160.173]) by imf02.hostedemail.com (Postfix) with ESMTP id 7773480009 for ; Sat, 22 Mar 2025 23:14:47 +0000 (UTC) Authentication-Results: imf02.hostedemail.com; dkim=pass header.d=cmpxchg-org.20230601.gappssmtp.com header.s=20230601 header.b=ngx77oIU; dmarc=pass (policy=none) header.from=cmpxchg.org; spf=pass (imf02.hostedemail.com: domain of hannes@cmpxchg.org designates 209.85.160.173 as permitted sender) smtp.mailfrom=hannes@cmpxchg.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1742685287; a=rsa-sha256; cv=none; b=Tj+6NQA3OqHpIEYj6O+JMY5B4WSPMaqBivWZbWRnbvWONUg+0Y4alxGXJ+Zecs1mwM5R+k 47aeql6GU9AUZm/5/qUnlQ4bfrObr0dH9r1g3ZGHO875AVFiA+ML8zRODQ0faq2p9XismV 1OKbAy8QJvmbGAAJG4xN/1kUGjca39Y= ARC-Authentication-Results: i=1; imf02.hostedemail.com; dkim=pass header.d=cmpxchg-org.20230601.gappssmtp.com header.s=20230601 header.b=ngx77oIU; dmarc=pass (policy=none) header.from=cmpxchg.org; spf=pass (imf02.hostedemail.com: domain of hannes@cmpxchg.org designates 209.85.160.173 as permitted sender) smtp.mailfrom=hannes@cmpxchg.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1742685287; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=XJHqDIUEdiSQHsyrP8cT37rDikvtCQ4w65f+7jAbskE=; b=v+QjpVeouhn0GgaTqfYoZh1wRS1EopVgzGOHHJjZCE36cj2yBhjAHkF8iJTLZZtbU0jtDJ yXUFWemmxn3ZWrScN22Ha9MP+xSmclYmsX+A/1NhWZN8cs4PTUM7y7o9TG0cGiG+0ltj+H USouQxH4GIoCbUhSjpOvuDiJHQd5tV0= Received: by mail-qt1-f173.google.com with SMTP id d75a77b69052e-4769b16d4fbso16868301cf.2 for ; Sat, 22 Mar 2025 16:14:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cmpxchg-org.20230601.gappssmtp.com; s=20230601; t=1742685286; x=1743290086; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=XJHqDIUEdiSQHsyrP8cT37rDikvtCQ4w65f+7jAbskE=; b=ngx77oIUbPaOYWy1YC69O7Gy+wmyX+EXSEs1JtXj3on97SW6D/u2E1RIRTjEd7nxmo EgVhQkAvdBN+O+6BmNwK+39U/DZnIm+Qk+0f8RxBMWEXGBl/mtXR8fsTeAGdI5execep MHZWBRhYYuepf+ZsUH5nYVFsqnzro8Sj5Iutm/2Ob6DgTXrH9q+9SRzp9hXeQIpAajgm hR+6Ia94QK0QvUucn8SkHl+YUi7w1CDFzosWmuL8SSt+o4uhJhS/JlM7EQupC1/wbgJv A1NIhu6BfXwS/d2YlJhTSx1HkF98wma8WgKhOWk+OqGVBIhff6lKOjTFTsRt7rqCATgZ 80AQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1742685286; x=1743290086; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=XJHqDIUEdiSQHsyrP8cT37rDikvtCQ4w65f+7jAbskE=; b=EPzP7kQRTdGEUFPYQkbfeRUjWmlaizHY40RAw7cnXWe3q02H2jQxREXTqtXnPuxGHB mP70VE6DAOMNbI+Kfbcq9AhEduhN97K9uTN/GcYMlwgc79Yz56UI6GU0pE5SKQN7+wgR UPY4/8AqV9UBWAVd+3i0pmzXH5MSDK+W6XEBmaWjLuhIltLu6khchcD6GjbfS7HJOUfu SwDPyGfqO6efL7S9Je4k4ea+4ci4PY1+3jmAjCXZO8wvXW/DGHSv/jc69yebjFP8eDst g8IPxu2fxGCDYvVLHgEyjHakZjmCr++mX585CM2/QY3b0ssPf75n68KM0dXzzZpDQ1iz HdTw== X-Forwarded-Encrypted: i=1; AJvYcCX54bKj52nmWqKzz6fCHyZxZk5wjVH6Jhf32TufDWPDl0bPLGb6JECxJzwKj3Xio33Zww+M6zbj4A==@kvack.org X-Gm-Message-State: AOJu0YzZhsM2yDVWphYFzEL52uroIZ1YAaNlGjpQM8o7B6OvR0SQmm+h Yw4zS/lyzmCz8mkukRr7/fbmWY0Q7LXrXYyZKCzLXFG6+kIeH5d1yYbPLTlXv7M= X-Gm-Gg: ASbGncv/hfxMzf85b4j5SJidbCxcl1U7jtKPqZeKrLVkJzJKc1ltL/Y87mtJhMOeohV 7SrLXrev0+NPHylbcVsoh6MJeYOTdCPjy3oX/M64ELhCS/S5LNWTthLgd8H5QoGxMm58eU5j6Sw YGMeVAJH4xcodFlbCqSk+kMZgk0/k0ZGVvZkb61gJ+DmGW40oo/k8ixdH7O3F0ZHI6n33c105Uh sGO+BG2cPpKpwUwS/rIhqDch8yR+E0EJYeWYqMW5aemdG5RDQQEK6hjrHYlmNz1W/mENNsalK7H bk+rk65ZrujS6BmR2K8yw3sJmlGQhmWr31h1p87+YN0= X-Google-Smtp-Source: AGHT+IGn+Hfwrgke1zQGLzwV/3qh9WnxZhHDgrV3gDmuUHLVptmjftr0MP8pFPzrqZlO7fZJloZXWg== X-Received: by 2002:a05:622a:2513:b0:476:8132:c556 with SMTP id d75a77b69052e-4771de61284mr143182971cf.48.1742685286373; Sat, 22 Mar 2025 16:14:46 -0700 (PDT) Received: from localhost ([2603:7000:c01:2716:da5e:d3ff:fee7:26e7]) by smtp.gmail.com with UTF8SMTPSA id d75a77b69052e-4771d18f6a3sm27701901cf.38.2025.03.22.16.14.45 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 22 Mar 2025 16:14:45 -0700 (PDT) Date: Sat, 22 Mar 2025 19:14:40 -0400 From: Johannes Weiner To: Luis Chamberlain Cc: Matthew Wilcox , Jan Kara , Oliver Sang , David Hildenbrand , Alistair Popple , linux-mm@kvack.org, Christian Brauner , Hannes Reinecke , oe-lkp@lists.linux.dev, lkp@intel.com, John Garry , linux-block@vger.kernel.org, ltp@lists.linux.it, Pankaj Raghav , Daniel Gomez , David Bueso Subject: Re: [linux-next:master] [block/bdev] 3c20917120: BUG:sleeping_function_called_from_invalid_context_at_mm/util.c Message-ID: <20250322231440.GA1894930@cmpxchg.org> References: <20250311-testphasen-behelfen-09b950bbecbf@brauner> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 7773480009 X-Stat-Signature: 7719b3tbsuxcocj4as718wpn8tzayrgb X-Rspam-User: X-Rspamd-Server: rspam06 X-HE-Tag: 1742685287-501881 X-HE-Meta: U2FsdGVkX1/M3esxMMG3C8hne6HnmHCpWyR0m6rr6V/hZGDSEu92ToVmBSZKDjyFx3M8ZpuWp/eZA0BXCEl42tNOOycmMoFZRtwwQiTRK9gwuC3rnh0B1UNsfN6Ov78mSI5CfuagBCvrpw01xkvSIzLPU5e62t7AAPp6dH6u47NCm/ilHFooSAC4/3F9WM1FkTf7+I/h/8S6xkUGGMlMslbt6bHq7IOoiC/xhDXbSp7ReSi3sVHYzn7lS1ie5AjTYr0LO9L+gbe6ANLqiox3GQTDWjQ2HX6MRNz1i8ax4gpn37e9ipYFOLteBkjxy8nLBjCxWx2XWxd7aGpL9jjkwiArSdZ6pQfkSN0a0ulto91nl8cyRVtopE64Insf/8F+lgF3k6fCmvennvrKMHR9bWTzP138RoluEdlxzCJrOHYfZ8+mKIQk7lk1IOcUZ2Q9E2Qrppbvj3K1dg7jTDtLGnPr8NkEq93lUQPuPVZc8S7EeEwxNZvi+ehjOh+m12N2GxIBI/DmDgAsxIYW0Z0fg8KpO9JzsLZuIZAfcjOqSNC8I4lIBabMvRA5MWwDY8mTu9mwS4CUOFzfExj8rYsLAKCLaUJuNKNQAQHb77CdAQug/VV7JradQJmXOlzhfAR744ZybhwUBU3twixkej9aPNhESphL/yUepnOA5fF7zR9AWj/WFdBN2MhsGyFSwVrzHadn4xHYkcCBdS2f6C9tirpPuL0u7MV5yZsQvBvZ1TcPSEXiwqk0qulmmzgyBtuYFWj2YXoqBa42XA+NgkGwyzwp5J40XMUQH4UBSzhFgW2u9vWyCF577bw99AiOjeuJGGEikmQ/FPFKMFY6/0+WDgLice1zT/BdTFjWBj/pYIACy02Pm5ZId4S0o9+WrdSnSUg/jc5evu9tbC7RmOla8Nnt/coczHVmvziSAHY+oxQ3LxuejjHAUoQazllk420yNRxJ7+SQKgotN06HLse YE6Vzncc WONyG3Nd8SoIbUwRt8vnMvcZMvakrLi5TDynTQkchgBPtwuV9V/4BbrPkae3tGs/qVTktVr8a4296BJT57SlDoaD0d5/jJTIrCgOdtuBK5hLiRFu8zGAc3L42sqwpEz6QRJNbo6rMrhwotGVAH7tsQNmd0xxM4ZKVtaiApOWvKevAVzByKW4MkjMlqIQNeTE/Xc+dIHogz6XZ7gMb3XY9jKdiSJNAAzHduuWiKYUaB4JUp4w/HUGxirqXdwqLDhGUznAmAL6qI1CzLno4+LRvYMt30PIspID3F70TYQ8zKweAMK6uwS9SIxXaD9ElF5uwUEyJLbAebahb7IkSWdTFXJJ7xID542/oxmPGfxXlUBWDF0N2nMcjhD6kBuqffsDh3YO8aw1GZh8hQwqEEqd2hkw830uQN2D8qp97AZ7FUU/JC3DwhvAho7Osgdy+EOhP3COPO90lwPPWj/VZISykEuhErw1NGTF8YPU+o66dIJzd7V8/LBeSBFSxa+lxtHu3/TXIkkauJY6vwcWaYWROodOw7B2m8OYC21pFCG0dpHrYOHAilrs4U0v22g== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hey Luis, On Thu, Mar 20, 2025 at 05:11:19AM -0700, Luis Chamberlain wrote: > On Wed, Mar 19, 2025 at 07:24:23PM +0000, Matthew Wilcox wrote: > > On Wed, Mar 19, 2025 at 12:16:41PM -0700, Luis Chamberlain wrote: > > > On Wed, Mar 19, 2025 at 09:55:11AM -0700, Luis Chamberlain wrote: > > > > FWIW, I'm not seeing this crash or any kernel splat within the > > > > same time (I'll let this run the full 2.5 hours now to verify) on > > > > vanilla 6.14.0-rc3 + the 64k-sector-size patches, which would explain why I > > > > hadn't seen this in my earlier testing over 10 ext4 profiles on fstests. This > > > > particular crash seems likely to be an artifact on the development cycle on > > > > next-20250317. > > > > > > I confirm that with a vanilla 6.14.0-rc3 + the 64k-sector-size patches a 2.5 > > > hour run generic/750 doesn't crash at all. So indeed something on the > > > development cycle leads to this particular crash. > > > > We can't debug two problems at once. > > > > FOr the first problem, I've demonstrated what the cause is, and that's > > definitely introduced by your patch, so we need to figure out a > > solution. > > Sure, yeah I followed that. > > > For the second problem, we don't know what it is. Do you want to bisect > > it to figure out which commit introduced it? > > Sure, the culprit is the patch titled: > > mm: page_alloc: trace type pollution from compaction capturing > > Johannes, any ideas? You can reproduce easily (1-2 minutes) by running > fstests against ext4 with a 4k block size filesystem on linux-next > against the test generic/750. Sorry for the late reply, I just saw your emails now. > Below is the splat decoded. > > Mar 20 11:52:55 extra-ext4-4k kernel: Linux version 6.14.0-rc6+ (mcgrof@beefy) (gcc (Debian 14.2.0-16) 14.2.0, GNU ld (GNU Binutils for Debian) 2.44) #51 SMP PREEMPT_DYNAMIC Thu Mar 20 11:50:32 UTC 2025 > Mar 20 11:52:55 extra-ext4-4k kernel: Command line: BOOT_IMAGE=/boot/vmlinuz-6.14.0-rc6+ root=PARTUUID=503fa6f2-2d5b-4d7e-8cf8-3a811de326ce ro console=tty0 console=tty1 console=ttyS0,115200n8 console=ttyS0 > > < -- etc --> > > Mar 20 11:55:27 extra-ext4-4k unknown: run fstests generic/750 at 2025-03-20 11:55:27 > Mar 20 11:55:28 extra-ext4-4k kernel: EXT4-fs (loop5): mounted filesystem c20cbdee-a370-4743-80aa-95dec0beaaa2 r/w with ordered data mode. Quota mode: none. > Mar 20 11:56:29 extra-ext4-4k kernel: BUG: unable to handle page fault for address: ffff93098000ba00 > Mar 20 11:56:29 extra-ext4-4k kernel: #PF: supervisor read access in kernel mode > Mar 20 11:56:29 extra-ext4-4k kernel: #PF: error_code(0x0000) - not-present page > Mar 20 11:56:29 extra-ext4-4k kernel: PGD 3a201067 P4D 3a201067 PUD 0 > Mar 20 11:56:29 extra-ext4-4k kernel: Oops: Oops: 0000 [#1] PREEMPT SMP NOPTI > Mar 20 11:56:29 extra-ext4-4k kernel: CPU: 0 UID: 0 PID: 74 Comm: kcompactd0 Not tainted 6.14.0-rc6+ #51 > Mar 20 11:56:29 extra-ext4-4k kernel: Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 2024.11-5 01/28/2025 > Mar 20 11:56:29 extra-ext4-4k kernel: RIP: 0010:__zone_watermark_ok (mm/page_alloc.c:3256) > Mar 20 11:56:29 extra-ext4-4k kernel: Code: 00 00 00 41 f7 c0 38 02 00 00 0f 85 2c 01 00 00 48 8b 4f 30 48 63 d2 48 01 ca 85 db 0f 84 f3 00 00 00 49 29 d1 bb 80 00 00 00 <4c> 03 54 f7 38 31 d2 4d 39 ca 0f 8d d2 00 00 00 ba 01 00 00 00 85 > All code > ======== > 0: 00 00 add %al,(%rax) > 2: 00 41 f7 add %al,-0x9(%rcx) > 5: c0 38 02 sarb $0x2,(%rax) > 8: 00 00 add %al,(%rax) > a: 0f 85 2c 01 00 00 jne 0x13c > 10: 48 8b 4f 30 mov 0x30(%rdi),%rcx > 14: 48 63 d2 movslq %edx,%rdx > 17: 48 01 ca add %rcx,%rdx > 1a: 85 db test %ebx,%ebx > 1c: 0f 84 f3 00 00 00 je 0x115 > 22: 49 29 d1 sub %rdx,%r9 > 25: bb 80 00 00 00 mov $0x80,%ebx > 2a:* 4c 03 54 f7 38 add 0x38(%rdi,%rsi,8),%r10 <-- trapping instruction This looks like the same issue the bot reported here: https://lore.kernel.org/all/20250321135524.GA1888695@cmpxchg.org/ There is a fix for it queued in next-20250318 and later. Could you please double check with your reproducer against a more recent next? Thanks