From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 78A56D68BE6 for ; Sat, 16 Nov 2024 15:32:29 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 816826B0089; Sat, 16 Nov 2024 10:32:28 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 7C2B66B00C3; Sat, 16 Nov 2024 10:32:28 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 664776B00C4; Sat, 16 Nov 2024 10:32:28 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 40B366B0089 for ; Sat, 16 Nov 2024 10:32:28 -0500 (EST) Received: from smtpin05.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 00364A1AC7 for ; Sat, 16 Nov 2024 15:32:27 +0000 (UTC) X-FDA: 82792348884.05.FAD425C Received: from nyc.source.kernel.org (nyc.source.kernel.org [147.75.193.91]) by imf30.hostedemail.com (Postfix) with ESMTP id 2BF5380003 for ; Sat, 16 Nov 2024 15:30:57 +0000 (UTC) Authentication-Results: imf30.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=dRE3ms3B; dmarc=pass (policy=quarantine) header.from=kernel.org; spf=pass (imf30.hostedemail.com: domain of sashal@kernel.org designates 147.75.193.91 as permitted sender) smtp.mailfrom=sashal@kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1731771081; a=rsa-sha256; cv=none; b=NaSRR8JmJTaITAfkd9WZkRtMwDRRDjek3wlur/N5p9gn5QgoG7lwVskrY8xdhLS3rwlHIj IlHvC4BgUcfQukHbJY7lqhE+aDcZvbQg/6IB8alHZrq0Y1lyaWDa2fuPiuPChZkAg2khoW yhfrHgs8kIzm6an5xR4UKublOtOe2ng= ARC-Authentication-Results: i=1; imf30.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=dRE3ms3B; dmarc=pass (policy=quarantine) header.from=kernel.org; spf=pass (imf30.hostedemail.com: domain of sashal@kernel.org designates 147.75.193.91 as permitted sender) smtp.mailfrom=sashal@kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1731771081; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=zjhb36+XdIH1JODkDk9adyVXHS6h8OWtjzXITibrdX4=; b=7CVnMjJbaG6OXv7d3owww7EIgnA9AhzLnaV1cV4eeS9QuAk5R3ZLmKG+h9keol2ek5Vuy5 mlrPaOhvE2pXKBlz/ecGD17IE8H8VofT39XZ5r3pcYHdj0SiZQ/VfXo6heSVpC/rquhQYh JLNYMUmODdZxecIhnwXBgs9cYnQ09ho= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by nyc.source.kernel.org (Postfix) with ESMTP id 7C519A4025A; Sat, 16 Nov 2024 15:30:31 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id C8308C4CEC3; Sat, 16 Nov 2024 15:32:24 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1731771145; bh=gUhI8FPCE2iHwriwexSVAIZxCk3k4+8NuwBEKyXj/x4=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=dRE3ms3B5HYFsnfZbR2unSAo3E51ZvYGcn+QRDdwjA2oOVsctbBBC8Io+/TWpNRUt PSGQEWwBpvmOhZnln4HMEze/gEA/MlLr6iVs1T/FH0PzGYJPcSlIZy/atmeuz2wBHK SbMjeENrKf6CebrYBN+cZMPUfU2UYg7zX8T+2Cq7Z4ZxTU6EFectv3Z7TCZKy2clZ1 mYop16XeTCxtW4sTzhlGRaQKrFYobr6J1h2ZFwGzZtw/h5Z5JFOWbBindDXWPuLFDo HBlV/VyU6M+2lTGOqtxTDBNTvYLiFiXYAijhr23rZZZtwH4h+Zu2VoIKps5jRvg/yv pYSGlOfZM4xWg== Date: Sat, 16 Nov 2024 10:32:23 -0500 From: Sasha Levin To: Vlastimil Babka Cc: Linus Torvalds , David Rientjes , Christoph Lameter , Andrew Morton , "linux-mm@kvack.org" , LKML , Roman Gushchin , Hyeonggon Yoo <42.hyeyoo@gmail.com> Subject: Re: [GIT PULL] slab updates for 6.13 Message-ID: References: <03ec75a9-aade-4457-ac21-5649116afa98@suse.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <03ec75a9-aade-4457-ac21-5649116afa98@suse.cz> X-Rspam-User: X-Rspamd-Queue-Id: 2BF5380003 X-Rspamd-Server: rspam01 X-Stat-Signature: m8jo19ef6r7dr6fxuuaermjy87bacdun X-HE-Tag: 1731771057-394632 X-HE-Meta: U2FsdGVkX193XKU1pqgkGIT+ccoKZU+4R5NICViuP2e/wlfNKVz+BNO28COV52zXhCRtj4EkrlRVW31Nx08+lP7mfKO0Cg+bM2LfNptv2pcxjMiXTz9wrsJ1R+i7BinbkMPy7ltRjG4KiIPpLvkvZE//qC0XkC4dRtlyiuZ4HUpiIHfp4x/OaLngmR/5VQiG7Pq3rDoca9PTyTUeDpodSu6oFSnUnsU7Ea3pIUCeJF/P1BbVXTbTefpqzjUTjWgc6WoYUeynC6TtPoarGiSsD0XqJKZ3/PPxV//vSLgwuSRiNdFFFGejJuc0cWHIsqhdqctmjRtU3vDwJ5RKZqpcGtbN0mM8G2OrT1u+HTzjvcN8kYK39mYK+NR2vQ15PcB7TI2fnM51iO03PZlfVwkOo14U24eSLVMwDH0qFqTOW78CURTqkwNL5bobY6iAEgIhLyImhHFx+UIgxH2UaNua23rHZcu2yRbzrCZTpbGRuu2SDDh2dz6pXN6PIDF22GcZY1o7zywUxULWpP/uTsllrRtbslvyFTTkvlnssmT9uCTY7NeIu4GOm74TM5Y9sFlqWMJleUkarRWjw3nVe8KOAd1iNa3OFqmdWD0mJZZr6KdCnKsG4gy3gGr24tzrDYh9dy1M5Q0goyxBM1HFx8/N0E6k9ygRWUD6kX01EIRfL9rwJ5NZO9uKURvg+YCrtCRtk1vP0Ry1RYyykV3q3Eo+1yGfSP1iAQhczx8U/f96KwRREmE7pk8lzQ0p3VCFzv3wVOE6f3c8XTsmRX1TDNKG7MPTXu0MK+m/lJHeTIJIEFafPYY4o8wICbFFZcMeiS5qKkDhN65A/4Z48/VStjZLgYzWUwpkIjBLZeX9TIP0nIJX5ZYQmSXtSa87uW9Lis1fkV5+KLdl0b4Axpz2kav97X9GEDLhd4ooeRftbrTYkJt1JPpN1ZnV+wxp73+Z5shGmQiAWU0S8ZSB7mnxq13 8BzXIuhv 6MUyZ+DuEHxGjLVGW/BIqgIsgJmTVqw6tZegixbB6GFlWh+Bp7+xd5mzBYHbRhnO59aOp6+GYVkrl9gTjckN0jqfBqcJv8hhTX7HAYEU2F6IR4ZBHaJhhSYwpmS1S7kaElKYlKmm6od4SHG+une8E9oI+2iaHQMkoawQcPpFofjeGaRl+DDu6o8OMj+RY8ARpDuBDA2xtwLV8bIcFVamHEDPGnpW407lXaI5ErG61uyGY/HyIviwXBeno2++6mZTlC+R5dMYmJNNt6wYnfbQl4LkiNzMzye3HL+qolH545R9cA8GcLgFYkD/DANkbQhH+vXrHbjaq/nanP3/1VlE5mp4+DdqeJpLP1pj+DwnQSJgwjUMuXU9ON4WDMrRCbBAvgrmxmBL1fC8dwUPvY7vThYH3vheUxDQKqtvIJlFlnDd60txLROiDD253q0rtFK5kMgBYVxwsauxH7wzpxiwYGGUJq1C10ZjitaFH1HVKp16tct1KNYplkdWuV+JTlEEOUlMz6Cu4cGdQ+jjSzD6ifR4RAYi51IQeBrbync2MyxGuHPgFhzlk9xiE/sxxyde79X39PqTcDq8kQItMpT7oWlKxuRWmxYTsn+O4zmmhikGpTw4= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: [ Adding Christian and Al ] On Fri, Nov 15, 2024 at 03:22:30PM +0100, Vlastimil Babka wrote: >Hi Linus, > >please pull the latest slab updates from: > > git://git.kernel.org/pub/scm/linux/kernel/git/vbabka/slab.git tags/slab-for-6.13 > >One new feature and non-critical fixes (mostly related to debugging). >No conflicts to be expected, AFAIK. After merging the last batch of pull requests which included VFS and SLAB into my linus-next[1] tree I've started seeing consistent boot and runtime failures both on LKFT[2] and KernelCI[3]. I'm going to start bisection, but given the amount of content that went in it might take a day or two. It seems that this is something in the interaction between VFS and SLAB: Boot failures: [ 4.600870] __kmem_cache_create_args(ext4_groupinfo_4k) failed with error -22 [ 4.602001] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.12.0-rc7 #1 [ 4.602644] Hardware name: linux,dummy-virt (DT) [ 4.603346] Call trace: [ 4.603594] dump_backtrace+0x108/0x190 [ 4.604831] show_stack+0x24/0x38 [ 4.605104] dump_stack_lvl+0x40/0xa0 [ 4.605472] dump_stack+0x18/0x28 [ 4.605842] __kmem_cache_create_args+0x21c/0x248 [ 4.606235] ext4_mb_init+0x118/0x720 [ 4.606572] ext4_fill_super+0x1550/0x17d8 [ 4.606890] get_tree_bdev_flags+0x138/0x1d8 [ 4.607279] get_tree_bdev+0x20/0x38 [ 4.607643] ext4_get_tree+0x24/0x38 [ 4.608013] vfs_get_tree+0x3c/0x108 [ 4.608260] do_new_mount+0x154/0x398 [ 4.608622] path_mount+0x258/0x4d0 [ 4.609030] init_mount+0x78/0xc8 [ 4.609434] do_mount_root+0xd4/0x1b0 [ 4.609887] mount_root_generic+0x110/0x308 [ 4.610177] mount_block_root+0x5c/0x78 [ 4.610428] mount_root+0x74/0xa8 [ 4.610662] prepare_namespace+0x8c/0xd8 [ 4.610922] kernel_init_freeable+0x10c/0x160 [ 4.611197] kernel_init+0x2c/0x1c0 [ 4.611437] ret_from_fork+0x10/0x20 [ 4.612106] EXT4-fs: no memory for groupinfo slab cache [ 4.612757] EXT4-fs (vda): failed to initialize mballoc (-12) Runtime failures: __kmem_cache_create_args(ext4_groupinfo_1k) failed with error -22 CPU: 0 UID: 0 PID: 76 Comm: kunit_try_catch Tainted: G N 6.12.0-rc7 #1 Tainted: [N]=TEST Hardware name: ARM-Versatile (Device Tree Support) Call trace: unwind_backtrace from show_stack+0x10/0x14 show_stack from dump_stack_lvl+0x34/0x3c dump_stack_lvl from __kmem_cache_create_args+0x24c/0x2c4 __kmem_cache_create_args from ext4_mb_init+0xf4/0x690 ext4_mb_init from mbt_kunit_init+0x394/0x474 mbt_kunit_init from kunit_try_run_case+0x40/0x1d4 kunit_try_run_case from kunit_generic_run_threadfn_adapter+0x1c/0x34 kunit_generic_run_threadfn_adapter from kthread+0xe0/0x10c kthread from ret_from_fork+0x14/0x28 Exception stack(0xd0981fb0 to 0xd0981ff8) 1fa0: 00000000 00000000 00000000 00000000 1fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 1fe0: 00000000 00000000 00000000 00000000 00000013 00000000 EXT4-fs: no memory for groupinfo slab cache # test_new_blocks_simple: failed to initialize: -12 ------------[ cut here ]------------ kernel BUG at fs/ext4/mballoc.c:3283! Internal error: Oops - BUG: 0 [#1] PREEMPT ARM Modules linked in: CPU: 0 UID: 0 PID: 77 Comm: kunit_try_catch Tainted: G N 6.12.0-rc7 #1 Tainted: [N]=TEST Hardware name: ARM-Versatile (Device Tree Support) PC is at ext4_mb_release+0x2f4/0x31c LR is at mbt_kunit_exit+0x10/0x80 pc : [] lr : [] psr: 60000113 sp : d0985f18 ip : d0985f30 fp : 00000000 r10: 00000000 r9 : d0811d50 r8 : c17cc000 r7 : c17cc000 r6 : c16be240 r5 : c1c761c0 r4 : d0811d44 r3 : ffff0fff r2 : 00000000 r1 : c12d3fc0 r0 : 00000000 Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment none Control: 00093177 Table: 00004000 DAC: 00000053 Register r0 information: NULL pointer Register r1 information: non-slab/vmalloc memory Register r2 information: NULL pointer Register r3 information: non-paged memory Register r4 information: 2-page vmalloc region starting at 0xd0810000 allocated at copy_process+0x170/0xdd4 Register r5 information: slab task_struct start c1c761c0 pointer offset 0 size 1728 Register r6 information: slab kmalloc-64 start c16be240 pointer offset 0 size 64 Register r7 information: slab kmalloc-1k start c17cc000 pointer offset 0 size 1024 Register r8 information: slab kmalloc-1k start c17cc000 pointer offset 0 size 1024 Register r9 information: 2-page vmalloc region starting at 0xd0810000 allocated at copy_process+0x170/0xdd4 Register r10 information: NULL pointer Register r11 information: NULL pointer Register r12 information: 2-page vmalloc region starting at 0xd0984000 allocated at copy_process+0x170/0xdd4 Process kunit_try_catch (pid: 77, stack limit = 0x(ptrval)) Stack: (0xd0985f18 to 0xd0986000) 5f00: c1440000 00000000 5f20: c102e680 c1c76638 d0985f68 c0c21734 00000003 00000000 00000004 d0811d44 5f40: c1c761c0 c16be240 d0811c88 c17cc000 d0811d50 00000000 00000000 c022e758 5f60: d0811d44 c1c761c0 c16be240 d0811c88 c039be9c d0811d50 00000000 c0399c0c 5f80: d0811d50 c039beb8 c16bf160 c0044a4c c16bf160 c004496c 00000000 00000000 5fa0: 00000000 00000000 00000000 c000854c 00000000 00000000 00000000 00000000 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000 00000000 00000000 Call trace: ext4_mb_release from mbt_kunit_exit+0x10/0x80 mbt_kunit_exit from kunit_try_run_case_cleanup+0x30/0x3c kunit_try_run_case_cleanup from kunit_generic_run_threadfn_adapter+0x1c/0x34 kunit_generic_run_threadfn_adapter from kthread+0xe0/0x10c kthread from ret_from_fork+0x14/0x28 Exception stack(0xd0985fb0 to 0xd0985ff8) 5fa0: 00000000 00000000 00000000 00000000 5fc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000 5fe0: 00000000 00000000 00000000 00000000 00000013 00000000 Code: e3a010c9 e3811c0e eb278c81 eaffff5d (e7f001f2) ---[ end trace 0000000000000000 ]--- [1] https://git.kernel.org/pub/scm/linux/kernel/git/sashal/linus-next.git/log/?h=linus-next [2] https://qa-reports.linaro.org/lkft/sashal-linus-next/build/v6.11-15430-gc12cd257292c/testrun/25849362/suite/boot/test/clang-19-lkftconfig/log [3] https://kciapistagingstorage1.file.core.windows.net/early-access/baseline-x86-kcidebug-amd-6738b3dc1a48e7821930a51b/log.txt.gz?sv=2022-11-02&ss=f&srt=sco&sp=r&se=2026-10-18T13:36:18Z&st=2024-10-17T05:36:18Z&spr=https&sig=xFxYOOh5uXJWeN9I3YKAUvpGGQivo89HKZbD78gcxvc%3D -- Thanks, Sasha