From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id F179EC072A2 for ; Wed, 22 Nov 2023 03:17:33 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 126D56B0530; Tue, 21 Nov 2023 22:17:33 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 0B0476B0531; Tue, 21 Nov 2023 22:17:33 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E6C186B0532; Tue, 21 Nov 2023 22:17:32 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id D500D6B0530 for ; Tue, 21 Nov 2023 22:17:32 -0500 (EST) Received: from smtpin04.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id B49C11CB3DF for ; Wed, 22 Nov 2023 03:17:32 +0000 (UTC) X-FDA: 81484129944.04.9B3F25C Received: from mail-ua1-f41.google.com (mail-ua1-f41.google.com [209.85.222.41]) by imf22.hostedemail.com (Postfix) with ESMTP id CC591C0011 for ; Wed, 22 Nov 2023 03:17:29 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=kVnVJaLw; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf22.hostedemail.com: domain of 42.hyeyoo@gmail.com designates 209.85.222.41 as permitted sender) smtp.mailfrom=42.hyeyoo@gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1700623049; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=+cifHwiL86k/hSfKeSdI4QL5cIbDxkzf2iHBxnZU0xs=; b=7JZIpMG/xM5CwNLQ3ssKUxSCavPIjmpTUeGwo12U9zFbu7D3XE/InHIgFdOyKN28s3yOws kGK0yJo/Hmhe4gRoZY6eIbkP4UbK4GFH3WGvemLNEbDOXa3DHZZlK01CIpRIeRKnbgz4rT AEM9jo+W9GD+MUVw7Ze7T9XZzsbYPC8= ARC-Authentication-Results: i=1; imf22.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=kVnVJaLw; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf22.hostedemail.com: domain of 42.hyeyoo@gmail.com designates 209.85.222.41 as permitted sender) smtp.mailfrom=42.hyeyoo@gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1700623049; a=rsa-sha256; cv=none; b=8r45qIpdXjoo8PCTz0sNFyk+FwOgFUSxjYWLdyfKRdhS0K+8q/ZDzYH1JaITlZS9suiIKc q+EHwasrgfxZJU5xKykHPHlR/fUVg83E80gM84YhL1l1BK8dZS3DWNku3IDbXUWUfd1p7T sL7wN+Kj1bMCvymv/PPhVlohSozlkd8= Received: by mail-ua1-f41.google.com with SMTP id a1e0cc1a2514c-7baea76391dso257220241.1 for ; Tue, 21 Nov 2023 19:17:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1700623049; x=1701227849; darn=kvack.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=+cifHwiL86k/hSfKeSdI4QL5cIbDxkzf2iHBxnZU0xs=; b=kVnVJaLwF0x0r0s1aBoHwXgMDiYAdRYWyu92tuqre7fJR7R7PV5NAzW2XuhodiTZRP J/MhvOzConKKYHzrHEVVtBiAbkftbgJbtHQ554LlfSzzInAR/N8rAks/2pNdno0sigjN hbkuyKtWlBrd68NUw27wqVUJv9gWnWtmqzVEpmKw4bZjeGQEmog5wdsuByUr84LoZikO GuUzPF9WkV6RpeASk/bw1YIDWtNe5bqjozCHs3mh5oockdyGdMuk6z4VJy9ZmKNVkp/D H2C2uSp5U3dFGoslHlFQXWbAZg8SuVNEw1oS3pk4HTXotZm8n2QGfHngT6IAoGzOXwSa 0x6w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1700623049; x=1701227849; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=+cifHwiL86k/hSfKeSdI4QL5cIbDxkzf2iHBxnZU0xs=; b=AJ8qkTULItrC3vXO20MD6ZoJZU7WaB9hbbj/X3xU/4qy3bUSw7NrJgXN3V7m+7GOKt 6FaXT6eqsSCNBPrlNTDU8DGb+Suoryl3nXSIVo6yXIA8kYsx2iPTJROijOBBrltD4Kyq aX0Fv4GRAOBtZOB3rvDA3Ndh+nzJiEk0FL3kztNEhuCNQN6M9ju+h31hA5AJHt5KhVir kiOHziyftT2OqysUojcQaogSGVA0Eflm7tJSqMRSXJ9mw3mj6vUfWlnOwBvARV/Y15cl utScs9V9pnF9+YSCLvh8mq2zKUnnvpo1JZsIfQrkMEHmbJBpgOd7fgRfZ2yuZOipKL0J /m5w== X-Gm-Message-State: AOJu0YzxYX+GJUKZokh1p7/mfj6jYZyip4mtN4PQ4Y5yQftNKLlOpmjD 3Q+9DCe5T6sj8khklA4gINBnuiVNJ21uboMxAT0= X-Google-Smtp-Source: AGHT+IHwWKCYdU4EOP3jw3UxRFra14RalBM3o+CJ2ZW9N4I1zCof+WHTL8F6RhxLhxOG7+1rGmy9X48PL2wxhdfnPcc= X-Received: by 2002:a05:6102:47:b0:462:7c78:ba53 with SMTP id k7-20020a056102004700b004627c78ba53mr1343955vsp.16.1700623048669; Tue, 21 Nov 2023 19:17:28 -0800 (PST) MIME-Version: 1.0 References: <5cef104d9b842899489b4054fe8d1339a71acee0.1700502145.git.andreyknvl@google.com> In-Reply-To: <5cef104d9b842899489b4054fe8d1339a71acee0.1700502145.git.andreyknvl@google.com> From: Hyeonggon Yoo <42.hyeyoo@gmail.com> Date: Wed, 22 Nov 2023 12:17:17 +0900 Message-ID: Subject: [BISECTED] Boot hangs when SLUB_DEBUG_ON=y To: andrey.konovalov@linux.dev Cc: Andrew Morton , Andrey Konovalov , Marco Elver , Alexander Potapenko , Dmitry Vyukov , Vlastimil Babka , kasan-dev , Evgenii Stepanov , Oscar Salvador , Linux Memory Management List , LKML , Andrey Konovalov Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: CC591C0011 X-Rspam-User: X-Rspamd-Server: rspam04 X-Stat-Signature: ek4myp4fy67k7edtmiiyff7zkanzr6sa X-HE-Tag: 1700623049-339272 X-HE-Meta: U2FsdGVkX1+vFsQuXEEMbMBtV1JwdZYfzqLHKUk7CzM57cVdBcJVfHcQ4BlYcb5zEVI0NfLOw10aTabM8DhZD3KhelUNTCRFWNPQ/eRCwtg290bIrZMh2pzVmZ5fIB9i0ML6nXWcUzvL9H0Cvk7PnU5HaRT7eVyAlwvnoJ+1k6qtJ5UXBgiZTgeh9Udq+E6D3pQY2m70dY5ykYkVgMnfodn/Slvmj4cXqy65vkRpKecbCwF7fb0UqwSHHHHQmJ3pvFrKCDOSxW/eCGu/8LCF7rHGDASiXbUphYjWnUG3Kgy1qjp4t2PgP8ftuCTMg1pMkOexXGowVvX3vmE1nYDW7+vqDIfcWuvJCzUbiWFsaO2SzGnmsB0efXqQUdotlYNp+Epl5U46eIX6d8oV+Lj+j0pbpAvwJgsvaI9jPetgaO4TNbbFfSkQ8/klychfPaC3/4+zR+5Xxtnr5kzWYVTjMPaC3DJrSJ2IfngisDjrrbjkj4cVzmArreBiL5neTyNSpdbf0ig2kll2WpiAl2+NlrTqmh5sIvQlQ85KKC+4RGOSDPQpulLLqaqpU194mJFs2XZoRJT7W+OpyHt/bUEzlwNGiBfcVGJm6jk2uCpguEl39snbjWbOBZsRQUO9xa2CFNZ63TZamjyHx3K24s0C5qGdEj/VyKww6OwYYQfa5Y8mwA2tXF1rKLXVCfyM4Bo0HSr84ZzsuNCaQkoUk6gMgu9eofLSwR7tI7POV/PCUXV+xta2QMLRGYWHlqtYr3TYaZTF7sZJhH4jlUIyUF3e7gmZAcqT0lxhdwsiTnV9ap0/Do2a4VDl7PQC/84EHBrQNAGC05EarDSsUvlUBCmQGunRM4YmsUuM7MLuGI+rmzeNCoQjhuRR3avHas2Uq6r0ACnOqba+o07BwV2YzHVx7/libQcfMNUe5ORhs8uxxpyNy5f8QnbbwRgAAyYbK1TblXl/+BeTwYfmReKAPJN 6MxFw7Un MDE9Vof8PSfDMPYPuowXcEflKT+rz2Ift3iBdnaLMri1ncQBGSg+6b5NPcaSO3UwchQMn74cJVKMvL1d2CPxsq/FaiVphYc+FPH+av1QmQbygocdSmWmqrB8xEV6F+B5tX9xJKVOUWn3x5poSE/jzZnZM/9nspqeDkub/5Q/Ry4UnJx6afAKKxmgH4tn/jeV8gNBmVxv/uQRZ0SMiQa4nKs5K1jMzsTv/mwVhqbEtYTgiESpeu5eZsWd8r0U2s1dstCeU5RhNnTssbKmqvgaU4iGW1v1+LT6cbnCfoduZU5Ufd0kNjANm9jrzG4TzKE1wBaZ3B+ZoYS/gHT2pY7OcVrg6WOe3b5FGp8V1SRRv83/QcjpJv6s5xQnkV4nuNwBGY8ahpZtGY1UxZ0Z7DvXSiaHTAkZ1qPBcXH6vW+m0WFvTqw7sIp6D4XhMoF9IhtuBKckZsBlSK4Nn4seNbut0hhGn7YegjlwBN+1kB4hfD62qoBSFNed7u4AHOipOnFzpjSpkqrN8yJkDT6VtKJHTZs7SsPcgf3kjVJyNY36Tp+pphHEpnQvpNgrC9/OaiCiTZoIpx6gE2e7GXOZNrwAJcgc7tYVEyTG/TVyx X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Tue, Nov 21, 2023 at 1:08=E2=80=AFPM wrote: > > From: Andrey Konovalov > > Evict alloc/free stack traces from the stack depot for Generic KASAN > once they are evicted from the quaratine. > > For auxiliary stack traces, evict the oldest stack trace once a new one > is saved (KASAN only keeps references to the last two). > > Also evict all saved stack traces on krealloc. > > To avoid double-evicting and mis-evicting stack traces (in case KASAN's > metadata was corrupted), reset KASAN's per-object metadata that stores > stack depot handles when the object is initialized and when it's evicted > from the quarantine. > > Note that stack_depot_put is no-op if the handle is 0. > > Reviewed-by: Marco Elver > Signed-off-by: Andrey Konovalov I observed boot hangs on a few SLUB configurations. Having other users of stackdepot might be the cause. After passing 'slub_debug=3D-' which disables SLUB debugging, it boots fine. compiler version: gcc-11 config: https://download.kerneltesting.org/builds/2023-11-21-f121f2/.config bisect log: https://download.kerneltesting.org/builds/2023-11-21-f121f2/bis= ect.log.txt [dmesg] (gdb) lx-dmesg [ 0.000000] Linux version 6.7.0-rc1-00136-g0e8b630f3053 (hyeyoo@localhost.localdomain) (gcc (GCC) 11.3.1 20221121 (R3[ 0.000000] Command line: console=3DttyS0 root=3D/dev/sda1 nokaslr [ 0.000000] CPU: 0 PID: 0 Comm: swapper Not tainted 6.7.0-rc1-00136-g0e8b630f3053 #22 [ 0.000000] RIP: 0010:setup_arch+0x500/0x2250 [ 0.000000] Code: c6 09 08 00 48 89 c5 48 85 c0 0f 84 58 13 00 00 48 c1 e8 03 48 83 05 be 97 66 00 01 80 3c 18 00 0f3[ 0.000000] RSP: 0000:ffffffff86007e00 EFLAGS: 00010046 ORIG_RAX: 0000000000000009 [ 0.000000] RAX: 1fffffffffe40088 RBX: dffffc0000000000 RCX: 1ffffffff11= ed630 [ 0.000000] RDX: 0000000000000000 RSI: feec4698e8103000 RDI: ffffffff88f= 6b180 [ 0.000000] RBP: ffffffffff200444 R08: 8000000000000163 R09: 1ffffffff11= ed628 [ 0.000000] R10: ffffffff88f7a150 R11: 0000000000000000 R12: 00000000000= 00010 [ 0.000000] R13: ffffffffff200450 R14: feec4698e8102444 R15: feec4698e81= 02444 [ 0.000000] FS: 0000000000000000(0000) GS:ffffffff88d5b000(0000) knlGS:0000000000000000 [ 0.000000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 0.000000] CR2: ffffffffff200444 CR3: 0000000008f0e000 CR4: 00000000000= 000b0 [ 0.000000] Call Trace: [ 0.000000] [ 0.000000] ? show_regs+0x87/0xa0 [ 0.000000] ? early_fixup_exception+0x130/0x310 [ 0.000000] ? do_early_exception+0x23/0x90 [ 0.000000] ? early_idt_handler_common+0x2f/0x40 [ 0.000000] ? setup_arch+0x500/0x2250 [ 0.000000] ? __pfx_setup_arch+0x10/0x10 [ 0.000000] ? vprintk_default+0x20/0x30 [ 0.000000] ? vprintk+0x4c/0x80 [ 0.000000] ? _printk+0xba/0xf0 [ 0.000000] ? __pfx__printk+0x10/0x10 [ 0.000000] ? init_cgroup_root+0x10f/0x2f0 --Type for more, q to quit, c to continue without paging-- [ 0.000000] ? cgroup_init_early+0x1e4/0x440 [ 0.000000] ? start_kernel+0xae/0x790 [ 0.000000] ? x86_64_start_reservations+0x28/0x50 [ 0.000000] ? x86_64_start_kernel+0x10e/0x130 [ 0.000000] ? secondary_startup_64_no_verify+0x178/0x17b [ 0.000000] -- Hyeonggon