From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.4 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 006BAC433E1 for ; Fri, 5 Jun 2020 09:37:22 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id ABEE9206A2 for ; Fri, 5 Jun 2020 09:37:21 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=oracle.com header.i=@oracle.com header.b="mVEBu5qr" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org ABEE9206A2 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=oracle.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 5818280009; Fri, 5 Jun 2020 05:37:21 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 5570C8E0006; Fri, 5 Jun 2020 05:37:21 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 46CC580009; Fri, 5 Jun 2020 05:37:21 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0171.hostedemail.com [216.40.44.171]) by kanga.kvack.org (Postfix) with ESMTP id 2CFDB8E0006 for ; Fri, 5 Jun 2020 05:37:21 -0400 (EDT) Received: from smtpin25.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with ESMTP id DB124181AC9C6 for ; Fri, 5 Jun 2020 09:37:20 +0000 (UTC) X-FDA: 76894655040.25.time63_130bccd26d9e Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin25.hostedemail.com (Postfix) with ESMTP id B2FE81804E3A1 for ; Fri, 5 Jun 2020 09:37:20 +0000 (UTC) X-HE-Tag: time63_130bccd26d9e X-Filterd-Recvd-Size: 8918 Received: from userp2120.oracle.com (userp2120.oracle.com [156.151.31.85]) by imf30.hostedemail.com (Postfix) with ESMTP for ; Fri, 5 Jun 2020 09:37:20 +0000 (UTC) Received: from pps.filterd (userp2120.oracle.com [127.0.0.1]) by userp2120.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 0559WPe4020478; Fri, 5 Jun 2020 09:36:40 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : to : cc : references : from : message-id : date : mime-version : in-reply-to : content-type : content-transfer-encoding; s=corp-2020-01-29; bh=B2li6JE+2+Vyucl3OG9dx1eiyf5W8A5lM7qPWKwY84M=; b=mVEBu5qrk339LfMFIPTc6sRrEKxc6Si/vtYTBTfE+2AqtJcyqdE3ZaVfqdA0SfoPStkl A/EeGVAEoY12R/D+HfFmx0Zng/fE8Lc4N9k5aBFT06xqGXzMLMcvb2ciTvbyqNp9VMBO EIOPiQrEI8eP+MneM5kvN2Z6Lx5t/rqOLLm6YU5GPUAAMQ8dtm3m+FeBXjA6mOxswvEp G3+h9FGDeDrBlltoXVsF2xqJtVIi3VgiH5D+p5Kq1C9a0DMBlJ2iQ/Nv9djn3o7wtK1w NQLHNHi74RvSsQoWWDUdVPQviYtpp5esHp71n/TNY0BQ6PMrYliRPouXgqzKXOL/xISp qQ== Received: from aserp3030.oracle.com (aserp3030.oracle.com [141.146.126.71]) by userp2120.oracle.com with ESMTP id 31f92621ew-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=FAIL); Fri, 05 Jun 2020 09:36:39 +0000 Received: from pps.filterd (aserp3030.oracle.com [127.0.0.1]) by aserp3030.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 0559Xp6D025708; Fri, 5 Jun 2020 09:36:39 GMT Received: from aserv0121.oracle.com (aserv0121.oracle.com [141.146.126.235]) by aserp3030.oracle.com with ESMTP id 31f92571ne-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 05 Jun 2020 09:36:39 +0000 Received: from abhmp0017.oracle.com (abhmp0017.oracle.com [141.146.116.23]) by aserv0121.oracle.com (8.14.4/8.13.8) with ESMTP id 0559abin019098; Fri, 5 Jun 2020 09:36:37 GMT Received: from [10.175.51.78] (/10.175.51.78) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Fri, 05 Jun 2020 02:36:36 -0700 Subject: Re: slub freelist issue / BUG: unable to handle page fault for address: 000000003ffe0018 To: Vlastimil Babka , Kees Cook Cc: Christoph Lameter , Andrew Morton , Marco Elver , Waiman Long , LKML , Linux MM , linux-acpi@vger.kernel.org, Robert Moore , Erik Kaneda , "Rafael J. Wysocki" , Len Brown , Steven Rostedt References: <4dc93ff8-f86e-f4c9-ebeb-6d3153a78d03@oracle.com> <7839183d-1c0b-da02-73a2-bf5e1e8b02b9@suse.cz> <94296941-1073-913c-2adb-bf2e41be9f0f@oracle.com> <202006041054.874AA564@keescook> <34455dce-6675-1fc2-8d61-45bf56f3f554@suse.cz> From: Vegard Nossum Message-ID: <6b2b149e-c2bc-f87a-ea2c-3046c5e39bf9@oracle.com> Date: Fri, 5 Jun 2020 11:36:31 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: <34455dce-6675-1fc2-8d61-45bf56f3f554@suse.cz> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9642 signatures=668680 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 mlxlogscore=999 malwarescore=0 bulkscore=0 mlxscore=0 spamscore=0 suspectscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2006050074 X-Proofpoint-Virus-Version: vendor=nai engine=6000 definitions=9642 signatures=668680 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 adultscore=0 suspectscore=0 cotscore=-2147483648 bulkscore=0 clxscore=1011 impostorscore=0 priorityscore=1501 malwarescore=0 mlxlogscore=999 spamscore=0 lowpriorityscore=0 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2006050074 X-Rspamd-Queue-Id: B2FE81804E3A1 X-Spamd-Result: default: False [0.00 / 100.00] X-Rspamd-Server: rspam03 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 2020-06-05 11:11, Vlastimil Babka wrote: > On 6/4/20 8:46 PM, Vlastimil Babka wrote: >> On 6/4/20 7:57 PM, Kees Cook wrote: >>> On Thu, Jun 04, 2020 at 07:20:18PM +0200, Vegard Nossum wrote: >>>> On 2020-06-04 19:18, Vlastimil Babka wrote: >>>>> On 6/4/20 7:14 PM, Vegard Nossum wrote: >>>>>> >>>>>> Hi all, >>>>>> >>>>>> I ran into a boot problem with latest linus/master >>>>>> (6929f71e46bdddbf1c4d67c2728648176c67c555) that manifests like this: >>>>> >>>>> Hi, what's the .config you use? >>>> >>>> Pretty much x86_64 defconfig minus a few options (PCI, USB, ...) >>> >>> Oh yes indeed. I immediately crash in the same way with this config. I'll >>> start digging... >>> >>> (defconfig finishes boot) >> >> This is funny, booting with slub_debug=F results in: >> I'm not sure if it's ACPI or ftrace wrong here, but looks like the changed >> free pointer offset merely exposes a bug in something else. > > So, with Kees' patch reverted, booting with slub_debug=F (or even more > specific slub_debug=F,ftrace_event_field) also hits this bug below. I > wanted to bisect it, but v5.7 was also bad, and also v5.6. Didn't try > further in history. So it's not new at all, and likely very specific to > your config+QEMU? (and related to the ACPI error messages that precede it?). I see it too, but not on v5.0. I can bisect it. Also, panic_on_warn is apparently a core parameter, it should probably be __setup()... Vegard > >> This would mean acpi_os_release_object() calling kmem_cache_free(ftrace_event_field, x) >> where x is actually from kmalloc-64? Both parts of that sounds wrong. >> >> Thread starts here: https://lore.kernel.org/linux-mm/4dc93ff8-f86e-f4c9-ebeb-6d3153a78d03@oracle.com/ >> >> [ 0.144386] ACPI: Added _OSI(Module Device) >> [ 0.144496] ACPI: Added _OSI(Processor Device) >> [ 0.144956] ACPI: Added _OSI(3.0 _SCP Extensions) >> [ 0.145432] ACPI: Added _OSI(Processor Aggregator Device) >> [ 0.145501] ACPI: Added _OSI(Linux-Dell-Video) >> [ 0.145951] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) >> [ 0.146522] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) >> [ 0.147070] ACPI Error: AE_BAD_PARAMETER, During Region initialization (20200430/tbxfload-52) >> [ 0.147494] ACPI: Unable to load the System Description Tables >> [ 0.148104] ACPI Error: Could not remove SCI handler (20200430/evmisc-251) >> [ 0.148507] ------------[ cut here ]------------ >> [ 0.148985] cache_from_obj: Wrong slab cache. ftrace_event_field but object is from kmalloc-64 >> [ 0.149502] WARNING: CPU: 0 PID: 1 at mm/slab.h:523 kmem_cache_free+0x248/0x260 >> [ 0.150254] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.7.0+ #43 >> [ 0.150490] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.13.0-0-gf21b5a4-rebuilt.opensuse.org 04/01/2014 >> [ 0.150490] RIP: 0010:kmem_cache_free+0x248/0x260 >> [ 0.150490] Code: ff 0f 0b e9 9d fe ff ff 49 8b 4d 58 48 8b 55 58 48 c7 c6 10 47 c1 a4 48 c7 c7 f0 c1 d0 a4 c6 05 9f 05 b1 00 01 e8 bc cc eb ff <0f> 0b 48 8b 15 5f 36 9b 00 4c 89 ed e9 d6 fd ff ff 0f 1f 80 00 00 >> [ 0.150490] RSP: 0018:ffffb4dac0013dc0 EFLAGS: 00010282 >> [ 0.150490] RAX: 0000000000000000 RBX: ffffa38a07409e00 RCX: 0000000000000000 >> [ 0.150490] RDX: 0000000000000001 RSI: 0000000000000092 RDI: ffffffffa51dd32c >> [ 0.150490] RBP: ffffa38a07403900 R08: ffffb4dac0013c7d R09: 00000000000000eb >> [ 0.150490] R10: ffffb4dac0013c78 R11: ffffb4dac0013c7d R12: ffffa38a87409e00 >> [ 0.150490] R13: ffffa38a07401d00 R14: 0000000000000000 R15: 0000000000000000 >> [ 0.150490] FS: 0000000000000000(0000) GS:ffffa38a07a00000(0000) knlGS:0000000000000000 >> [ 0.150490] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 >> [ 0.150490] CR2: 0000000000000000 CR3: 000000000560a000 CR4: 00000000003406f0 >> [ 0.150490] Call Trace: >> [ 0.150490] acpi_os_release_object+0x5/0x10 >> [ 0.150490] acpi_ns_delete_children+0x46/0x59 >> [ 0.150490] acpi_ns_delete_namespace_subtree+0x5c/0x79 >> [ 0.150490] ? acpi_sleep_proc_init+0x1f/0x1f >> [ 0.150490] acpi_ns_terminate+0xc/0x31 >> [ 0.150490] acpi_ut_subsystem_shutdown+0x45/0xa3 >> [ 0.150490] ? acpi_sleep_proc_init+0x1f/0x1f >> [ 0.150490] acpi_terminate+0x5/0xf >> [ 0.150490] acpi_init+0x27b/0x308 >> [ 0.150490] ? video_setup+0x79/0x79 >> [ 0.150490] do_one_initcall+0x7b/0x160 >> [ 0.150490] kernel_init_freeable+0x190/0x1f2 >> [ 0.150490] ? rest_init+0x9a/0x9a >> [ 0.150490] kernel_init+0x5/0xf6 >> [ 0.150490] ret_from_fork+0x22/0x30 >> [ 0.150490] ---[ end trace 967e9fbc065d7911 ]--- >> >> >> >