From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id E4D13C282C5 for ; Mon, 3 Mar 2025 12:57:45 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 5FB90280002; Mon, 3 Mar 2025 07:57:45 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 5ABCD280001; Mon, 3 Mar 2025 07:57:45 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 44C8A280002; Mon, 3 Mar 2025 07:57:45 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 2803E280001 for ; Mon, 3 Mar 2025 07:57:45 -0500 (EST) Received: from smtpin09.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id CEEED1A091B for ; Mon, 3 Mar 2025 12:57:44 +0000 (UTC) X-FDA: 83180241648.09.4AD58F9 Received: from mail-wm1-f41.google.com (mail-wm1-f41.google.com [209.85.128.41]) by imf26.hostedemail.com (Postfix) with ESMTP id BE435140018 for ; Mon, 3 Mar 2025 12:57:42 +0000 (UTC) Authentication-Results: imf26.hostedemail.com; dkim=pass header.d=suse.com header.s=google header.b=c6LbRmdI; spf=pass (imf26.hostedemail.com: domain of hare@suse.com designates 209.85.128.41 as permitted sender) smtp.mailfrom=hare@suse.com; dmarc=pass (policy=quarantine) header.from=suse.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1741006662; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=7c5IluLwUn9XZcbi+gsxrgVSyKCV8Nuiw5SKDgtgpy8=; b=ACb+xGYxT1MIsDXUMB9GvW46Pr3SG0kjd6LSK80z4bmzrHckl9ABMK+8i17P5GYBiD6BEl Xkjj6TgRSht7sGocjwfb7dpSXrpNUGRX9jYMoYZ+O1Xk5yKHZgsdNKNTnqKw/xedS7CtJu 4D5lNhGd0Trc3+Q/DTwFj8Cv7j5/Mro= ARC-Authentication-Results: i=1; imf26.hostedemail.com; dkim=pass header.d=suse.com header.s=google header.b=c6LbRmdI; spf=pass (imf26.hostedemail.com: domain of hare@suse.com designates 209.85.128.41 as permitted sender) smtp.mailfrom=hare@suse.com; dmarc=pass (policy=quarantine) header.from=suse.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1741006662; a=rsa-sha256; cv=none; b=x9DpergQ0cMkuSJr87Ue9X+cuQTcJAv1XnjBe/Kz5E1CbU4DdF/lM61B3cPH0X7oOY/cIV 5SrnBk6IoA2bsPbQ5dtFZUri2Zni/M9Wp3WsVogbJm59YOxtE8dUI1W3ZJ0N4ZDT1huoG3 WSfI6xG+9KF7PBXn7Wia9rHf0kyHNXo= Received: by mail-wm1-f41.google.com with SMTP id 5b1f17b1804b1-43bc30adad5so5078955e9.1 for ; Mon, 03 Mar 2025 04:57:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=google; t=1741006661; x=1741611461; darn=kvack.org; h=content-transfer-encoding:in-reply-to:content-language:references :cc:to:from:subject:user-agent:mime-version:date:message-id:from:to :cc:subject:date:message-id:reply-to; bh=7c5IluLwUn9XZcbi+gsxrgVSyKCV8Nuiw5SKDgtgpy8=; b=c6LbRmdIKb+tFLAIiACqLm5U80Mo5aMCiSQZgrn71PmKnm7qZ+kVLYXAvPlPklgJwP NWEvNVa5VoxDEiDX6rqYkxYqg1f5OY4Q2JTbh/BGL7oOKt30jhV04Wbrt29fK+X3xXMg saPDCjfhpD0UShfXy637RSmCNAdjqoh2L8f7xse4OFt3+hDTUoFP4paodfvKwU8OctUi Um5N753gXAC1JXQHS0Kgq3Z7FVjy0l8T3EeroBiNQvQV/77yJmi2/C+8/ihttzda8ygQ Bmqbxa+wRksKzl2/cO1HlfsXbqlfhSWX7mvh6otP9bTJNgYLpv3i4xXfUue7vUe2huaC f6+Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741006661; x=1741611461; h=content-transfer-encoding:in-reply-to:content-language:references :cc:to:from:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=7c5IluLwUn9XZcbi+gsxrgVSyKCV8Nuiw5SKDgtgpy8=; b=JvzwWpzgiK6NshKTOI4ZduLwuMJsY+I5dKdHhziYvfmVde8SZhH4b921dsp9ffG/Yk m3wktLcSrLmPPF4Eb+Bsx5hl36CN1JS/BbwbYt/vcp6IbO02OTI9N1LbqkvVOXfXRJqc 8UPMzs0bory+uqRaKayGAQNEPzr2fOoHyzAl46mZeL8PmIXSH+5vuJ94AS2Za/o52PFL JXmx85zMrxS4QcMkU1/Kc/2F/unWl+TO3817m8T8wzGvjW2jDrBzNLnLrwl39otKZfXp NRO3nbK5Fa81oZy642VfWrXvIm3LytZAimLYdUHRQqtp0BW+6PfdeGTX2hFGkws7jiaj Yyaw== X-Forwarded-Encrypted: i=1; AJvYcCV1ob5StvkoTI0kwGGGdvEEXJxDEfYGLEgNQfgBqQzaASTuWlkfkkP1M7TRXdTwFmwHU560pUWh/w==@kvack.org X-Gm-Message-State: AOJu0YxZvVMRp4nvo/C+v2rqMzDg45AfvU7cLYsYdD0yy+Y09NXVs/xl WwzUlcatQM//t+wB6rI88p8LNw+aVZ3OmtnNZuZw27r7KMvvU1Mf9fLk8agW2wc= X-Gm-Gg: ASbGncuzsCt9QBP4rYlVaZoGcLFzbQOFXIt6El8Q5DkjcEsDZxQgxCJdWlm6ZnPtLMV d2K2+Mfqbw64nFrAJESidnRSc24SVf7yAIoF7evQDnEUPM9a0LBLed7FCs0EQcxGey7BUpzVEZ5 rfB9kYwaMidWmM1hbnQFw1qgsh3w+1cU8Jd6364lUWKnzpwLd5UvlYpnGcq9CIcC/LUR9j3UXwj BBmKrks+2WWPoILr0mlT+vQG1F3S19NydNW9LcDEOPkX2av/8dk3HRYt1mCRjbpNDYMcwxW6cE0 TieiEQQsLo9MeYPRwgTvM+Nhkca053V2KdT8qZ3v+Sx1KEwxoMcnsOtzjbIXikd5chK/sQ== X-Google-Smtp-Source: AGHT+IEU2Ynd1Axdm2Onf66zwpc3lqfrstpt22YuyOVgX5RS7ch0fh8GiVhPPpclTmGl0abT8uNphw== X-Received: by 2002:a05:600c:4f0d:b0:439:9828:c450 with SMTP id 5b1f17b1804b1-43ba67082e6mr118647225e9.15.1741006661184; Mon, 03 Mar 2025 04:57:41 -0800 (PST) Received: from ?IPV6:2a07:de40:a101:3:ce70:3e6f:3b9c:9125? (megane.afterburst.com. [2a01:4a0:11::2]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-390e4844abbsm14296736f8f.70.2025.03.03.04.57.40 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 03 Mar 2025 04:57:40 -0800 (PST) Message-ID: <542192ca-6fea-4a3b-867f-b14d14a39478@suse.com> Date: Mon, 3 Mar 2025 13:57:40 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Kernel oops with 6.14 when enabling TLS From: Hannes Reinecke To: Sagi Grimberg , Matthew Wilcox Cc: "linux-nvme@lists.infradead.org" , "linux-block@vger.kernel.org" , linux-mm@kvack.org References: <08c29e4b-2f71-4b6d-8046-27e407214d8c@suse.com> <509dd4d3-85e9-40b2-a967-8c937909a1bf@suse.com> <913d3824-04c7-4cb1-a87b-01f9241a37aa@suse.com> Content-Language: en-US In-Reply-To: <913d3824-04c7-4cb1-a87b-01f9241a37aa@suse.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspam-User: X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: BE435140018 X-Stat-Signature: 4xpc69neam5z5z3xcqiq1mn4popnu3k5 X-HE-Tag: 1741006662-735490 X-HE-Meta: U2FsdGVkX18FV7NqtjN/hIfnfANkG3x4anrWFS6Z61dkX8T/j6TdPK+4tWb+8na8CMOfu6YsVJhY0owM6pnItruifMKm4wwcszP5lnslNF0O2qB2qgySm3qOZJ3NJLVCHARvuf7KKbwWKSWtseEcb6TMQPHHHvuDeYWfiB8gjbkTso5dTot2+mLYJ2zJHEH6sDv0eOgUifnHlTHqPUdTm7IqjoNvtH3yGZ+GWQvYUltPBr4vdE/ss+qr2oG1szlaPNzcTBPO4VqjRjWX7JJaFCxR8xmlcBw0KXzuUwunDXod3egvkN1C6DNBTGWFdG/7sGr9mgFbrlFslUO9Je+GJ8KvsJ8BOTG7yh+J9DCb7i1aWKKsfyT033UJeB6T2FOk0aoRzLdKekyBRUdphusLtSIsrk9ey8ZlPoGMkrfzRkyv8WapH9KLG+yhFc5aW9g/lfnCkK9OjqU1e5061uizP5Kk79YkgSCQvKeR5q0ANABbCaQ9UPjrfJxokfx2W2hq+h6hWbekSRz5kIYPAAXDBjdQlG3+IhLCBJicmJC25gPsdC5E7KsMDArDZcMSDepKEMssp44ovLw4wd3x3NK8/8DWJDm0QmSLfmq5W3V8FXoOwLHinsAnsMGy5DGMbC/Z6+pJW6pKR2naYybmxyNVnJydyuYgxd/NxOGOS78DzpaQZCKe2WGzGCnLEhTTcdzpfLGPn3BU9qIL6/iZrPIXIinsT1Qr8oaxPz128mvQmPjGkrvnr8gLjbr/R0lkcfKg/G2M+POH2CI3Ud7qMYmuwUKDBz6d56hJ5wo0fc7zXIalVhnr8lgS+GZaLkraEkAErLaPk3+rg/68AjWh8dP8DYKOz+tfCYnKFKbszoHxABce7WCZry3yrs3/q+0bBp+knrFsOwgtuoTK1TkahH065WkVAoNni3Hgob1y78ttfhBR2yBXNL8+p0TrJ0FsZEIw0PPyxSDlmu1VvOnTeFy FjtO9JHa aMrnLN3m3XcI+TS6I02GLF4CPKiWGYyQIphftaQTjyhNyOy/9oF8u+YAsdCnompoqsxShThN6Xy+oDFZ12i6eoOD+fADl7hqAuqVC9m1n2pqNujsbM2RNXC07V0+UMAQ/gZu7l+d0n+3myuAXCpDIPzKTVTIoi+D1t/hR2YdyQjDgBhVk4IyHV5mIKE4SlQ3dUz9Bm61kgqEoOnaTgfiEIgfW/78HQdiu3Dsi7pvbpxnwEQUGLZe8FgWzBIEyqKQEqZznV2AtmCjqrf6lO7l/S+QVSV7k3MDv8jsUh0nYR2xSwKu+Sv+CdutNuKzEHtKo+Q+tpSbfSZaaqhpGxb4XC+8wc5PO6t8KjnzPefWtpIvGxFCdJuYpXCfPD+F8Wp7L2M5D4i4GO/NQgeNfopaucBYBFcZdiFufnt4wW44gIngx0MM= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 3/3/25 12:06, Hannes Reinecke wrote: > On 3/3/25 08:48, Hannes Reinecke wrote: >> On 2/28/25 11:47, Hannes Reinecke wrote: >>> Hi Sagi, >>> >>> enabling TLS on latest linus tree reliably crashes my system: >>> >>> [  487.018058] ------------[ cut here ]------------ >>> [  487.024046] WARNING: CPU: 9 PID: 6159 at mm/slub.c:4719 >>> free_large_kmalloc+0x15/0xa0 > [ .. ] >>> >>> Haven't found a culprit for that one for now, started bisecting. >>> Just wanted to report that as a heads-up, maybe you have some idea. >>> >> >> bisect is pointing to >> 9aec2fb0fd5e ("slab: allocate frozen pages") >> and, indeed, reverting this patch on top of linus current resolves >> the issue. >> >> Sorry Matthew. >> > It's getting even worse; after reverting above patch I'm getting a crash > here: > [  968.315152] Oops: general protection fault, probably for non- > canonical address 0xdead000000000120: 0000 [#1] PREE > MPT SMP NOPTI > [  968.328747] CPU: 30 UID: 0 PID: 665 Comm: kcompactd5 Kdump: loaded > Tainted: G        W   E      6.14.0-rc4-defaul > t+ #306 9ca11b70f9498982db3664c8471cfe00b0a16485 > [  968.345747] Tainted: [W]=WARN, [E]=UNSIGNED_MODULE > [  968.351913] Hardware name: Lenovo ThinkSystem SR655V3/SB27B09914, > BIOS KAE111E-2.10 04/11/2023 > [  968.362371] RIP: 0010:isolate_movable_page+0x7c/0x130 > [  968.368826] Code: 02 75 3c f0 48 0f ba 2b 00 72 34 48 89 df e8 8b e0 > f6 ff 84 c0 74 20 48 8b 03 a9 00 00 01 00 75 >  16 48 8b 43 18 89 ee 48 89 df <48> 8b 40 fe ff d0 0f 1f 00 84 c0 75 61 > 48 89 df e8 ff d8 f2 ff f0 > [  968.390698] RSP: 0018:ff582840034c7bd0 EFLAGS: 00010246 > [  968.397354] RAX: dead000000000122 RBX: ffc1af3dcf400000 RCX: > ffc1af3dcf400034 > [  968.406145] RDX: dead000000000101 RSI: 000000000000000c RDI: > ffc1af3dcf400000 > [  968.414950] RBP: 000000000000000c R08: 0000000000000000 R09: > 000000000f400000 > [  968.423755] R10: 0000000000000400 R11: ff4187a00d995780 R12: > 00000000003d0000 > [  968.432562] R13: ff582840034c7d30 R14: 0000000000000001 R15: > 0000000000000001 > [  968.441365] FS:  0000000000000000(0000) GS:ff41879ffaa00000(0000) > knlGS:0000000000000000 > [  968.451245] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033 > [  968.458488] CR2: 000055b303833c20 CR3: 000000005a838002 CR4: > 0000000000771ef0 > [  968.467295] PKRU: 55555554 > [  968.471120] Call Trace: > [  968.474655]  > [  968.477804]  ? __die_body+0x1a/0x60 > [  968.482521]  ? die_addr+0x38/0x60 > [  968.487030]  ? exc_general_protection+0x19e/0x430 > [  968.493115]  ? asm_exc_general_protection+0x22/0x30 > [  968.499395]  ? isolate_movable_page+0x7c/0x130 > [  968.505180]  isolate_migratepages_block+0x39a/0x1090 > [  968.511555]  ? srso_alias_return_thunk+0x5/0xfbef5 > [  968.517728]  ? update_curr+0x19e/0x220 > [  968.522725]  compact_zone+0x368/0x1090 > [  968.527722]  ? srso_alias_return_thunk+0x5/0xfbef5 > [  968.533896]  compact_node+0xa8/0x120 > [  968.538720]  kcompactd+0x21e/0x2b0 > > which again points straight into the 'allocate and free frozen pages' > patchset. Something's buggered there, and I'm not sure if further > bisecting will be getting us anywhere. > And now it's even happening without TLS enabled. So seems that reverting the patch is not sufficient. Some guidance would be good. Cheers, Hannes -- Dr. Hannes Reinecke Kernel Storage Architect hare@suse.com +49 911 74053 688 SUSE Software Solutions GmbH, Frankenstr. 146, 90461 Nürnberg HRB 36809 (AG Nürnberg), GF: I. Totev, A. McDonald, W. Knoblich