From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1EE48C282CD for ; Mon, 3 Mar 2025 11:06:26 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 931FE6B0092; Mon, 3 Mar 2025 06:06:25 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 8E2436B0093; Mon, 3 Mar 2025 06:06:25 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7A9966B0095; Mon, 3 Mar 2025 06:06:25 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 5E2696B0092 for ; Mon, 3 Mar 2025 06:06:25 -0500 (EST) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id CFE97A38B8 for ; Mon, 3 Mar 2025 11:06:24 +0000 (UTC) X-FDA: 83179961088.19.22DB219 Received: from mail-wr1-f52.google.com (mail-wr1-f52.google.com [209.85.221.52]) by imf23.hostedemail.com (Postfix) with ESMTP id 01CC9140008 for ; Mon, 3 Mar 2025 11:06:20 +0000 (UTC) Authentication-Results: imf23.hostedemail.com; dkim=pass header.d=suse.com header.s=google header.b=Zr5AEhVg; dmarc=pass (policy=quarantine) header.from=suse.com; spf=pass (imf23.hostedemail.com: domain of hare@suse.com designates 209.85.221.52 as permitted sender) smtp.mailfrom=hare@suse.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1740999981; a=rsa-sha256; cv=none; b=DLtwdfL5cg1RQXd3CEbFb1mPVHg12vZXmmMM6Y/oWsiQMTQ/dMsduZoVlTN1Mk7fQQyQEi A+zMX7+jVlundXpbBpg0+axhJt53zMI7EeCR9KTMH60b9oA68j75ccZvGJDPGP6bMHxjPg ZjWjdKb8eug2kZNxikbdR5vafKIhFD4= ARC-Authentication-Results: i=1; imf23.hostedemail.com; dkim=pass header.d=suse.com header.s=google header.b=Zr5AEhVg; dmarc=pass (policy=quarantine) header.from=suse.com; spf=pass (imf23.hostedemail.com: domain of hare@suse.com designates 209.85.221.52 as permitted sender) smtp.mailfrom=hare@suse.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1740999981; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=kQ8cBKg5ej+Kp/w3MQ6nf2UTZ/6C1yGKdohploMEAJI=; b=IfMoW5kuC3DbpFYcZp34DDRhozH0OCdmxl3Z0gVouX1ZJkD3sFb+dMnkt7a1X5EunRBsxI ybVDeF4BZEbezpOTxQwWLdK0ib2WWeElL8lt1Rr6RaR+l1KETzWx73TopqVjyMoJHbdNMX jYeN7Of0VEOWwKH63wfDeD3j+OPI8tk= Received: by mail-wr1-f52.google.com with SMTP id ffacd0b85a97d-390dc0a7605so2309653f8f.1 for ; Mon, 03 Mar 2025 03:06:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=google; t=1740999979; x=1741604779; darn=kvack.org; h=content-transfer-encoding:in-reply-to:content-language:references :cc:to:from:subject:user-agent:mime-version:date:message-id:from:to :cc:subject:date:message-id:reply-to; bh=kQ8cBKg5ej+Kp/w3MQ6nf2UTZ/6C1yGKdohploMEAJI=; b=Zr5AEhVgXh+PjTZ1vSg9CrNvqAkE4B9QGmo0D3VifSEsWe3muikgVPw1ma1QvdYYBB mBGtNxjYxaNRa4tqazwcW0pC6yL72n+ueNaVF8fy8kt7fdOTHZNHt3e3b4OWybAUaiMj a3wiOBKpS8K9tb5f7UDS3fJLBtCH5DPQ+jcw+VbaDx6kkq3rbu91JjmyMwZhNt1pd21I 4QL6CUZgtYCSj5YX7bGRv1c/kmSp01AkDGUqOMSdU9dpyRBBI61BILPkk3ItXa0xN/UH 9liYFAan0qlgmM0FOuDWTZgrthUUutgQB709ijl1O3DzHVDYw7s5KQWKR3WTm78xUW8v VQxw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1740999979; x=1741604779; h=content-transfer-encoding:in-reply-to:content-language:references :cc:to:from:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=kQ8cBKg5ej+Kp/w3MQ6nf2UTZ/6C1yGKdohploMEAJI=; b=fVN0we4q5SPGQejDXj1ZJYlFshFYqHzbCcQXofxeILywL2Sdp8Fuf7oF+8As5K2rnA cop3VbjP7MacCbyUCKnvqp3ruQbfohn68XVw+ofUwx0Tuc/sg0JvB52N1nqHOa0sY502 lDERzbtYWvxkN9naw9/mlyW2Fzuz4zTasJXHtVzGnLrPEo5REQB8iEbls9JTPbq455r8 xJMHWyY7YZbJbOvXPNsW/FC5uFqFlsj1CWLqmDvsBOoS67wRfq4Bd6ftKAZqVQQO/sFU oNRz/+cptiRw5z+NQwnqJ+KrYhGmtl35JFi0NH2bKDc0NDHu40KqQvywhroV+490ZK8G fS8w== X-Forwarded-Encrypted: i=1; AJvYcCWUqXOydQULoN8v2rcuuOGUQBsEsYgFUUdQH9uQ/7cRVp/brirbWGev3oC888dkv62tn4akolARSg==@kvack.org X-Gm-Message-State: AOJu0Yyih8O7hQ823Tzi5kN98pOWAnWlF3XzrH9QI8NpuOdu3eZHEZgE JWuYhENBBWTJO/V0Ym7enIbiBdX61Eq/kWwfXnc1CV34D3Zi3xmQ2UE1y5UurLQ= X-Gm-Gg: ASbGncvv0N/J0fnTJwsZlRyVUVhau9GfU48ZDzo3VaIaCZEiyFZuOxeVTLcV8yr9neA r0gvtJAPGG4MRIdQPW2oeH70tQDU4/AQRB+noEN8tWorwNSDOKSGz+0NKY7NmSwUUIY7JzcLSxY 6qqjQGrPb00AiIc5S2ktG3eNrlySgnFGTPPhqla9x93RJS/a6oclhz09PZZhTFqvlcX/ROTerAz CKsIbnqMe+B51isWILJFpQuw3HxUJIxWXuIxXAxP7/lJN32+YVNeIliQgl1BK0c9sdoD2mgljWV JV8XcXd+I4BmeH+p0vK9C67NaJ/T95tdIghSxV6pLc3sMZTlIk6yG3eDKzvamok9G4J0EQ== X-Google-Smtp-Source: AGHT+IFXsUYLxm8Df30+KsC35vTZ6zstjg62rje6R1G9L3oOQ25nE/E4W1Oe3hkZUEWPeieF2m9H4Q== X-Received: by 2002:a05:6000:4029:b0:38f:2726:bc0e with SMTP id ffacd0b85a97d-390eca138d2mr11479696f8f.44.1740999979152; Mon, 03 Mar 2025 03:06:19 -0800 (PST) Received: from ?IPV6:2a07:de40:a101:3:ce70:3e6f:3b9c:9125? (megane.afterburst.com. [2a01:4a0:11::2]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-390e47a6d0asm13933050f8f.27.2025.03.03.03.06.18 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 03 Mar 2025 03:06:18 -0800 (PST) Message-ID: <913d3824-04c7-4cb1-a87b-01f9241a37aa@suse.com> Date: Mon, 3 Mar 2025 12:06:18 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Kernel oops with 6.14 when enabling TLS From: Hannes Reinecke To: Sagi Grimberg , Matthew Wilcox Cc: "linux-nvme@lists.infradead.org" , "linux-block@vger.kernel.org" , linux-mm@kvack.org References: <08c29e4b-2f71-4b6d-8046-27e407214d8c@suse.com> <509dd4d3-85e9-40b2-a967-8c937909a1bf@suse.com> Content-Language: en-US In-Reply-To: <509dd4d3-85e9-40b2-a967-8c937909a1bf@suse.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspam-User: X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: 01CC9140008 X-Stat-Signature: dfbueu5qjyuieowg6tsxrrz8a3gpge4o X-HE-Tag: 1740999980-352025 X-HE-Meta: U2FsdGVkX1/wKqmCH6KO4RPwlWvqXU8+kR47/iVDlKt12agyopKHnyXEmCvi9NMIS92xJqG8IBBNs/zDT3KJ+8Mu3orPOGGqO68cpLmoggNt7kc6uzAN7ZFr8W15inAg8TZI8ojZARA6vrGPqpR7rlNGr67tOaUHs50KAHM9snKO6GgTTtaztN7BE8e5SkQ3dmSR/d0DDjCseuwkT+HzWN2pvSDtkdVX7vCoyZEQQps50Lj7eUV6981oW09UWJrk0wQA8bfiV+lj+pbTrbpvqOuL8bphJ+DYq9hoN6/reDyajWfpvbCVkS0itCcCORVsIG8ZCUGuPjtqXHLgjQOQmXzUVvtotApCocCFu7EKD9yZhnVGxvfAruMOEwzTXA7aW+4ym1K2m9Nh6Mkx31PyYWciCeyoXOBpR407L3AX9zhWfCcBNR7gMaWUDIc1bYiRzwLWbiGN3MRN62fu3U1ePkb9ndqyaFumM1F7FP9YOE20SiufX1MowAzlGlRL1EJfAAtNqfJEUTaShHh0vL7BmfObjJuOCKyBTqFO9cavKvzajN1ukzQHg85lvTP5/ifoeTHQu+G1BuwJzXIrzQ48F/8Em+cqJ52BeW+8QBBJMQiUSAQBUyHB5p+PH+dmctKnRqve07Ilwab1TPt6P3yh2UipwWHO5XmVYNhKLUY/xhL9wyQJZM7LfjKDCz+wJlN6p2F+5ZHYNhLv7TlJHuglB1+Y1F39hEr9lcheW31r3z7XD4+bwvtcyzrmyjTBTA2BeKzCdSI+T/GDEfre2XRoTHEhBAeK3KJEQahAKU/5BUCOM6vxbn1tj+bLTcM9nc/XEpASfchUkerMVK5mWwx2Jx5UE4VPlyqpmAFGGF1ll8LW4GrFdjAykSLF34kr3nVb7j3I7/bYVlp8JFD+8snEGksvniY+uUmXy771HWEMCS1oTNeVInWEUQ6vz46kJ5nV53K0mH+mdIwN1r/32hE zzmdcQtb zJSoP6Nh0pFQcHQyYrdLmDF7jQdRT261ArqSl04EiqWMPszjwIjMyA1tUHrrjUDT4cshTjB9HtRVVUI0s02qbcWuHgXoBmEBbh94znw1f/kBE9PHv/AqJwX18IUT8Ek4Mhtb5w8YEm7eymrF5iN4A6yOe3vt34fCcehAAjxeYbchAvvidjTVYn6r3kOO3NkB/k4DZTs8CR+/IWmB4jmcS0H7QRkUyspX2E3dvyEmsvLLaR8LDcVnNc4eyLdS9XXLfo8H5p99X5YdFMj0oAZ7TFf7PnlxId5N3Vp7pgE2XIwjoTNQ8xNGzX7A926X0k5c/bDmK8oC1d5O6GHMmSIIc8Q/eGSrnUluBNFDK6e1T5luwW+0F0URK0SW9CF+sPuyXPjety3rfeZaBC1Mdm2NqYjxp5X3juA1LPCD4320yD1rF164= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 3/3/25 08:48, Hannes Reinecke wrote: > On 2/28/25 11:47, Hannes Reinecke wrote: >> Hi Sagi, >> >> enabling TLS on latest linus tree reliably crashes my system: >> >> [  487.018058] ------------[ cut here ]------------ >> [  487.024046] WARNING: CPU: 9 PID: 6159 at mm/slub.c:4719 >> free_large_kmalloc+0x15/0xa0 [ .. ] >> >> Haven't found a culprit for that one for now, started bisecting. >> Just wanted to report that as a heads-up, maybe you have some idea. >> > > bisect is pointing to > 9aec2fb0fd5e ("slab: allocate frozen pages") > and, indeed, reverting this patch on top of linus current resolves > the issue. > > Sorry Matthew. > It's getting even worse; after reverting above patch I'm getting a crash here: [ 968.315152] Oops: general protection fault, probably for non-canonical address 0xdead000000000120: 0000 [#1] PREE MPT SMP NOPTI [ 968.328747] CPU: 30 UID: 0 PID: 665 Comm: kcompactd5 Kdump: loaded Tainted: G W E 6.14.0-rc4-defaul t+ #306 9ca11b70f9498982db3664c8471cfe00b0a16485 [ 968.345747] Tainted: [W]=WARN, [E]=UNSIGNED_MODULE [ 968.351913] Hardware name: Lenovo ThinkSystem SR655V3/SB27B09914, BIOS KAE111E-2.10 04/11/2023 [ 968.362371] RIP: 0010:isolate_movable_page+0x7c/0x130 [ 968.368826] Code: 02 75 3c f0 48 0f ba 2b 00 72 34 48 89 df e8 8b e0 f6 ff 84 c0 74 20 48 8b 03 a9 00 00 01 00 75 16 48 8b 43 18 89 ee 48 89 df <48> 8b 40 fe ff d0 0f 1f 00 84 c0 75 61 48 89 df e8 ff d8 f2 ff f0 [ 968.390698] RSP: 0018:ff582840034c7bd0 EFLAGS: 00010246 [ 968.397354] RAX: dead000000000122 RBX: ffc1af3dcf400000 RCX: ffc1af3dcf400034 [ 968.406145] RDX: dead000000000101 RSI: 000000000000000c RDI: ffc1af3dcf400000 [ 968.414950] RBP: 000000000000000c R08: 0000000000000000 R09: 000000000f400000 [ 968.423755] R10: 0000000000000400 R11: ff4187a00d995780 R12: 00000000003d0000 [ 968.432562] R13: ff582840034c7d30 R14: 0000000000000001 R15: 0000000000000001 [ 968.441365] FS: 0000000000000000(0000) GS:ff41879ffaa00000(0000) knlGS:0000000000000000 [ 968.451245] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 968.458488] CR2: 000055b303833c20 CR3: 000000005a838002 CR4: 0000000000771ef0 [ 968.467295] PKRU: 55555554 [ 968.471120] Call Trace: [ 968.474655] [ 968.477804] ? __die_body+0x1a/0x60 [ 968.482521] ? die_addr+0x38/0x60 [ 968.487030] ? exc_general_protection+0x19e/0x430 [ 968.493115] ? asm_exc_general_protection+0x22/0x30 [ 968.499395] ? isolate_movable_page+0x7c/0x130 [ 968.505180] isolate_migratepages_block+0x39a/0x1090 [ 968.511555] ? srso_alias_return_thunk+0x5/0xfbef5 [ 968.517728] ? update_curr+0x19e/0x220 [ 968.522725] compact_zone+0x368/0x1090 [ 968.527722] ? srso_alias_return_thunk+0x5/0xfbef5 [ 968.533896] compact_node+0xa8/0x120 [ 968.538720] kcompactd+0x21e/0x2b0 which again points straight into the 'allocate and free frozen pages' patchset. Something's buggered there, and I'm not sure if further bisecting will be getting us anywhere. Matt? Cheers, Hannes -- Dr. Hannes Reinecke Kernel Storage Architect hare@suse.com +49 911 74053 688 SUSE Software Solutions GmbH, Frankenstr. 146, 90461 Nürnberg HRB 36809 (AG Nürnberg), GF: I. Totev, A. McDonald, W. Knoblich