From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 27D5BC83F2D for ; Thu, 29 Aug 2024 15:51:07 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id B566F6B0096; Thu, 29 Aug 2024 11:51:06 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id B04D96B0098; Thu, 29 Aug 2024 11:51:06 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 9A5F46B0099; Thu, 29 Aug 2024 11:51:06 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 7A9EB6B0096 for ; Thu, 29 Aug 2024 11:51:06 -0400 (EDT) Received: from smtpin24.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 3A4BB140689 for ; Thu, 29 Aug 2024 15:51:06 +0000 (UTC) X-FDA: 82505721732.24.C2D0212 Received: from mail-lj1-f177.google.com (mail-lj1-f177.google.com [209.85.208.177]) by imf18.hostedemail.com (Postfix) with ESMTP id 3901A1C0012 for ; Thu, 29 Aug 2024 15:51:03 +0000 (UTC) Authentication-Results: imf18.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=AqBPEtAY; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf18.hostedemail.com: domain of piotr.oniszczuk@gmail.com designates 209.85.208.177 as permitted sender) smtp.mailfrom=piotr.oniszczuk@gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1724946598; a=rsa-sha256; cv=none; b=O4skxSr/bqycpMjJmnKt45ckQfiH7qmgMp8+gl82rrLmAfOyFed16SR1uSCFWaXXJsYaxG B1DhlZLFyNnolFTKlWEuFTUrmCnTsEZq547Jc3DLvIUmIcfkFnkNKdrBQxAUL2KY1Ol0Mu 7S9s9fauG5/ePKwhOvu37GqQatNvDHQ= ARC-Authentication-Results: i=1; imf18.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=AqBPEtAY; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf18.hostedemail.com: domain of piotr.oniszczuk@gmail.com designates 209.85.208.177 as permitted sender) smtp.mailfrom=piotr.oniszczuk@gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1724946598; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=zvAY9Ccukr+/HE07/0WO1dFQLdJcPTCRcUNXQG5PwWI=; b=Nq0Jkw8+UXbaM6Alu6Uc+vw4EmvLLCzFZInDkXW8I5nFc75VpJh7XaRSok9zeII1TeADL6 WlLEZyWJ6JjmhCghyroxjXfwGph2AKJWAzL/kbK5vofvf3eMTJ2poy7y0krnISnYfrKoTP 2y7curK/JToffA90Igdz1z09OP+SGPc= Received: by mail-lj1-f177.google.com with SMTP id 38308e7fff4ca-2f3f163e379so13415231fa.3 for ; Thu, 29 Aug 2024 08:51:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1724946662; x=1725551462; darn=kvack.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=zvAY9Ccukr+/HE07/0WO1dFQLdJcPTCRcUNXQG5PwWI=; b=AqBPEtAYXRhTDvIu8/mUchScSMpaiW2TJkiBl6eiAHRh0FspD8xZsSCOkDJm9hrsVK wktF712KuKpZ6y8spcyj4dy92YdZJaEuRjqTrwUT0OPn6hn5VHSdUQq2+dzNvFAknP4N f2URARanBe1z9NH1WKYumPV/8M0ZV9J9SMpo3Qdqceg3vu69S+TsKqo7ECRI0/3mLA+J 9lQPZvOFrES8nEWwGyY8pGpSXwAdwlTY5hrsn9y573gzt2ppBuEzj+2ETRkJ/1H3uoaI jUflNoDkAv905G2Yve2nkRghpmTG9VfFr57ZQwOoVuVdg+rIo6nPDNihmkJQybNa1LDl 8VNg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1724946662; x=1725551462; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=zvAY9Ccukr+/HE07/0WO1dFQLdJcPTCRcUNXQG5PwWI=; b=HhCqyFFwQEwlpdbzNa+4zsSGhLz0pi/kViORtn1392opop6PUY0gQ35ZzjqYsOepEB JGVX4HElrZGEaffrG+e32SRFg8Y8qZQGQescpfdlf6itas6YfMHHD0W2nbj+DobCiAvJ W9XDpt2ZUEwYe4NqPUdnjddwhOn+gGep/V2k8eA15zgzO74irhHC2F3nBI2PxGfyGTK5 E/P89kiyoMsK8VA0KmjswSnhGCRnyfW6njWShCf+6DIz0p24/YTpZmbo48ceUUs8wO1t Hy4IYrm3Qys9Up8gF4ZGt4TvTRkP1cTJ0Mx3Tt9Cqj2D9lrOwYdQHk1edjFOE7SmLdXd 8HTQ== X-Forwarded-Encrypted: i=1; AJvYcCWPdvhbaC+KtLI3DKWRXJNGm0uy+DUQB7ZIxQKCvIOo1RI9gRhUAYXkb2YOyXFohw/YAK5IyrHjZw==@kvack.org X-Gm-Message-State: AOJu0YwtyrSiH9oZSnur0KTUO6CKb8dzHXM8ZONmd6q1ZhkHfaGpz+2C ODd7taaSls0h+NbgN+bRQmopMmyhnsyw5VXqbJBLLKLdxfModVRomtRc4Q== X-Google-Smtp-Source: AGHT+IFha5XsOkvb/Z9HPThCNhx9ub0dAJ1+WGMf83pfULX4kvSBKgNFy4SELU2Yh91wH2n+OKqXyw== X-Received: by 2002:a05:651c:210d:b0:2ef:29cd:3191 with SMTP id 38308e7fff4ca-2f6108934b4mr25104131fa.35.1724946661825; Thu, 29 Aug 2024 08:51:01 -0700 (PDT) Received: from smtpclient.apple (89-73-96-21.dynamic.chello.pl. [89.73.96.21]) by smtp.gmail.com with ESMTPSA id 38308e7fff4ca-2f61518225bsm1970721fa.107.2024.08.29.08.51.00 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 29 Aug 2024 08:51:01 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3776.700.51\)) Subject: Re: [regression] oops on heavy compilations ("kernel BUG at mm/zswap.c:1005!" and "Oops: invalid opcode: 0000") From: Piotr Oniszczuk In-Reply-To: Date: Thu, 29 Aug 2024 17:50:50 +0200 Cc: Pedro Falcato , Nhat Pham , Matthew Wilcox , Linux regressions mailing list , LKML , Johannes Weiner , Linux-MM Content-Transfer-Encoding: quoted-printable Message-Id: References: <6f65e3a6-5f1a-4fda-b406-17598f4a72d5@leemhuis.info> <02D2DA66-4A91-4033-8B98-ED25FC2E0CD6@gmail.com> <3D1B8F1F-2C41-4CCD-A5D7-41CF412F99DE@gmail.com> To: Yosry Ahmed X-Mailer: Apple Mail (2.3776.700.51) X-Rspamd-Queue-Id: 3901A1C0012 X-Rspam-User: X-Rspamd-Server: rspam05 X-Stat-Signature: ftjhn3qmucrcrq76wuxg4csd6xrz9ahb X-HE-Tag: 1724946663-843181 X-HE-Meta: U2FsdGVkX18iUYHhLEmbSU0ZO/ygLJWJAqAGVnbRLW4p4l3nyKIRfzsW/0P4XNb+Zv91FVbR3qPk+yLPM9gRm/N9KAVbBBDeevu7iVM8QgALhoV1A7a3E+ajTHSQOlmm+Z2H4s7uWjUQV7Pv6QLEjMWtP1BSyeL0NoZpz3xSzrmQk19ScoWxsNyQ6jI96xVHF21yeNpQcSWZeJJlRqEXUbw/vKIb+BBnmn1xWEJliPPlmo52HjIkXuYUcj/UcPfojAoA2T0CsFCJZXOnTnT04zzw7xzUGGr2l8q5bFKOY0nLVoxlUFBQmeP9lub8YTRuA1TDOHp7j4mKknv0S8wl4MFyiYHOh8GGwZyLgg1PwER5u4r33iliK6O/qa7Hgry3I7GSh+nwepk1WwIdABHXmsGTQMPlXi/dytU/0aPn5OSYMBfqlZCNyXUV32Tx98a8UmXndQKZFgTTPEa3tzktg9muXtfaMXzexRUNdRZVC/boa0xK9TNz/tnBKNYbfFY+irSrFY9qnmFV9/eknlPlY8kB7MP5JmyJDdSR7Qui0+Ws8cv6QGphpYYliOXGo3nhI5tAuaB/3JDqwkq8/qdQrNq+hZ01ub0DTf8i68ns+vFybGk+iv9x4MNi2dl9iE/vSzTVYlIi4/cAO2oSJ/78OQz/ACDkFD+EhLk7iLdTYOFnzf4+1ytbCQPkgjFU8b8l1/uY3cdK2edSdS1FTIazJSYwEsZWLenaENpm44kjVqvtUGA0590kRZxf50Yprp7U4Aa8jxDTEGplXf6gqxrzxIyVx+epqaG7676hP1aG2pvSLcweuermE4SpLznrudNUBY1YxG1XIeQKXq3xAHJQOUnbe/GyHdswqZr+5qg0kxywoiXyCMtqRknOWl70i4XtYKCb60hA+9NovbF/e18MkcPsa8P/AoLx5fAG5Y8RaqlOpyeYcNmt+pJk4Lsn6M749ENvVMs/n/xzIK1pKee 2s3g94gb 52iswN2186b8mHrnCo4ZHz8o4cP5mr4tUdwcpEunGmoJ6dDAI8C9ZippaZp3a8EjA8BXDHkCkXNMGvUfAHz00lugvf/b/1YZ1LucTnh+XXbRUDskMxNo2NQqQX0boNEvOdALrmjVJnH8y9tc5EpTDozUeH0dAgN3avJSHNXWzXDzPzIWvMi4Sc4t4WYwopo/NV/YWqFSQaziA59VxrpavhW6UHTIi1iD3seyRkSVuOlIIP1wTYklqkisUd9kB71ynxUnhm8H2cWLeu2Xk+8+rmibSZmHvBJGuWYtmnzlcOagLfv49BEdahIP5i5sNUCiFGGyQYNh0cnsduFaf/JEAGMOloXe+D4INzOAInKiMrlnM17iYZ3Hh0alhezBNqhyaViOqCoElhXnjtA3TLY8M6H5x3f7gQpB8q5DLfaLqoe9yloxbM/AhC5K1eu7UpW4KRCGh0Wb+ALYsQ3CfQv2aNDnU72ATZDZnVJv8fzqib7aqfpu5RwEpRpFfH2639C/ab98LLQaX0RNd+Av52B8QOFhOPbwolhnCAtJVn9EjMYWLVmzkXi2HAiSAzp9OVI9vkQdpGP+JuYpYw+t2GmTc0XYYVA== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000612, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: > Wiadomo=C5=9B=C4=87 napisana przez Yosry Ahmed = w dniu 27.08.2024, o godz. 20:48: >=20 > On Sun, Aug 25, 2024 at 9:24=E2=80=AFAM Piotr Oniszczuk > wrote: >>=20 >>=20 >>=20 >>> Wiadomo=C5=9B=C4=87 napisana przez Pedro Falcato = w dniu 25.08.2024, o godz. 17:05: >>>=20 >>> Also, could you try a memtest86 on your machine, to shake out = potential hardware problems? >>=20 >>=20 >> I found less time consuming way to trigger issue: 12c24t cross = compile of llvm with =E2=80=9Eonly 16G=E2=80=9D of ram - as this = triggers many heavy swappings (top swap usage gets 8-9G out of 16G swap = part) >>=20 >> With such setup - on 6.9.12 - i=E2=80=99m getting not available = system (due cpu soft lockup) just in 1..3h >> (usually first or second compile iteration; i wrote simple scrip = compiling in loop + counting interations) >=20 > Are we sure that the soft lockup problem is related to the originally > reported problem? It seems like in v6.10 you hit a BUG in zswap > (corruption?), and in v6.9 you hit a soft lockup with a zswap lock > showing up in the splat. Not sure how they are relevant. If so then i=E2=80=99m interpreting this as: a\ 2 different bugs=20 or=20 b\ 6.10 issue is result of 6.9 bug In such case i think we may: 1. fix 6.9 first (=3Dget it stable for let say 30h continuous compil.) 2. apply fix to 6.10 then test stability on 6.10=20 >=20 > Is the soft lockup reproducible in v6.10 as well? >=20 > Since you have a narrow window (6.8.2 to 6.9) and a reproducer for the > soft lockup problem, can you try bisecting? >=20 > Thanks! May you pls help me with reducing amount of work here?=20 1. by narrowing # of bisect iternations? On my side each iteration is like -build arch pkg -install on builder -compile till first hang (2..3h probably for bad) or 20h (for good) this means days and i=E2=80=99m a bit short with time as all this is my = hobby (so competes with all rest of my life...) or 2. Ideally will be to have list of revert 6.9 commit candidates = (starting from most probable falling commit) i=E2=80=99ll revert and test i=E2=80=99ll really appreciate help here=E2=80=A6.