From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3BE12C531DC for ; Fri, 23 Aug 2024 17:24:45 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 9C8CC6B047E; Fri, 23 Aug 2024 13:24:44 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 978D46B047F; Fri, 23 Aug 2024 13:24:44 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 840CB6B0480; Fri, 23 Aug 2024 13:24:44 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 643916B047E for ; Fri, 23 Aug 2024 13:24:44 -0400 (EDT) Received: from smtpin03.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id DF7661A1DB9 for ; Fri, 23 Aug 2024 17:24:43 +0000 (UTC) X-FDA: 82484184846.03.4F023D3 Received: from mail-lf1-f45.google.com (mail-lf1-f45.google.com [209.85.167.45]) by imf27.hostedemail.com (Postfix) with ESMTP id EB86E40011 for ; Fri, 23 Aug 2024 17:24:41 +0000 (UTC) Authentication-Results: imf27.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=NlStZRzj; spf=pass (imf27.hostedemail.com: domain of piotr.oniszczuk@gmail.com designates 209.85.167.45 as permitted sender) smtp.mailfrom=piotr.oniszczuk@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1724433817; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=wA90O16jMgd8CWh2MnYobE93W15NHZgeiwtdthdRGp4=; b=PKtTzEyZ9gMUi7oU+2ZtlXbe0oV1s2KvJftRZ0cpN2Uhmfm5mLg+cMNQu68SpCZ2jsfOgt YPQI1M8Xu42HMoI7ZXdElnpgbsM8ZEBwNIUIsDMnOSGwWEtZel+u4mJ8fodUXlRopIR3Dx KDXMLtroKw3EAbBz1yLOc+haQ1SA8YY= ARC-Authentication-Results: i=1; imf27.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=NlStZRzj; spf=pass (imf27.hostedemail.com: domain of piotr.oniszczuk@gmail.com designates 209.85.167.45 as permitted sender) smtp.mailfrom=piotr.oniszczuk@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1724433817; a=rsa-sha256; cv=none; b=G4BJlA+9eX0K+iROZLHRmgWVTza5Go0z1GgfuzQywzO5PuC/r24MDx4Ig+UwnLztn5IprL V8DLXnOjhl8GnuZerTRJHsNwY/oipOykBi1+WsyYbWxbO/b/OlWMXvG+HC5UxP5T/thr79 WW0EKHVZDyRPVjpryCTXb6DdduPqmQs= Received: by mail-lf1-f45.google.com with SMTP id 2adb3069b0e04-5333b2fbedaso3620234e87.0 for ; Fri, 23 Aug 2024 10:24:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1724433880; x=1725038680; darn=kvack.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=wA90O16jMgd8CWh2MnYobE93W15NHZgeiwtdthdRGp4=; b=NlStZRzjM/At0lueuWycfr+XFTBbHymO7jmKlvU0lQmIBofWln9fbLAA8qkR3d5YyJ t0cT2rv57fc5aLmnn4+akVRSQPk/ahDHO9gDFPZOW+dYHKTQgFx2HAOcVQfU8gtSL/aB lL3rVWNJe9Gd2Uft7VNn5QpVZD18XkmWSyTpQsqfH8eynFNugHcLkv5F8jGsWjUSuXBZ I3aZalSnLvMO8lJFqAtyRVtDKfqBUUlXnwMODQsHUBMhb3geI/rpEsdDD821IFh/xttt KvU3/G8SZMQC9NV5sRImboteJ2Ima+F009E7WpC2MBr+cwfRpH+vPnA8Wf3G8Oollz5V 5nfw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1724433880; x=1725038680; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=wA90O16jMgd8CWh2MnYobE93W15NHZgeiwtdthdRGp4=; b=RrGOnh8HL4VgAdO8f4bBYv9WxTd0WA7V0gZTcHTaoKSBGAx2g5MGhUrBVOETkHzP2K ulZJ/l5Bi/UcaX38UUlTmCOIvxcOySOAiOEHR3klOZ+dzTiQbMj9v1rL4vqs2iTZpSiw mhFba15J4swhW419UKCB5khCMGq5tIKp5Fm6qhskXgP01/+kkPrGUA4lwEQwpuG5l2Rw Yn1V3HSn8EANMCDzjDsqC1MOHqqmEyHnEWuszHi8EhJZvrTcQ07lgOodG2/ABQQG7vlu Bmtu2ondswr3mOvOLzKQHOnUkjTrBhPjt/qVvwGtoTs0Hpxs/rv3212KmEzP8l/WYlHw dJig== X-Forwarded-Encrypted: i=1; AJvYcCVxpiGKxttiSXQAyDzUoMTRR8LmCK+GBcxSCqeESI9HvmpaUIEIUWoKet/T82tT6/S75JGpxlKIrg==@kvack.org X-Gm-Message-State: AOJu0YzKTA5iprEzi2s9nzy8hZBXb8eDd7RwDkqgjPlZa8LofktYTdIJ yeaQtdkzOvLjn7n2EEfsWVUz75eQEtiMMOH2QiHSQf6UX793zovR X-Google-Smtp-Source: AGHT+IFZHmqXsjrxBKhdu8OBEsZNOg0v/ZZ7Ci9CMduEvA+77wHDailfpz0DSdPAgrJBCpingvQDRw== X-Received: by 2002:a05:6512:3089:b0:52d:b150:b9b3 with SMTP id 2adb3069b0e04-53438785d61mr1902615e87.32.1724433879707; Fri, 23 Aug 2024 10:24:39 -0700 (PDT) Received: from smtpclient.apple ([188.146.32.62]) by smtp.gmail.com with ESMTPSA id 2adb3069b0e04-5334ea88f82sm600036e87.257.2024.08.23.10.24.38 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 23 Aug 2024 10:24:39 -0700 (PDT) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3776.700.51\)) Subject: Re: [regression] oops on heavy compilations ("kernel BUG at mm/zswap.c:1005!" and "Oops: invalid opcode: 0000") From: Piotr Oniszczuk In-Reply-To: Date: Fri, 23 Aug 2024 19:24:27 +0200 Cc: Matthew Wilcox , Linux regressions mailing list , LKML , Johannes Weiner , Yosry Ahmed , Linux-MM Content-Transfer-Encoding: quoted-printable Message-Id: <9793DBCA-13F4-4B47-AD57-12A62F7DD8DD@gmail.com> References: <6f65e3a6-5f1a-4fda-b406-17598f4a72d5@leemhuis.info> <02D2DA66-4A91-4033-8B98-ED25FC2E0CD6@gmail.com> To: Nhat Pham X-Mailer: Apple Mail (2.3776.700.51) X-Stat-Signature: qw5yzrguiqy4d8j55tzkm5q51pek5peq X-Rspam-User: X-Rspamd-Queue-Id: EB86E40011 X-Rspamd-Server: rspam02 X-HE-Tag: 1724433881-193166 X-HE-Meta: U2FsdGVkX19nNlfGPs/kphMTlj5sBl3Bk2P6G9YVc0N/d1XeLlT1oQd1tzYkbdra4C1eBB+8ahSf7QujvTtw8ac390JQq+cJaafk8ZmpiB/H5ZbgT/49tNdU6qJERm2tw+15OqdUYmDRiEW5HWQikYNwwvJmRu8goUN6+jDFFEdX9r3JlXKvLbfQCjmwdL4sEMuPCksSZI7Ly+ZhtVTRK2tIgX3lCKZwZQWlco0bVd+B/AKNAfFBpXD2ZdWiRq9VmDjcbsC/i5Jx9DvPcoVsOtJzDijvm/ZpRYbt5NRXNywXiVtSEBUSgGjIni/BcMKk5cD4SmknOfG8dSF1V3GYkqWYnNuF9BMkizrTLgv45dImYf6otnNXg6AMQZADSZa0fX8I0AumgrlpYCKskpTt7YKZVvJDqVLghUBVgf8+vBgu72pvzLC47TtBFMyn9X7+8VZxZodKBy37KptjzATSf8tsjWcnvjZsTUHQF8p9Wv11q6BMJupVB82zM9aOhdzu4ysEf9n5umnK2psEzDkxtCi0UFOJmhftmcQarlLPlVhMJbOM8mNBzIt+UQBuUw7Z2kp6x3JeQoB0KaZyweh41sJVJ424QePILcXw//5rUyT9q1GZbssiLf1VBKjHMWDm8HdqCXpzJx/xXwFTYqu6wA0vdN2VIbKEcAPo2yqgnrtWWQIDjndNyvA9PPkwZNo492Pplbg+RxKErSmjrfQZAkZQuVrLBoSd5XSOE7TRWsm7Eq0udNHzBgtI1ylAlZBkHU6r7jwOP4ugs7nd7VsBuN8WDXRzyu0KZocgXATdvoc+xGu7ke8dZwqzlLsnwIruTTawTsh01WPL0UuBQVVf6M51/jr21JdQnX1xR5j+6nS5Q0rQu25lhIJdEz4FW3qwJcdaMldLHSvq7cxwfDl0KShFecvVuR+zX8/oSfFLOykWlJL/WQoINClaIUiQIzS3fDRk/RpRXqZlt2imoI4 i6eE3XdA AZaVxh7s1ZTDw95vzh72FWd8l8t8H1658SdipE390PgCsn9fP/F+glyiw3SUlZilfyEPY5loWQVMIq34yGynhiohv8INzftAAP2a+FVhUCJjxCwaoMjqIIO7Z7J6dwfE5lSISup5FjFhC8X7Xwa8YT1+qTtyDaxjPYerP9fH3aGBZwsGQkRJKzdgKgnvebZkT9ORlsNUHOD5+3G2kgbPvRFhYYgA0p80oqqRI395WMubLWceoUbV2s1AI58H9yFtrGNMyZ54noeCh6kuJa82Pryh0PxcDXRbg8sZF6a8nKX124T3yf/4hqFJVTO1/g3KsRqZQNy6ug1kIqEKBoOiut0UG45yNgTfkfXkWUtuoq1JR27hRxlCoaoeG+IGb77yvVcj/St4l0JFDwtAFemFbL6eW7ExGTvZiVHZf8no4QZ8WRUsbecEjBRlzkyeuGb0bs5jv69r2S7JmkovoqthQiuQTZtEZEcvEId9a X-Bogosity: Ham, tests=bogofilter, spamicity=0.000084, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: > Wiadomo=C5=9B=C4=87 napisana przez Nhat Pham w = dniu 23.08.2024, o godz. 18:16: >=20 > Have you tried with 6.9 yet? IIRC, there are two major changes to > zswap architecture in recent versions. No. But now building vanilla 6.9.12. Will install and see=E2=80=A6 (This will take some time as catching issue needs days of compilation) >=20 > 1. In 6.9, we range-partition zswap's rbtrees to reduce lock = contention. >=20 > 2. In 6.10, we replace zswap's rbtrees with xarrays. >=20 > If 6.9 is fine, then the latter is the suspect, and vice versa. Of > course, the minor changes are still suspect - but you get the idea :) >=20 >>=20 >> btw: we can go with elimination strategy. >> So what i need to change/disable to be closer to finding root cause? >=20 > Could you let me know more about the setup? A couple things come to my = mind: >=20 > 1. zswap configs (allocator - is it zsmalloc? compressor?) Well - I=E2=80=99m not using zswap. [root@minimyth2-aarch64-next piotro]# swapon -s Filename Type Size = Used Priority /dev/nvme0n1p3 partition 16776188 = 294164 -2 >=20 > 2. Is mTHP enabled? mTHP swapout was merged in 6.10, and there seems I don=E2=80=99t have used config at the moment, but = /sys/kernel/mm/transparent_hugepage in I see: =E2=94=82/hugepages-1024kB =E2=94=82/hugepages-128kB =E2=94=82/hugepages-16kB =E2=94=82/hugepages-2048kB =E2=94=82/hugepages-256kB =E2=94=82/hugepages-32kB =E2=94=82/hugepages-512kB =E2=94=82/hugepages-64kB > to be some conflicts with zswap, but Yosry will know more about this > than me... >=20 > 3. Is there any proprietary driver etc.? >=20 Only 2, both ryzen9 monitoring related: https://github.com/leogx9r/ryzen_smu/commits/master https://github.com/ocerman/zenpower/commits/master