From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 67ED8C38142 for ; Tue, 31 Jan 2023 17:36:17 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D32E06B0078; Tue, 31 Jan 2023 12:36:16 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id CE2E56B007B; Tue, 31 Jan 2023 12:36:16 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B83CB6B007D; Tue, 31 Jan 2023 12:36:16 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id AA62D6B0078 for ; Tue, 31 Jan 2023 12:36:16 -0500 (EST) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 705F6A0AC2 for ; Tue, 31 Jan 2023 17:36:16 +0000 (UTC) X-FDA: 80415797952.16.FE36AAB Received: from mail-pj1-f44.google.com (mail-pj1-f44.google.com [209.85.216.44]) by imf06.hostedemail.com (Postfix) with ESMTP id 8A8FA18001D for ; Tue, 31 Jan 2023 17:36:14 +0000 (UTC) Authentication-Results: imf06.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=X4w+zBWX; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf06.hostedemail.com: domain of 42.hyeyoo@gmail.com designates 209.85.216.44 as permitted sender) smtp.mailfrom=42.hyeyoo@gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1675186574; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=AIi1oha6qhxDVjUsD0+c0ThSUDGZAaY8VVAoIXJEL64=; b=3iZP2soAHq2eHWMqvKpNmrQVYlL6vgAgxnaWKX3H2obpU2XdLNEurNNJpmuOBQkkU4KUbB 9DvHBH0FbgWxgSUqmQ4sv8oD4l9QX2hQ3awuij5QweGYRgkCTdWlHXkoQukUnOPPX1H3Tj QN51cnYWEi4w7eOhL9FkS8xV4s444Z0= ARC-Authentication-Results: i=1; imf06.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=X4w+zBWX; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf06.hostedemail.com: domain of 42.hyeyoo@gmail.com designates 209.85.216.44 as permitted sender) smtp.mailfrom=42.hyeyoo@gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1675186574; a=rsa-sha256; cv=none; b=sxZ6e1xIU6/CQo5I7lUBzDQ2pgpvW9fwlltkd3OneluvYpzxBQJzo+mSOKqDx/FLeQyIgo idUprPbo6loRpODiFSqe1G7EdStIoqev97POrTxOjNGlHHQVMv+z/lx6+1lm2MVGXfRQw5 /azFjKnaseH9LGAEMq96j84LojDO75M= Received: by mail-pj1-f44.google.com with SMTP id cl23-20020a17090af69700b0022c745bfdc3so8580694pjb.3 for ; Tue, 31 Jan 2023 09:36:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=AIi1oha6qhxDVjUsD0+c0ThSUDGZAaY8VVAoIXJEL64=; b=X4w+zBWX9YZMyJSOkAMYSj2F6xcfOkNbbUcS6x2KRO0rkyxPyz5dDgJ5c9GKJqV1XI GT31RR3YONiGWpl1EGXN0WmcG8WPSb+HNXpWGiJD0j8GSmSJ+v9gBFefTVDuojGP7Ng+ DW6V8mL1vmtB7FNrIdF4mJUH4og1AuzPDid3OFXcPloeiXb6/HG57vL7KLc0l8jfAgkb QpsV0BvKTyL/zFBPHeJFZdNyclbVrgveD6ZPFEwUXgQmdO4KswyOQqiF5GtmOvCYwI1w e00iNZQLS0N2Nr27qc7Eck5F9Dw6eweR4yorERjCaKv8UODK1WwGlQazJHWz0SjTCQtS HfJw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=AIi1oha6qhxDVjUsD0+c0ThSUDGZAaY8VVAoIXJEL64=; b=kZdwL67Z0WJBx2dovN64/C7ttu7Caz8yESw7zjlX5MIeZamLwlwlui8y7Pvkz8GkzV Gl+Jd88Bnb9ipFl17BcaugLbUbvMdQCwlHBEhTR69E/39WlBz5ezXQvznppRHOxZyLZg +wuoqRJaJhOGG+Zs+mVLRw2jzA04Dh/txZ4uJe3rN7YQ317n9kqdECS4aVDwetl1Pcs3 Ck7yMMyRmMsNT9nRFNrnFajukorSWuhIgF6ZtFHHmCCtU9zYs0Nuwn5lSVyscp7y6Buy fH/6jc+tWDUeZzqq9FihhzNcrJrCbiYBLjlVJy6IGj+eiN7fS3Ekf5kKkWAKqFrjt3vL 7t5A== X-Gm-Message-State: AO0yUKVOwiIxftKiZKgLcLVRbRw4GHk9GTyejIQT2cAP0RL745rzewhq 8DVxuJ+VZqMCn516R1O/cnJHlFUaHe8= X-Google-Smtp-Source: AK7set8bLW0tYL6M2BX5chQWZGccaFAF20jjrfPV5RrZx6IFCK0du6bfESeO47itJMlRBu1sibZVPQ== X-Received: by 2002:a17:90b:3849:b0:22c:1a96:d3b8 with SMTP id nl9-20020a17090b384900b0022c1a96d3b8mr13890865pjb.49.1675186572934; Tue, 31 Jan 2023 09:36:12 -0800 (PST) Received: from hyeyoo ([114.29.91.56]) by smtp.gmail.com with ESMTPSA id e6-20020a17090a7c4600b0022c03785e9dsm11083203pjl.18.2023.01.31.09.36.09 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 31 Jan 2023 09:36:12 -0800 (PST) Date: Wed, 1 Feb 2023 02:35:55 +0900 From: Hyeonggon Yoo <42.hyeyoo@gmail.com> To: linux-mm@kvack.org Cc: akpm@linux-foundation.org, Huang Ying , Zi Yan , Yang Shi , Baolin Wang , Oscar Salvador , Matthew Wilcox , Bharata B Rao , Alistair Popple , haoxin , Minchan Kim Subject: [BISECTED] first bad commit is c203c6d5b3f0597 ("migrate_pages: batch _unmap and _move") Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspam-User: X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: 8A8FA18001D X-Stat-Signature: prmayooacz8qxormed84h5fxw34xikth X-HE-Tag: 1675186574-98954 X-HE-Meta: U2FsdGVkX1+44aRzSe/jxCen5kcuKjaNvI1PFqVCheXtuE72WibuTg7L6KElH+FGI7Tx5rXxzasOQuzIcBOfd7pfYqsIQsiemBNM7I3alxam9CluCL2qApSLNolcXURh63iCYrDz6oaD6xkTtAtldFX354gfE00MhYxv+He4ngfbUsuywQSriD3jekRlq2XlrZtonP2fOLzAgxhNwotVdktjh7BMUAhwd/HRRSF6mGlig+Pc01VWaVzUHnv29bx+Egj5VPinn7sQzShnzTw6619cg4zwDZcndXQ6akJeuaKiv98l+zo7FnJ+Alg8GOfgzTcalPykEBwK12dzvT42Q3ohNkpNZqWMn+xv9gy58Tkf9SfiugkOoyb/A5fFOENt0eLU6HfEFNDDn4uwviPTAHWu9jXOjT77YKRFtOWhxWK8rrObBboHCCkRvD1w95BKBemM6OVIfa5R+XRw3ZGwd9zEKZNGJ1OlNYvGctES7U+cV40yPYGB14xnC4c/NWZaJe/Eq2qG8yVdjLiy9CV029KFRe8ICS5/sOwba51d5pcZDyUuEuvMPWAF/DeKjnxGcp76ifILO62psxdFYHq2OVHa71UHc/KhjcIOjDTY1QK2AM34b1wK5pWrKrQOMF0z8mLi+meXm8gFslYskfMOTBxpUcT3lEfNeoTqMXUZ/C3zkZGXdQ5iHTC7EUy9ewV2e4EkKnVk745npNHB5SrH9fJotdql/K1Gr3NRzMH5BCaylgDrYbuXesimK00G4d4xVUvvVq3jplb3mDrhWdMUBRzV5ZPQY072KKBhVkLz1DJ9woZwmO+Sch/VCa8qM8Jn/adrVzgx5d3Tkku312wujV1TYCvUtBqAZYSNzkRUlBMKhuN8ft37jn7aUl9BMcCna9iADzSRPu3KNZ6UUHPbDWEc60DnwMspYkgUk7vO/C2+DvoOawGqZrcSQpK420vTnKnRC7ivQsnopmQFDwZ ebvr9swL bOtU7uM1/6PKGypTKM13CD/rBilI28i96lL6oCVJ6EFncDYne2KRrmm+UMDEycq0Ud1adD4LdgT45mvsYaoyz14dGZWq8a/GoTAH1XiMjCCT4mBjY4A4e1FBrbTy1I6K8JWwV1+0xUAiGv1qVztkluAEF0SI0kxf1TwnEAH9NMTdBgOvR/x4s1phGwlicnoI2LRXMGsw/Nqp4FPy7+pb71sKppRMWAkhUdHTXJwjWQfao50kghZR83f3riZnnSbl6QKaU5a/RU1RZWhmX6++BMZgeuBH5ApqzWIeYMDqQpZQ3yPBkbsqwhAY4UdxsLDo51NylZ+px+QPNpra24fKaLqjvCaOnM0JM4BQEEzFbFjAxUmpJGsseEJZLAKdTcQqOLLarje0hr3Aa4GxxZkT2HdA/4HX2Cpu473PLSDMuR+j3tsHRwtnwLyevbfF9hCwPMF0FBLDvCntdF2Mgg1dZqAb63dgW41KhQsyQfSqiWskHbWpnBC7TyZ+bhFebS7YK2r5+NaWrFyIKd+Q= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000001, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed, Feb 01, 2023 at 01:09:10AM +0900, Hyeonggon Yoo wrote: > I've observed random list_del corruption on mm-unstable, > where HEAD is commit d69862e693c069f4 > ("mm/migrate: convert putback_movable_pages() to use folios"). > > The issue can be easily reproduced by stressing MM multiple times: > stress-ng --bigheap 0 --timeout 300 > > The compiler is gcc 12.2.1 and config, dmesg are included as attachment. > I will try to bisect but can't promise quick resolution :) The first bad commits appears to be: c203c6d5b3f0597 ("migrate_pages: batch _unmap and _move") the first bad commit _probably_ be earlier, but this is quite easy to reproduce so at this point I think above is the real bad commit. Here's bisect log: [hyeyoo@hyeyoo linux]$ git bisect log git bisect start # status: waiting for both good and bad commits # bad: [d69862e693c069f4f67fc55c159ce5f6c6def42f] mm/migrate: convert putback_movable_pages() to use folios git bisect bad d69862e693c069f4f67fc55c159ce5f6c6def42f # status: waiting for good commit(s), bad commit known # good: [5dc4c995db9eb45f6373a956eb1f69460e69e6d4] Linux 6.2-rc4 git bisect good 5dc4c995db9eb45f6373a956eb1f69460e69e6d4 # good: [b81cc59c6835bb84e72f1ce516121f25780a42cb] shmem: convert shmem_write_end() to use a folio git bisect good b81cc59c6835bb84e72f1ce516121f25780a42cb # bad: [1e2a127908bdbc11065bc08200d0add096d96245] mm: multi-gen LRU: improve walk_pmd_range() git bisect bad 1e2a127908bdbc11065bc08200d0add096d96245c203c6d5b3f0597 # good: [4d2eba3fd7c0b3ada6b474e4f13dc1238670ea91] ceph: convert ceph_writepages_start() to use filemap_get_folios_tag() git bisect good 4d2eba3fd7c0b3ada6b474e4f13dc1238670ea91 # good: [b22d808ef6c68b6fa2b5a97f5d02e83ab8fb732d] migrate_pages: separate hugetlb folios migration git bisect good b22d808ef6c68b6fa2b5a97f5d02e83ab8fb732d # bad: [6d8b6b69ee6a24a89f2552a12e43b7c9b3a7635d] mm/hugetlb: fix get_hwpoison_hugetlb_folio() stub git bisect bad 6d8b6b69ee6a24a89f2552a12e43b7c9b3a7635d # bad: [71d4be767f5fde1ac5df2ade1f654f19c24a0a3e] mm/damon/core: skip apply schemes if empty git bisect bad 71d4be767f5fde1ac5df2ade1f654f19c24a0a3e # bad: [68611caff673fc59c17f00dcd0cab2704987828d] migrate_pages: move migrate_folio_unmap() git bisect bad 68611caff673fc59c17f00dcd0cab2704987828d # good: [7199465b2be061f1b2bd6b5a1a5a96a822f658b9] migrate_pages: split unmap_and_move() to _unmap() and _move() git bisect good 7199465b2be061f1b2bd6b5a1a5a96a822f658b9 # bad: [c203c6d5b3f0597a15137b6394fa715542df78c8] migrate_pages: batch _unmap and _move git bisect bad c203c6d5b3f0597a15137b6394fa715542df78c8 # first bad commit: [c203c6d5b3f0597a15137b6394fa715542df78c8] migrate_pages: batch _unmap and _move