From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id CFD80C05027 for ; Tue, 14 Feb 2023 04:01:39 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 4E87F280004; Mon, 13 Feb 2023 23:01:39 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 4978C280001; Mon, 13 Feb 2023 23:01:39 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3386B280004; Mon, 13 Feb 2023 23:01:39 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 1F51D280001 for ; Mon, 13 Feb 2023 23:01:39 -0500 (EST) Received: from smtpin06.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id D2DD9160D89 for ; Tue, 14 Feb 2023 04:01:38 +0000 (UTC) X-FDA: 80464548276.06.070A85A Received: from mail-oi1-f176.google.com (mail-oi1-f176.google.com [209.85.167.176]) by imf10.hostedemail.com (Postfix) with ESMTP id D951DC0003 for ; Tue, 14 Feb 2023 04:01:36 +0000 (UTC) Authentication-Results: imf10.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=PvH4ywpa; spf=pass (imf10.hostedemail.com: domain of groeck7@gmail.com designates 209.85.167.176 as permitted sender) smtp.mailfrom=groeck7@gmail.com; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1676347297; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=5JDOB47jyfKN5KErSHTMXnOCV8uvdMv6HLEbTTUpfVc=; b=6xy/IofgJ7rAwUuwSmXr/xC/mfKZ4F0w/V1kVsmFplgFb1idnpp5WsO0BBZgBmlJkaAFGK gkL5E+GpcTM+bsbLGFCtD/njKGqTFXn0BBGIjIhzcJNPAbefO+v0pRJ4l7mdFTcPs+McS1 pKTWyGk6KRYJcUDGOhRe8Q2j4doFLAY= ARC-Authentication-Results: i=1; imf10.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=PvH4ywpa; spf=pass (imf10.hostedemail.com: domain of groeck7@gmail.com designates 209.85.167.176 as permitted sender) smtp.mailfrom=groeck7@gmail.com; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1676347297; a=rsa-sha256; cv=none; b=28pGAsbP02NWkOet8ZJ89Mx1O3kRiOTjUT0bwYMDDT85LR4wQa5XAzXeGE+bTg8OhnO7pu +AovK/qx+g1iHauo5TASc64IpB3LnkuEO7f/WC4PbUdzcN1JtEwSHF6fkN8coyyiHBoI6u t0X0el8LqR3AVDZRL/iuzglUUE9Y7dM= Received: by mail-oi1-f176.google.com with SMTP id bx13so12019538oib.13 for ; Mon, 13 Feb 2023 20:01:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :from:to:cc:subject:date:message-id:reply-to; bh=5JDOB47jyfKN5KErSHTMXnOCV8uvdMv6HLEbTTUpfVc=; b=PvH4ywpa+2KCQubu0hvx8E4h3Rm8Pe9P2NZ+NhUibOlKrSornMpsZHwL8sjw3kC/a/ b2U5W9NCyOpyz+5PbesdQkNtJUwbnQYh/JwK/0Q449IdDSj8TV59Jz0OV6m/DXWnQDOn Sj63vAzgj2mY0n57joUvI6eg9XC3FqUY2WUIpqA1xDtxzVrgwXe0BLRRV6G0OPLJLLYS f8QKHb1sG/umGWuNYg/CRVmSd3QIisgI8RW8ytF/trAxtMIAGSgTW1+yUzUiA34g2Sxz pcIdXwU4R+ew58P/3eck4PbSuD/9M6TZVO0ttv7UuFOdgnjJQDcnC4rhmEukChrqsfGT /x7A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=5JDOB47jyfKN5KErSHTMXnOCV8uvdMv6HLEbTTUpfVc=; b=KMM33BcNMJeiG7Fuf9VtKJHT+UgrZRDPyZ47RLgaRUaKEhSMDgWEJasuKtM9PzvelY 7qqDiCQyIR4CizSOQ0d8jnoaCMFQOeTrDhLW0/zgMLNGh8Lr2hFVrk4wy4z1D9qSnBbA dIJBCc/l/Efot1Qfdi1sueNgTlGNcqnu9dyljRlZrQlQicKwTRutUI6OWKjJL9qU30wD /T1luMYvVgKKFAfLYObwptBfk/gVXa2VdR0CG2pehzB+sNiQNy0oK+Gz9gIuiRT/bLSd vt7wc2aRuuRQnBPVb/3Vq1e/9Gby9EiJbh0VBE8xA9auC//ESrtcbonAFO7qiY1MuSuB Ovmw== X-Gm-Message-State: AO0yUKUtLoH5aalbFOUlmiJvZXmyUn52V42jroPY7Q1GGeKbsOunEKWV Ltz4On6QPmG+/HXGClzzTAY= X-Google-Smtp-Source: AK7set90lp2VkK76+s92grnXK338HpX+PhyFW0Fs6BGnZPjlTYHNCREMMyuYsQucX7m2cxUiWC1aRA== X-Received: by 2002:a05:6808:18b:b0:378:8a89:95df with SMTP id w11-20020a056808018b00b003788a8995dfmr461073oic.34.1676347295929; Mon, 13 Feb 2023 20:01:35 -0800 (PST) Received: from ?IPV6:2600:1700:e321:62f0:329c:23ff:fee3:9d7c? ([2600:1700:e321:62f0:329c:23ff:fee3:9d7c]) by smtp.gmail.com with ESMTPSA id g18-20020a9d6b12000000b0068d6ed06b73sm5974460otp.18.2023.02.13.20.01.34 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 13 Feb 2023 20:01:35 -0800 (PST) Message-ID: <58fb32f8-ce1e-913b-3b85-c41b0630d4c6@roeck-us.net> Date: Mon, 13 Feb 2023 20:01:33 -0800 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.4.2 Content-Language: en-US To: Bagas Sanjaya , Andrew Morton Cc: "linux-kernel@vger.kernel.org" , Stephen Rothwell , "linux-next@vger.kernel.org" , linux-mm@kvack.org References: <20230213094754.397f86af6b2dea4aafd92344@linux-foundation.org> From: Guenter Roeck Subject: Re: nvme boot problems after merge of mm-stable tree into linux-next In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: D951DC0003 X-Stat-Signature: bk3gp965ksfn6ddopq51f974be1q7p5d X-Rspam-User: X-Rspamd-Server: rspam08 X-HE-Tag: 1676347296-497616 X-HE-Meta: U2FsdGVkX1/8f7DW2sxBCKF0YKSoa/nUcsQXBbd8V1wQViWIbbF7K1qinQyFTHurMVjqCqybMbS79AQIGl+TXJcAh49fnpcrbGocNW4/5cMCADa+DjBeDnGyspAm23Ot/kVYMDQ9n/Yr/L2RzZg1PMttBQiqzz6HSq2txsJyrmLiOIc5B6KQEnBlnxgShafjTI0xuNQNKaRWjR2g5bIVsQdTNCbxITliqOqlwJhQB86M7UkxU+Ea4xnzc9aBCw73veRkekSuWSFEKMuqXLi6wixyzavvZqjc4VkGTuu5fvl9vifl+XRpDiBNfA7NDjloAp1p6gB6ovYEJ+nrvQUe9mNVwzS0ZX040F/QOOt9lzr4tKD5npDuyZWKBjnViNvEU5KiPOiQoMi6N3vMVhLEcZo+iN2Q4FnCA6wbOjtMz5t1XFpandM9QjJa6K47wMFn+IhZsA9fV8PZ89bfeECCRNJ2G95nwhW00UzYaBQkPvpTTUhLWA1dTp7umNkbtyr16CXvGBpj3WNYDEXAoZunvR4JNVSW6lmzAQJbY0N7eH4CmEkj/tLHDzqYXwX/GDHgjySDlEPE6390JiD6kIC/xY6KnZH1O3WMbSwXK+Xwm4mRC19FqYbqZuRTRqx8RiDtBVfJRYDce8tc6G3+JE2rNwN/hyXWnFYkRUJOzUqMvzsg7dOUJGNSV+ulV/7QZt+adXz4GDnR1xNShrct6ofvvuD17K90DxrU1p1HzdlUWmsyUPsrMg54NSrBOrIta5WbwIA02GqQjkhRYLPHlQFb1Q1521vPo7sC2PU3Q2j9/k7dgTF45f2eh37ceQL4Cr+UPDGkczfK7KWl078z4ZB3IMh9QlJHnkxBOIBhYJ9Dc7+9YcEQLu9EA/VZb5GjXusp+42PZqKZyKBliG2qJalHgP+ehgtZiWMvjapYoK5RoGU7J4ft7AjqRuOojPLHuSs3W0uW9gvzy3Ma89T56R3 C5eBvUgr QjiVzdw8/ioo7VtdK2LkvsndIMNO0zsWUSx5KQdGeEfpbKwRnUH6+3B+Vh9o0nwX7OzXbBZ/ARgbFwaMWWOGEdIMnEP8jLXYW1dRe2TVObbiTWjmYhmWuDS91NhBaKgGcO9EX9Dde9QX7BQ2tfb5yOsHveGMLnjCYCVGokGZH9BupZN3k7ceCpytvR1+F3JwMq3PDXYCCSDdXfnTMQoXuEJ5SLjwxZcnnewMQ1Audu8Qo630un3jXIzdrIyXu2ezlDWonl12pKTM9jmnmFoy7peAMo6e+9dJU/7zHZLnCxTkq5wblJFzH3NDlHjhLfdtxAuXW+ZqihlDl7YHY2Bl6tsMNE+jXe0cKGMt6JHdA1cbTGxY0AtyD/X3QTEPF+hwZf2JYdQJQg1dMIU9riVIkweVKbo7Dk9sjz48E3QujPl2K8frEyCsrhyGYrzT3agHfC8tJUgmY2DJEYZ0GTIDTPjAkLG/MiPNFtjO1qTICJ4VXvhmbXcHdmUp9jPJ3djukQWjZwmq87Qm6XN0zIuqH5z7M39uBk0zoK5MtAOqKDF/7B1Te2CwRMcl7g2EFOu17WNbyneHuXdgNB9M= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 2/13/23 18:23, Bagas Sanjaya wrote: > On 2/14/23 00:47, Andrew Morton wrote: >>> I am having problems booting from nvme in linux-next. Bisect points to 06e5887cdcc11 >>> ("Merge branch 'mm-stable' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm"). >>> The problem was first seen on February 8. >>> > > Hi, > > Can you please directly test mm-stable tree instead and bisect from there? > I'd love to, but as it turns out today's next release (next-20230213) bisects to a different merge. Still mm, but this time it is the merge of mm-everything, and both the merge of mm-stable as well as mm/mm-stable itself are fine. See below for the updated bisect results. mm/mm-everything itself (mm-hotfixes-stable-2023-02-13-13-50-593-g48de1df158c9) is fine as well. The merge of mm-nonmm-stable into linux-next (v6.2-rc7-12363-g214c8cfc3507) is also fine. However, the merge of mm-everything into linux-next) is broken. Overall, that suggests that there may have been a change somewhere else in the kernel which is incompatible with a change in one of the mm branches. It is interesting that the problem in next-20230210 was seen after the merge of mm-stable, and that it is now seen after the merge of mm-everything. Guenter --- # bad: [09e41676e35ab06e4bce8870ea3bf1f191c3cb90] Add linux-next specific files for 20230213 # good: [4ec5183ec48656cec489c49f989c508b68b518e3] Linux 6.2-rc7 git bisect start 'HEAD' 'v6.2-rc7' # good: [8b065aee8dfbecc978324b204fc897168c9adcd0] Merge branch 'master' of git://git.kernel.org/pub/scm/linux/kernel/git/herbert/cryptodev-2.6.git git bisect good 8b065aee8dfbecc978324b204fc897168c9adcd0 # good: [72655d7bf4966cc46ac85ef74b26eb74e251ae4a] Merge branch 'rcu/next' of git://git.kernel.org/pub/scm/linux/kernel/git/paulmck/linux-rcu.git git bisect good 72655d7bf4966cc46ac85ef74b26eb74e251ae4a # good: [11b208f696c4111c8bd66863b8306d7857266e4c] Merge branch 'staging-next' of git://git.kernel.org/pub/scm/linux/kernel/git/gregkh/staging.git git bisect good 11b208f696c4111c8bd66863b8306d7857266e4c # good: [d69b9b369439219613ca6df66745217f1f56a533] Merge branch 'for-next' of git://git.kernel.org/pub/scm/linux/kernel/git/rppt/memblock.git git bisect good d69b9b369439219613ca6df66745217f1f56a533 # good: [37598f5a9d8b63b91cce0cb6bac5f6374ed1bb80] mlock: convert mlock to vma iterator git bisect good 37598f5a9d8b63b91cce0cb6bac5f6374ed1bb80 # good: [1c2080951a87c3f146c9f9f837ec3c877d4a3c87] Merge branch 'mm-nonmm-unstable' into mm-everything git bisect good 1c2080951a87c3f146c9f9f837ec3c877d4a3c87 # good: [d1b7f15191d2c203b48eff421f65effce20faa4b] Merge branch 'for-next' of git://git.kernel.org/pub/scm/linux/kernel/git/krisman/unicode.git git bisect good d1b7f15191d2c203b48eff421f65effce20faa4b # good: [7223173e7652230265ba89c5a12eacab1d416797] Merge branch 'bitmap-for-next' of https://github.com/norov/linux.git git bisect good 7223173e7652230265ba89c5a12eacab1d416797 # good: [70d207cb345c41262a24973e1a40f5015c2c309f] Merge branch 'for-next/kspp' of git://git.kernel.org/pub/scm/linux/kernel/git/kees/linux.git git bisect good 70d207cb345c41262a24973e1a40f5015c2c309f # good: [84798f2849942bb5e8817417adfdfa6241df2835] iommufd: Add three missing structures in ucmd_buffer git bisect good 84798f2849942bb5e8817417adfdfa6241df2835 # good: [e5773cfccc0b3c35cef89129f45087d43c136a2d] Merge branch 'for-next/kspp' of git://git.kernel.org/pub/scm/linux/kernel/git/gustavoars/linux.git git bisect good e5773cfccc0b3c35cef89129f45087d43c136a2d # good: [77ce632bfb804e4d71bd7aa106cc5b10f164cb14] Merge branch 'for-next' of git://git.kernel.org/pub/scm/linux/kernel/git/jgg/iommufd.git git bisect good 77ce632bfb804e4d71bd7aa106cc5b10f164cb14 # good: [214c8cfc350729dcce2f2e6d228b996ff568626c] Merge branch 'mm-nonmm-stable' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm git bisect good 214c8cfc350729dcce2f2e6d228b996ff568626c # bad: [a037e6164093ebb92745768a59e1e2ff8c731d57] Merge branch 'mm-everything' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm git bisect bad a037e6164093ebb92745768a59e1e2ff8c731d57 # first bad commit: [a037e6164093ebb92745768a59e1e2ff8c731d57] Merge branch 'mm-everything' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm