From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-1.0 required=3.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 51780C4360F for ; Fri, 1 Mar 2019 23:24:13 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id DB0AF2083E for ; Fri, 1 Mar 2019 23:24:12 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=intel-com.20150623.gappssmtp.com header.i=@intel-com.20150623.gappssmtp.com header.b="LrEuuV+I" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org DB0AF2083E Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=intel.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 439D98E0003; Fri, 1 Mar 2019 18:24:12 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 3E8AC8E0001; Fri, 1 Mar 2019 18:24:12 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 2FF588E0003; Fri, 1 Mar 2019 18:24:12 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from mail-ot1-f72.google.com (mail-ot1-f72.google.com [209.85.210.72]) by kanga.kvack.org (Postfix) with ESMTP id 015938E0001 for ; Fri, 1 Mar 2019 18:24:12 -0500 (EST) Received: by mail-ot1-f72.google.com with SMTP id b10so11122979oti.21 for ; Fri, 01 Mar 2019 15:24:11 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:dkim-signature:mime-version:references :in-reply-to:from:date:message-id:subject:to:cc; bh=e/UacENV4WbTWn1Wv4mMZSa64/NkU5mKPQz23H0xeho=; b=eHdae6J3Ti1bov9khOYk5BSTTblY1rRabMFTlPF5F+U6WbyAfFNqc/0hj7TB+cPvz/ LyEU9RCH+G82bqfG6hJl3n7YXzOTIoidUCGBZCRHF3G53Uq9fW3sLWYE0jZI3DCzqfsh TD1o3PH05r2qtusDPoeJv4kJtwiYOk073DGqf2JLh+D6W4y0khHMc6hzIG4/Xa/h/qqX 20hPVlPVFdDigUNswW8JbYFPkglsn8NYOUg3mUsYcGJ/3gZqzuViSfb5MTY1YLrHcfTs kYm/R22VMe1RoqXWjUYKMiMNmV5RzIgStXOyBhUikAqA850g1AV5pwpom/lOcvgOswKT z6nQ== X-Gm-Message-State: APjAAAXZC0YZPUVnHM6rcMfgstxuBf1/9MRMHaphzV3QGYAxwaePV/e2 ylGzjlzWSlmAFTJWII7KE4JP9JXzDUAAYEF22sIA8xHrE/qFOzFfBKe9bSuSQQetgs1Wu9CuAXc /4xI85WYaVMTruzFIDKnCUuBYlmcq5O7ZNE1SPFZxkSFd2dQzkCxUTyH5htHoZrI2fdtWwwVXuh hpCSJYxEqTJElBU5Ib5kDmZlPaDXUvKccOKFDUiomO321T9ro71aQGdXt6nB3xhANfMxNwpGU19 bgngRbJN0dLteBY8Nq0qOr5/fvVXvf0nB59DFESJJ3WEOGhNAbzMe1ZVMe/XKp3TmoIj7GGrDgT xoJry2Ps7Gxs3hirTA0SygkT8lTP6n/lsmhjxK63CAZp7olr8a/FHwAYNNo5KIkhbQkNWwAM3b5 r X-Received: by 2002:a9d:6285:: with SMTP id x5mr4845082otk.13.1551482651661; Fri, 01 Mar 2019 15:24:11 -0800 (PST) X-Received: by 2002:a9d:6285:: with SMTP id x5mr4845044otk.13.1551482650462; Fri, 01 Mar 2019 15:24:10 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1551482650; cv=none; d=google.com; s=arc-20160816; b=BMk18wATmEBfe8QvjDcbu6h6km4rE3sar5lBPpXSCW7FXhcUsCN0/QYdstk15SXipR omDsBckC9WTCcFfq4Z7ShjU384NDMCOen8PqldhZ+yKCkatEwIgjLjPY3B7U52jKp+5T CroKgGAj2QIqz01Ph52Bobdy6uImMzp+BjIZp3qDKjJXAAGY6w4/BUP5XYlenmD/IBao ycFaD9nZBCn6kxM6/f39rMPbH1mDmH0ON1JfB1xkHU53Nt8R393WrdX9YWDw/NzgYQIE 4gk/0yWHesjwUaT+qdskzPXfTIgOsthK/HD6qNXdTba6nDBCC+XEIadc7AH9QItQSN49 NZIQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=e/UacENV4WbTWn1Wv4mMZSa64/NkU5mKPQz23H0xeho=; b=vHXkWK8DnIZc13gPEEm7dYMfxUg2cM3eeEZGaLPnWzxej7Gp6FsC6x9D6mYMhK0VD8 zs8RqRKhS/PcknTc/LyYgux0ID1UzWy05ONUw9lcwjDBZYcbdaAQojS4sqpR4NYA09Mh 8wKhLJJzuDGZedcvlLnif0hGKig812c6ENQtgNFyzOwzNF9AU88K+Ly7Wr7kVgNm2sg6 kIBfB5c7gZz60EKzwEgFYZHJ+V5A6bXKWHPj51gl51EJrf7WskpmfiiN6GZL1FA+GHCr m9225D7/BTjNi1Q986cM7BJH1l9RS/r4qEQxCANiBKUqO3p3LGHkXJbV3rRb3z+cgWOs lMSw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@intel-com.20150623.gappssmtp.com header.s=20150623 header.b=LrEuuV+I; spf=pass (google.com: domain of dan.j.williams@intel.com designates 209.85.220.65 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com Received: from mail-sor-f65.google.com (mail-sor-f65.google.com. [209.85.220.65]) by mx.google.com with SMTPS id b191sor9170401oih.123.2019.03.01.15.24.09 for (Google Transport Security); Fri, 01 Mar 2019 15:24:10 -0800 (PST) Received-SPF: pass (google.com: domain of dan.j.williams@intel.com designates 209.85.220.65 as permitted sender) client-ip=209.85.220.65; Authentication-Results: mx.google.com; dkim=pass header.i=@intel-com.20150623.gappssmtp.com header.s=20150623 header.b=LrEuuV+I; spf=pass (google.com: domain of dan.j.williams@intel.com designates 209.85.220.65 as permitted sender) smtp.mailfrom=dan.j.williams@intel.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=intel.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=e/UacENV4WbTWn1Wv4mMZSa64/NkU5mKPQz23H0xeho=; b=LrEuuV+IJvMczvVVPcuvT5TWXSzjpQ/ZEYOa3ATCb0IGPlZI6PBIoEIhD2d4SaF+6B ER4xENxMb5DXuN+04gnHDtjX7ExDvGPsuVvFpMJMyjeRIeGALodtjrGulXXKqcGTMzO+ ZejNO74xfPy6yS1rGx6ZriPwFoa0Cpw5R1BUdKxm6MugC+Istff/AfN79pWSWddriD5v yEwAnelOnso5ntUkTpx5I+jqkZNhQlR7MG55obCnTDDjMEOb7394kwg+WZs7lZL8OSf0 2oIHnrQK4+Fm1PgC1yStNInxU+VT8HkTBW5Nb9RPWVn7QrSnte0JCEYrQGYp1oRj7EyU xQQQ== X-Google-Smtp-Source: APXvYqxYvcFwspRUzJfzOBv3qA35nU7UHDvw0dm0OA2N3TnJ0A6UpkfhFLloJaDEc2+G0X+4yC4DtRjHLHdFvHFwRjE= X-Received: by 2002:aca:cc0f:: with SMTP id c15mr5285857oig.105.1551482649622; Fri, 01 Mar 2019 15:24:09 -0800 (PST) MIME-Version: 1.0 References: <5c6702da.1c69fb81.12a14.4ece@mx.google.com> <20190215104325.039dbbd9c3bfb35b95f9247b@linux-foundation.org> <20190215185151.GG7897@sirena.org.uk> <20190226155948.299aa894a5576e61dda3e5aa@linux-foundation.org> <20190228151438.fc44921e66f2f5d393c8d7b4@linux-foundation.org> <026b5082-32f2-e813-5396-e4a148c813ea@collabora.com> <20190301124100.62a02e2f622ff6b5f178a7c3@linux-foundation.org> <3fafb552-ae75-6f63-453c-0d0e57d818f3@collabora.com> In-Reply-To: <3fafb552-ae75-6f63-453c-0d0e57d818f3@collabora.com> From: Dan Williams Date: Fri, 1 Mar 2019 15:23:58 -0800 Message-ID: Subject: Re: next/master boot bisection: next-20190215 on beaglebone-black To: Guillaume Tucker Cc: Andrew Morton , Michal Hocko , Mark Brown , Tomeu Vizoso , Matt Hart , Stephen Rothwell , khilman@baylibre.com, enric.balletbo@collabora.com, Nicholas Piggin , Dominik Brodowski , Masahiro Yamada , Kees Cook , Adrian Reber , Linux Kernel Mailing List , Johannes Weiner , Linux MM , Mathieu Desnoyers , Richard Guy Briggs , "Peter Zijlstra (Intel)" , info@kernelci.org Content-Type: text/plain; charset="UTF-8" X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, Mar 1, 2019 at 1:05 PM Guillaume Tucker wrote: > > On 01/03/2019 20:41, Andrew Morton wrote: > > On Fri, 1 Mar 2019 09:25:24 +0100 Guillaume Tucker wrote: > > > >>>>> Michal had asked if the free space accounting fix up addressed this > >>>>> boot regression? I was awaiting word on that. > >>>> > >>>> hm, does bot@kernelci.org actually read emails? Let's try info@ as well.. > >> > >> bot@kernelci.org is not person, it's a send-only account for > >> automated reports. So no, it doesn't read emails. > >> > >> I guess the tricky point here is that the authors of the commits > >> found by bisections may not always have the hardware needed to > >> reproduce the problem. So it needs to be dealt with on a > >> case-by-case basis: sometimes they do have the hardware, > >> sometimes someone else on the list or on CC does, and sometimes > >> it's better for the people who have access to the test lab which > >> ran the KernelCI test to deal with it. > >> > >> This case seems to fall into the last category. As I have access > >> to the Collabora lab, I can do some quick checks to confirm > >> whether the proposed patch does fix the issue. I hadn't realised > >> that someone was waiting for this to happen, especially as the > >> BeagleBone Black is a very common platform. Sorry about that, > >> I'll take a look today. > >> > >> It may be a nice feature to be able to give access to the > >> KernelCI test infrastructure to anyone who wants to debug an > >> issue reported by KernelCI or verify a fix, so they won't need to > >> have the hardware locally. Something to think about for the > >> future. > > > > Thanks, that all sounds good. > > > >>>> Is it possible to determine whether this regression is still present in > >>>> current linux-next? > >> > >> I'll try to re-apply the patch that caused the issue, then see if > >> the suggested change fixes it. As far as the current linux-next > >> master branch is concerned, KernelCI boot tests are passing fine > >> on that platform. > > > > They would, because I dropped > > mm-shuffle-default-enable-all-shuffling.patch, so your tests presumably > > now have shuffling disabled. > > > > Is it possible to add the below to linux-next and try again? > > I've actually already done that, and essentially the issue can > still be reproduced by applying that patch. See this branch: > > https://gitlab.collabora.com/gtucker/linux/commits/next-20190301-beaglebone-black-debug > > next-20190301 boots fine but the head fails, using > multi_v7_defconfig + SMP=n in both cases and > SHUFFLE_PAGE_ALLOCATOR=y enabled in the 2nd case as a result > of the change in the default value. > > The change suggested by Michal Hocko on Feb 15th has now been > applied in linux-next, it's part of this commit but as > explained above it does not actually resolve the boot failure: > > 98cf198ee8ce mm: move buddy list manipulations into helpers > > I can send more details on Monday and do a bit of debugging to > help narrowing down the problem. Please let me know if > there's anything in particular that would seem be worth > trying. > Thanks for taking a look! Some questions when you get a chance: Is there an early-printk facility that can be turned on to see how far we get in the boot? Do any of the QEMU machine types [1] approximate this board? I.e. so I might be able to independently debug. Were there any boot *successes* on ARM with shuffling enabled? I.e. clues about what's different about the specific memory setup for beagle-bone-black. Thanks for the help! [1]: https://wiki.qemu.org/Documentation/Platforms/ARM