From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8C371D5B86D for ; Tue, 29 Oct 2024 21:04:07 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0886C6B0096; Tue, 29 Oct 2024 17:04:07 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 037BE6B0099; Tue, 29 Oct 2024 17:04:06 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E1B296B009A; Tue, 29 Oct 2024 17:04:06 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id C1E0F6B0096 for ; Tue, 29 Oct 2024 17:04:06 -0400 (EDT) Received: from smtpin08.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 41255A068C for ; Tue, 29 Oct 2024 21:04:06 +0000 (UTC) X-FDA: 82727866158.08.7F85622 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by imf09.hostedemail.com (Postfix) with ESMTP id BB8B0140006 for ; Tue, 29 Oct 2024 21:03:46 +0000 (UTC) Authentication-Results: imf09.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=NsygaHiB; spf=pass (imf09.hostedemail.com: domain of jstancek@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=jstancek@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1730235764; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=TfD1DetZzLaBym84XosC3+P3GN+QnX7QF0+o66GGJ4Y=; b=ogYPeQrxAyswDSwJGfDkAfg6Fx1KJAi0bqgOn/BWMHimtWr5dLcBUOv2035DtISDxXos4X u6WzImdNnpVieFWCoqCuTNeuperjQSHLMD8Tg4i4CIntD01b7JICfmQI0inTFpz57mkv9G MAfmg+XJRqc5OeTQR0OTwwI6T4HvOls= ARC-Authentication-Results: i=1; imf09.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=NsygaHiB; spf=pass (imf09.hostedemail.com: domain of jstancek@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=jstancek@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1730235764; a=rsa-sha256; cv=none; b=TmLb365dOO9IKw4nyO+nOdO6pDoRepCKaxUVzjfjP2SzoKwB37VaYpgevKnC90Jxb7kJcg zvBmKR6AUDsAL/arwfvb7hXN8YPO/3cZtzMqSeQZuF9fOidm9ZTpFdfQupP1yw0ntDJkTa Qy3CGZLMYYjfbWrnsQGKKkkVuBRbSec= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1730235843; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TfD1DetZzLaBym84XosC3+P3GN+QnX7QF0+o66GGJ4Y=; b=NsygaHiBDam2uEYYYXmc3zdHNwiU5i1+ZXQSRzl5p9HG36A0j4tZYMNvMK4mxkeYJ9A7A+ FdSV1Kfn58vlLpwyJbd35/g0yfqZF+n1D4qBVO5rb2qXl9ldT/8QBL7Jy5s51y4EcS+Dzv ZJl5fVyPZjvZu1YKBKupNlUKQKGuWDY= Received: from mail-oa1-f72.google.com (mail-oa1-f72.google.com [209.85.160.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-682-YfwX9sVuMT6jC52wC-GulA-1; Tue, 29 Oct 2024 17:04:00 -0400 X-MC-Unique: YfwX9sVuMT6jC52wC-GulA-1 Received: by mail-oa1-f72.google.com with SMTP id 586e51a60fabf-2886446d741so339641fac.1 for ; Tue, 29 Oct 2024 14:04:00 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1730235839; x=1730840639; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=TfD1DetZzLaBym84XosC3+P3GN+QnX7QF0+o66GGJ4Y=; b=DD3pfHfwDnZEvRfOzvuwVCfzuhRmJC70DWTeLuzmofDxvw87Tk9AR6zUjRdIgFYAwO 9aL92QrJp4Rj1dYV1Gps++ycXq5wJhFPWbjjL3ZJmw78UhcRWvxLKU9ta8YGyo4QSUJD 1Vc3/g7Z/C5zekfrGkgZFINv+Cw6oLc0kWqKXYpffSOFtrxV0WfKFYvuH4ABLmZmkQ2l mB60GFeJOWML51vMRR86xTnOASDbytuv2cdTADFR8eGW6ocp8ej7pLY6Ip7kLy5sBDOO qVMR277AdOcvYIe69Ulfm/ya1Z74qJA39FPZuhSSnY298ygk1MI1Sbz/GzXH5SFnaGoW 7yJw== X-Forwarded-Encrypted: i=1; AJvYcCVgis40DxbixktG7/hctMQD4SIKsxryQgBFlRQnUvCjmIOPpnBoeYatoulmyt0kv1q+EUp0e56cUQ==@kvack.org X-Gm-Message-State: AOJu0YxJIIViVsPkDuuqIhW1PiwjFLlkf43tqu91AvmUh5cdMW0ODxvK Ev7gkR930V9NNZWMRCUAeBQnroTOwYk2503BhW68hpe8jv+ETkprF4r1l0Xtf9ch/iGQyDrr1cu mkuHQu+tZmax45+iHTpHGsrR3MZf0Skgksg8Uz7lbx1IsGXs0bRJRMdYM/Q7ExioxL3jVgX/r2d Kqtbmoy1XzQIeJ2DwG4FECJYE= X-Received: by 2002:a05:6870:170e:b0:254:b337:eeb5 with SMTP id 586e51a60fabf-291046e55e9mr2141492fac.18.1730235839605; Tue, 29 Oct 2024 14:03:59 -0700 (PDT) X-Google-Smtp-Source: AGHT+IF0FaW9744QqAdp6tEpgnXEx1lws0uvXXj2TggY33DwbU5PmIv1EIXwfn9y+mGEbsu/hkZQkYALRP7zpxZl5Xc= X-Received: by 2002:a05:6870:170e:b0:254:b337:eeb5 with SMTP id 586e51a60fabf-291046e55e9mr2141481fac.18.1730235839304; Tue, 29 Oct 2024 14:03:59 -0700 (PDT) MIME-Version: 1.0 References: <525593F0-1AA8-4BCB-9B6D-630505C49F10@nvidia.com> In-Reply-To: From: Jan Stancek Date: Tue, 29 Oct 2024 22:03:31 +0100 Message-ID: Subject: Re: [bug] aarch64 host no longer boots after 767507654c22 ("arch_numa: switch over to numa_memblks") To: Mike Rapoport Cc: Zi Yan , linux-mm@kvack.org, Linux ARM , Jonathan.Cameron@huawei.com, dan.j.williams@intel.com, David Hildenbrand , linux-tegra@vger.kernel.org, Thierry Reding , Jonathan Hunter X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Server: rspam03 X-Rspam-User: X-Rspamd-Queue-Id: BB8B0140006 X-Stat-Signature: 3sfs89kw8yu6bkbkq51ppxywcjs84pdu X-HE-Tag: 1730235826-635174 X-HE-Meta: U2FsdGVkX1/pnpY0Zm7wwHJaXcOhyt/bxcFN83J2jv81HyE3GgyzpQ5A/41dvP9b4To5FXNqT50mWYEJlsvN/miC32w9t9J/KkKnIS72TrmMlEanggDt94IxFZj/brIJjxta3VbyDT2whyb8YThjn6+D4tF5OZ25WOScrU8xUCjqyo2LapvkvQc3nHBlJisv6OG5aNSqid4iCsWF+C9OaJKEDkKTtaVpAeFHE1z9VdTUg0xbi/87rYAarJ3HPIyo0tptIncG7Y2Bgghf4NXcdJreiv01Q/NWybsLurW5g3J01UwRsQ36TEGP2vrSQrRMx6/c+IdEZfOOzS+eK5vy1gxAvRS1ChDEYHOX46+3miih7q0BDoTliMxvqi+mUCz8xJ9qxxt7IsTJOlAgDcR0nENcJYqlB8FqHFQSz4iB4h9hEpC2gfbc5cFvTvfug6JfLDwlvZAELcy40elP19Yf4kjrCjqvwUn4KDZ4OHoZABDM9EtWsJpwE45iNMsJUFm0N6pp63FtheSfFbT1Zzfd0Dhj1Qr82pVbA/O6l2h5+8HlNYSPjvjjEAR/aS5eQtNPIxJugC+Fo0lbjaBwQR9GQIJk2lbW1nakXvXdK++ptwtsnlBTLSYr8hpJ/V7bBOZdmoCVFkBmLP+pm7YhNMEjJQyMHB3Xjv8F3syIbxCvpZqfSeGgMrYutMhJ3mk7XUpx8bpwK7FxnOT4nRPdacHLC8nq7r4RZuUkd/2GvRLCUsi2Ibu0KJUL5FyeOOA+sLMk2MSSXomUfGds+2GxvMcGlPpvEYna1mQV405p8HRH3a48P68p0ot7arvW22nGNfkf98CA6sMhtik+IgX/d7kJlssg2tfJrvRZsQJ28ziks/AieWGO6+6uG5Vxi5Hi7pwnmc/W+OQ0sNF7JzeMIbDssaib/IxLxAVqNvTXC8lVtiIPtgrjRfi7UigHiC29dgJcGBRkh1+2NI+CEgJUr5Z a9Z4Uj6U NManv7G3MGnsdOeF/JTm6DpnXh4tZBLVhB97g2AWGIF5rYRKT7LZxzK7dOjgFtNNNxwW+Oyjd6nGRcnfGKCkIGQzEyGJUCgg4553NlMN4eMDKv8E0bAjh6/1pGpL2/wBNl+gGil9QZy8v3FZxV3SExFGfefzY25nk4NosByKL4nQgHuBE3zSowroyDwotp9zW7K8ARjOlfExEHkxI1UBZpNyqQuIRE278h2pfPD8pgHa4p3nt8J327TkrnQIF5NV16GifIS609EBvmjhXGifW0ocDlVQSG33CYaWx+Ht7TXFrpQqxBm59mjoQStBNUzxAS5wmRUOdlBnqJ+J1iN7mWAfG7cEect56Q4fPxC6xPqmNB3MrSwJrBxhGJdEn+LNnJUU9x1Hb2vclbz01Jy9Z/XuCADTgz1Isl5Wq4dsZFazU61L6yrcXDJp8hpDQEmFQ/QlwLb6NxIR7x5UdLYcnRrj3jBT1SrDSSKSD0zTDy0YY9MwDnTZVn6QaCeB5tHfuJy5ZhvUs5DlrDhL/1W25rgxoJA== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Tue, Oct 29, 2024 at 5:24=E2=80=AFPM Mike Rapoport wro= te: > > On Tue, Oct 29, 2024 at 04:43:39PM +0100, Jan Stancek wrote: > > On Tue, Oct 29, 2024 at 4:07=E2=80=AFPM Zi Yan wrote: > > > > > > +tegra mailing list and maintainers > > > > > > On 29 Oct 2024, at 8:47, Jan Stancek wrote: > > > > > > > Hi, > > > > > > > > I'm seeing a regression on Nvidia IGX system, which no longer boots= . > > > > > > > > bisect points at commit 767507654c22 ("arch_numa: switch over to nu= ma_memblks"). > > > > It hangs very early, with 4k or 64k pages, with no kernel messages = printed: > > > > > > > > EFI stub: Booting Linux Kernel... > > > > EFI stub: Using DTB from configuration table > > > > EFI stub: Exiting boot services... > > > > > > > > > > > > > > Is it possible to have earlycon output? It is hard to debug without a= ny > > > information except kernel fails to boot. > > > > I know it was a long shot, so far I haven't had luck getting it to work= . > > Does it boot with numa=3Doff and numa=3Dfake? No, it doesn't. > > In the log from successful boot it seems there is no NUMA information in > the device tree, can you send the device tree as well please? https://people.redhat.com/jstancek/aarch64_numa_boot/device_tree Regards, Jan > > > > Since the previous commit boots and I assume both kernels are compile= d > > > with the same gcc toolchain, this should not be caused by the binuils > > > bug in 2.42[1]. Is your binutils version 2.42? > > > > Yes, both are compiled locally, with binutils 2.41 > > > > > > > > Thanks. > > > > > > > > > [1] https://sourceware.org/bugzilla/show_bug.cgi?id=3D31924 > > > > > > > Here's a log from successful boot with previous commit: > > > > https://people.redhat.com/jstancek/aarch64_numa_boot/console-log-go= od.txt > > > > and config: https://people.redhat.com/jstancek/aarch64_numa_boot/co= nfig > > > > > > > > # lscpu > > > > Architecture: aarch64 > > > > CPU op-mode(s): 32-bit, 64-bit > > > > Byte Order: Little Endian > > > > CPU(s): 12 > > > > On-line CPU(s) list: 0-11 > > > > Vendor ID: ARM > > > > BIOS Vendor ID: NVIDIA > > > > Model name: Cortex-A78AE > > > > BIOS Model name: Not Specified Not Specified CPU @ 0.0GHz > > > > BIOS CPU family: 257 > > > > Model: 1 > > > > Thread(s) per core: 1 > > > > Core(s) per cluster: 12 > > > > Socket(s): 1 > > > > Cluster(s): 1 > > > > Stepping: r0p1 > > > > CPU(s) scaling MHz: 100% > > > > CPU max MHz: 1971.2000 > > > > CPU min MHz: 115.2000 > > > > BogoMIPS: 62.50 > > > > Flags: fp asimd evtstrm aes pmull sha1 sha2 crc3= 2 > > > > atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp uscat ilrcp= c > > > > flagm paca pacg > > > > Caches (sum of all): > > > > L1d: 768 KiB (12 instances) > > > > L1i: 768 KiB (12 instances) > > > > L2: 3 MiB (12 instances) > > > > L3: 6 MiB (3 instances) > > > > NUMA: > > > > NUMA node(s): 1 > > > > NUMA node0 CPU(s): 0-11 > > > > Vulnerabilities: > > > > Gather data sampling: Not affected > > > > Itlb multihit: Not affected > > > > L1tf: Not affected > > > > Mds: Not affected > > > > Meltdown: Not affected > > > > Mmio stale data: Not affected > > > > Reg file data sampling: Not affected > > > > Retbleed: Not affected > > > > Spec rstack overflow: Not affected > > > > Spec store bypass: Mitigation; Speculative Store Bypass > > > > disabled via prctl > > > > Spectre v1: Mitigation; __user pointer sanitization > > > > Spectre v2: Mitigation; CSV2, BHB > > > > Srbds: Not affected > > > > Tsx async abort: Not affected > > > > > > > > Regards, > > > > Jan > > > > > > > > > Best Regards, > > > Yan, Zi > > > > > > > -- > Sincerely yours, > Mike. >