From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id AE931D3A66B for ; Tue, 29 Oct 2024 15:44:01 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 3912E6B0092; Tue, 29 Oct 2024 11:44:01 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 340B36B0093; Tue, 29 Oct 2024 11:44:01 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 1E1506B0095; Tue, 29 Oct 2024 11:44:01 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id F10C76B0092 for ; Tue, 29 Oct 2024 11:44:00 -0400 (EDT) Received: from smtpin30.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 8520412133C for ; Tue, 29 Oct 2024 15:44:00 +0000 (UTC) X-FDA: 82727059926.30.C689B48 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by imf26.hostedemail.com (Postfix) with ESMTP id D4C18140003 for ; Tue, 29 Oct 2024 15:43:39 +0000 (UTC) Authentication-Results: imf26.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=Kh4PKJpm; spf=pass (imf26.hostedemail.com: domain of jstancek@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=jstancek@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1730216558; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=wLzrPWzlgkFiUziotVGT3esj9crGq7+1ihwfkLHXWiQ=; b=a17tLTiazpQ+7Wy0Sxj03jr79BfawM+g4/Bq/zN0DVIqo0uupzORPvdGC3GjBgNI9HEZ23 VJTtseefP8V8E6MsYD1GUwgjxI9nDJlNCWcm6QvhjHz11SIa0OSYXd0/MmMqHjXwy8RZxn a/S4HtSCJT9UrdHzukJUO0jSQB2YDBU= ARC-Authentication-Results: i=1; imf26.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=Kh4PKJpm; spf=pass (imf26.hostedemail.com: domain of jstancek@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=jstancek@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1730216558; a=rsa-sha256; cv=none; b=euPgU/TVTkBO0MtnDGMcbgSkAb3r663qXB6FbFSe8R/zvWVwvVve0e7VPKdWlZAGClsnkg qpjpMUZXSSpJTil/vs7ECMU1of8v1tX20KWMmEgsJKpg1HYbviWwbYg/R81eewborLqrnT ofOHHxY70J9g7OCdxfrDcyzIG6w0uBw= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1730216637; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wLzrPWzlgkFiUziotVGT3esj9crGq7+1ihwfkLHXWiQ=; b=Kh4PKJpmaeb7jNd3ht8kt45aItCYKAuDzhIzBjj04QQyw4jpKS5IOtjNRxcy/dP96xNuoK lRUYVdfZ2lNnMk7V2Iuwf8shIZtgf2/luP9c18KHXEKMmsPa0yC+ug4F0oR9jov8EtWF09 yhLfP1b4DXuGUv6htYZogJMK/IeNs0Y= Received: from mail-oa1-f72.google.com (mail-oa1-f72.google.com [209.85.160.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-323-H2IrtrcAPre4NEyiMdu3vg-1; Tue, 29 Oct 2024 11:43:56 -0400 X-MC-Unique: H2IrtrcAPre4NEyiMdu3vg-1 Received: by mail-oa1-f72.google.com with SMTP id 586e51a60fabf-286efde9783so5964044fac.0 for ; Tue, 29 Oct 2024 08:43:56 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1730216635; x=1730821435; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=wLzrPWzlgkFiUziotVGT3esj9crGq7+1ihwfkLHXWiQ=; b=UnAejOBFjRPgCYVeitEhdtUo0UtO5wKJSqlATbEXh5xAkSzTqli3e7ZZ3LWaPKZCgo IV5J5PmeQeOVGgJsVHzzof2Z6tBp//3CDhpEvcOm0dGTrFdQI4bFUPAOZRwPAPnxHCCo ACo89Vs9jN4CXeEMabvZWGCz1DypvO603qdxRfsWcetUZQdjCXEOJrFKVSzq5+iPret0 fniVBwPaUlUTJHz6XQOEYbcDq0cY0lNsCV5Rs8+vYliS9nOSlHLlxgizENWeE0Jl82z2 1KCFPBEgipSMD+Yw1VsZ0/ONfBun8+O5vLYE9oHbbykqBCCI9jh4dJxnUsNZpVbYNlK0 vIqA== X-Forwarded-Encrypted: i=1; AJvYcCWI16VT9ImK4tJypwlGPeq1ppDj+Bd0hw+RQ1jp5tI0vK7MVrlH/+TvtDn/hh51sGdwsD+HwlitMQ==@kvack.org X-Gm-Message-State: AOJu0YxiyTG7Gpwho2FBoGUsK8YOIzDvCuasPq+eBDyqrwPD6ToSZoo6 mIT/6/F6nIi9v3Bskwm1yq4MJ9Yfv3juF/n0h3LnrlLVG0YUZXlGta6zEpAD9oTRVXMyChP419d jgB3DO9fwXqfPd8GlBMyTsqXI9djCP1xZqTU5xbfqzGZIrWBvVtFHq2KHq2lFyqpqwW18OFRnFs ZM1zu0O594rnFaxqzRqiEV6wA= X-Received: by 2002:a05:6870:c0cc:b0:268:2efa:2de0 with SMTP id 586e51a60fabf-29051b7d295mr10756358fac.13.1730216635498; Tue, 29 Oct 2024 08:43:55 -0700 (PDT) X-Google-Smtp-Source: AGHT+IHTdBdezoJ7VG3vDcy5K8pvqtBHt690NWETS+sPu3lYdLD78vt8pfHXNLZWYN26LTrmH4wgdkvUV70KRX6avfM= X-Received: by 2002:a05:6870:c0cc:b0:268:2efa:2de0 with SMTP id 586e51a60fabf-29051b7d295mr10756341fac.13.1730216635261; Tue, 29 Oct 2024 08:43:55 -0700 (PDT) MIME-Version: 1.0 References: <525593F0-1AA8-4BCB-9B6D-630505C49F10@nvidia.com> In-Reply-To: <525593F0-1AA8-4BCB-9B6D-630505C49F10@nvidia.com> From: Jan Stancek Date: Tue, 29 Oct 2024 16:43:39 +0100 Message-ID: Subject: Re: [bug] aarch64 host no longer boots after 767507654c22 ("arch_numa: switch over to numa_memblks") To: Zi Yan Cc: rppt@kernel.org, linux-mm@kvack.org, Linux ARM , Jonathan.Cameron@huawei.com, dan.j.williams@intel.com, David Hildenbrand , linux-tegra@vger.kernel.org, Thierry Reding , Jonathan Hunter X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Server: rspam03 X-Rspam-User: X-Rspamd-Queue-Id: D4C18140003 X-Stat-Signature: w5zexufjetufsghepqy9g18qnbjds5ye X-HE-Tag: 1730216619-996353 X-HE-Meta: U2FsdGVkX18K0SblFlT9q45jpjM0DTy5Se1pEttRbyqLP1648UTdNC5jFFAeSN188g+4vEYsNp26eYgJxLfbym9iFLtoqEhXVxUiZwZk4YbZr5Q+ZY+6TuOONPs+DQwpFWL/U7M/niJDwwNo7xRyOiZtMdUe5sY7yNRuZwbcMBjIMp4BiVue8d64wXztVaqZiK65W+XysapPtsdG5CFbVdog0E/v2/khmSaBh4G4VZe9UCTw8JKkkGrFe7TiNJxf7iDXazNLXWSfTk3VCVL3tT9kQ4QcCFJ35Z21WWDeYewsxe2fQH0NkNrOQ9/HcB1hFWm25UQC8+NT2ml0IyW5Pvthy6/Mge0YIeuY0kjnkLEuLaBRlkachs/1RXzCrMroefJCGiGi6h874ax17M80ZpOHAFLOtO2oXKbLtPm5PrfJn6uewPaeJ2LGVu1Q+GVCiFiO5jJf4FThqnNZO9vSm0dgwNBnuKv6V41bu2Vf40Apz/HTgO6faDbZ0r045mtIBStavsrQhGrRn2A+f2YhnZYmCow0ZeqBMavMah91+0DejOMmT1U9I9RkDiGIeMtTUg1aAIPbL/54WYzeYAXPcmmCWOxVa2F2mCCq9WVn+lUEmC+MGdg7bYTuJu8QseF4xXAoP5uxpGqIdF4P9zeV3LaxkW9pfWuxHfRZ9AW41fqCtZEe2392d3eouBZox3ovJnMpPRYALf/r8C8hTyFNPn8A9e89556yr3uqy2Glz0z6B7ICkW+R4r96zYRiCsihfejHdj8hXNgUO9fU2arNL0pCvd9AHA13orTbqUlOUlahrSIsNe5/aE3TOqOPkcza59NAyV9T7bS4kn68wmk0IiZ/Z30WiFAIlYPIjgWX/kZDCqwZa7uGw122Z8ZZawG6Kd4lcTlimgZozjcGKS/FD7+70NjPVz3XJsdzU7+G6Wlz4sQmrJRQcoGYFd7ZRGCkDbwJiANTGcyOcwVL1PD tKF/Nr+B ahnAVv12sayafNYZo2y2qO/LzX2Um6jteNwtydK0vPU7eYxBbsOL77lwtjKsX0iX9S1ktpf7QdUNwFHLQ3xl4ndEnYHELHZLTaAgwvKZetg7zIT01+PkIxv/Ka1BTYVig8YxpBdQvuNcM6xMFOTmD0E4nKsuBh9+o1aGUaC9/7ZKKSc32qcR/I14DvB5I2wUMm3EL+Ayr8hIB9ApUriqj5N0L6SXTFfoUatrsOKlXp5k2LXoMnR7jeOftG5/EVb6gav88EkSY20Za/ZURafQ7BcHFW0I2AKEUqj7zXqArPCGIkso+mB8UymvD9CyDnsZe4/B0my4SUBTg1t6a/TXuAekkOLTxVNj5/f1WF/gKSYmDMgdvRoj34w2YEj+v/MAivBwCtSS15Z071pnLAhFvSPPUH+iA1S9W0hkmeaif/YM1j0jY6d1wYxoPwoUD5yRqu5gVYGxpx9ulZf/M+m4jT84nWHtJJQLM+hzCk948xrtBljd5IMEuh0mTNQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Tue, Oct 29, 2024 at 4:07=E2=80=AFPM Zi Yan wrote: > > +tegra mailing list and maintainers > > On 29 Oct 2024, at 8:47, Jan Stancek wrote: > > > Hi, > > > > I'm seeing a regression on Nvidia IGX system, which no longer boots. > > > > bisect points at commit 767507654c22 ("arch_numa: switch over to numa_m= emblks"). > > It hangs very early, with 4k or 64k pages, with no kernel messages prin= ted: > > > > EFI stub: Booting Linux Kernel... > > EFI stub: Using DTB from configuration table > > EFI stub: Exiting boot services... > > > > > > Is it possible to have earlycon output? It is hard to debug without any > information except kernel fails to boot. I know it was a long shot, so far I haven't had luck getting it to work. > > Since the previous commit boots and I assume both kernels are compiled > with the same gcc toolchain, this should not be caused by the binuils > bug in 2.42[1]. Is your binutils version 2.42? Yes, both are compiled locally, with binutils 2.41 > > Thanks. > > > [1] https://sourceware.org/bugzilla/show_bug.cgi?id=3D31924 > > > Here's a log from successful boot with previous commit: > > https://people.redhat.com/jstancek/aarch64_numa_boot/console-log-good.t= xt > > and config: https://people.redhat.com/jstancek/aarch64_numa_boot/config > > > > # lscpu > > Architecture: aarch64 > > CPU op-mode(s): 32-bit, 64-bit > > Byte Order: Little Endian > > CPU(s): 12 > > On-line CPU(s) list: 0-11 > > Vendor ID: ARM > > BIOS Vendor ID: NVIDIA > > Model name: Cortex-A78AE > > BIOS Model name: Not Specified Not Specified CPU @ 0.0GHz > > BIOS CPU family: 257 > > Model: 1 > > Thread(s) per core: 1 > > Core(s) per cluster: 12 > > Socket(s): 1 > > Cluster(s): 1 > > Stepping: r0p1 > > CPU(s) scaling MHz: 100% > > CPU max MHz: 1971.2000 > > CPU min MHz: 115.2000 > > BogoMIPS: 62.50 > > Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 > > atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp uscat ilrcpc > > flagm paca pacg > > Caches (sum of all): > > L1d: 768 KiB (12 instances) > > L1i: 768 KiB (12 instances) > > L2: 3 MiB (12 instances) > > L3: 6 MiB (3 instances) > > NUMA: > > NUMA node(s): 1 > > NUMA node0 CPU(s): 0-11 > > Vulnerabilities: > > Gather data sampling: Not affected > > Itlb multihit: Not affected > > L1tf: Not affected > > Mds: Not affected > > Meltdown: Not affected > > Mmio stale data: Not affected > > Reg file data sampling: Not affected > > Retbleed: Not affected > > Spec rstack overflow: Not affected > > Spec store bypass: Mitigation; Speculative Store Bypass > > disabled via prctl > > Spectre v1: Mitigation; __user pointer sanitization > > Spectre v2: Mitigation; CSV2, BHB > > Srbds: Not affected > > Tsx async abort: Not affected > > > > Regards, > > Jan > > > Best Regards, > Yan, Zi >