From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.0 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 27952C17440 for ; Tue, 12 Nov 2019 05:32:22 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id C2A2221925 for ; Tue, 12 Nov 2019 05:32:21 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=kernel.org header.i=@kernel.org header.b="VQEAIVtW" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org C2A2221925 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=linuxfoundation.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 539246B0003; Tue, 12 Nov 2019 00:32:21 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 4E9966B0005; Tue, 12 Nov 2019 00:32:21 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3FF516B0006; Tue, 12 Nov 2019 00:32:21 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0095.hostedemail.com [216.40.44.95]) by kanga.kvack.org (Postfix) with ESMTP id 28BB76B0003 for ; Tue, 12 Nov 2019 00:32:21 -0500 (EST) Received: from smtpin10.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with SMTP id C8CBF2C88 for ; Tue, 12 Nov 2019 05:32:20 +0000 (UTC) X-FDA: 76146504840.10.hour88_6bb7e54d3161c X-HE-Tag: hour88_6bb7e54d3161c X-Filterd-Recvd-Size: 12094 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by imf28.hostedemail.com (Postfix) with ESMTP for ; Tue, 12 Nov 2019 05:32:20 +0000 (UTC) Received: from localhost (83-86-89-107.cable.dynamic.v4.ziggo.nl [83.86.89.107]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 5D30D21872; Tue, 12 Nov 2019 05:32:18 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1573536739; bh=izsixCPUUYg+TYB9fiopeUypvPVLYBbs9nXFgU3tJdE=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=VQEAIVtW3dng1/K3TnY77YN/pjpezj3Byyqej7i/Nsbux6PrfD8xniAU8CGeMQkTa G6Yf66Ykb3Qz0meKZ5Smw4CVohMhecz1a5XNnu8iVrTxy/qaiRlqYp804NR2VF+juO CJu6sMKqmV033D+tl3L8xcJnJjAkO0ytrrYTgPZY= Date: Tue, 12 Nov 2019 06:17:13 +0100 From: Greg Kroah-Hartman To: Daniel =?iso-8859-1?Q?D=EDaz?= Cc: Naresh Kamboju , Sasha Levin , lkft-triage@lists.linaro.org, Dan Rue , Anders Roxell , linux- stable , open list , linux-mm@kvack.org Subject: Re: stable-rc 4.14.154-rc1/0d12dcf336c6: regressions detected in project stable v.4.14.y on OE - sanity Message-ID: <20191112051713.GB1160519@kroah.com> References: <0100016e5ae0878e-7b9d1bef-b3be-4350-8823-440929ca4a81-000000@email.amazonses.com> <20191111183059.GA1140707@kroah.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.2 (2019-09-21) Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Mon, Nov 11, 2019 at 09:19:40PM -0600, Daniel D=EDaz wrote: > Hello! >=20 > On Mon, 11 Nov 2019 at 12:58, Greg Kroah-Hartman > wrote: > > On Mon, Nov 11, 2019 at 11:45:35PM +0530, Naresh Kamboju wrote: > > > Hi Greg, > > > > > > Regressions detected in project stable v.4.14. > > > arm64, arm, x86_64 boot failed. > > > > > > Summary > > > -------------------------------------------------------------------= ----- > > > git branch: linux-4.14.y > > > git repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/= linux-stable-rc.git > > > git commit: a67492b55c53045e9c0b9969f04410723448c1ee > > > git describe: v4.14.153-104-ga67492b55c53 > > > make_kernelversion: 4.14.154-rc1 > > > kernel-config: > > > http://snapshots.linaro.org/openembedded/lkft/lkft/sumo/juno/lkft/l= inux-stable-rc-4.14/641/config > > > > > > > > > arm64 kernel crash log: > > > --------------------------- > > > [ 0.000000] Linux version 4.14.154-rc1 (oe-user@oe-host) (gcc > > > version 7.3.0 (GCC)) #1 SMP PREEMPT Mon Nov 11 17:15:34 UTC 2019 > > > [ 0.000000] Boot CPU: AArch64 Processor [410fd033] > > > [ 0.000000] Machine model: ARM Juno development board (r2) > > > [ 0.000000] earlycon: pl11 at MMIO 0x000000007ff80000 (options '= ') > > > [ 0.000000] bootconsole [pl11] enabled > > > [ 0.000000] efi: Getting EFI parameters from FDT: > > > [ 0.000000] efi: UEFI not found. > > > [ 0.000000] cma: Reserved 16 MiB at 0x00000000fe000000 > > > [ 0.000000] NUMA: No NUMA configuration found > > > [ 0.000000] NUMA: Faking a node at [mem > > > 0x0000000000000000-0x00000009ffffffff] > > > [ 0.000000] NUMA: NODE_DATA [mem 0x9fffc6f80-0x9fffc8bff] > > > [ 0.000000] Zone ranges: > > > [ 0.000000] DMA [mem 0x0000000080000000-0x00000000fffffff= f] > > > [ 0.000000] Normal [mem 0x0000000100000000-0x00000009fffffff= f] > > > [ 0.000000] Movable zone start for each node > > > [ 0.000000] Early memory node ranges > > > [ 0.000000] node 0: [mem 0x0000000080000000-0x00000000feffff= ff] > > > [ 0.000000] node 0: [mem 0x0000000880000000-0x00000009ffffff= ff] > > > [ 0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000= 009ffffffff] > > > [ 0.000000] On node 0 totalpages: 2093056 > > > [ 0.000000] DMA zone: 8192 pages used for memmap > > > [ 0.000000] DMA zone: 0 pages reserved > > > [ 0.000000] DMA zone: 520192 pages, LIFO batch:31 > > > [ 0.000000] Normal zone: 24576 pages used for memmap > > > [ 0.000000] Normal zone: 1572864 pages, LIFO batch:31 > > > [ 0.000000] psci: probing for conduit method from DT. > > > [ 0.000000] psci: PSCIv1.1 detected in firmware. > > > [ 0.000000] psci: Using standard PSCI v0.2 function IDs > > > [ 0.000000] psci: Trusted OS migration not required > > > [ 0.000000] psci: SMC Calling Convention v1.0 > > > [ 0.000000] percpu: Embedded 25 pages/cpu s62280 r8192 d31928 u1= 02400 > > > [ 0.000000] pcpu-alloc: s62280 r8192 d31928 u102400 alloc=3D25*4= 096 > > > [ 0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5 > > > [ 0.000000] Detected VIPT I-cache on CPU0 > > > [ 0.000000] CPU features: enabling workaround for ARM erratum 84= 5719 > > > [ 0.000000] Built 1 zonelists, mobility grouping on. Total page= s: 2060288 > > > [ 0.000000] Policy zone: Normal > > > [ 0.000000] Kernel command line: console=3DttyAMA0,115200n8 > > > root=3D/dev/nfs rw > > > nfsroot=3D10.66.16.123:/var/lib/lava/dispatcher/tmp/1004132/extract= -nfsrootfs-jn9hl2x_,tcp,hard,intr,vers=3D3 > > > rootwait earlycon=3Dpl011,0x7ff80000 debug systemd.log_target=3Dnul= l > > > user_debug=3D31 androidboot.hardware=3Djuno loglevel=3D9 > > > sky2.mac_address=3D0x00,0x02,0xF7,0x00,0x68,0x15 ip=3Ddhcp > > > [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) > > > [ 0.000000] software IO TLB: mapped [mem 0xf9fff000-0xfdfff000] = (64MB) > > > [ 0.000000] Memory: 8123672K/8372224K available (12988K kernel > > > code, 1878K rwdata, 5196K rodata, 1728K init, 12356K bss, 232168K > > > reserved, 16384K cma-reserved) > > > [ 0.000000] Virtual kernel memory layout: > > > [ 0.000000] modules : 0xffff000000000000 - 0xffff00000800000= 0 > > > ( 128 MB) > > > [ 0.000000] vmalloc : 0xffff000008000000 - 0xffff7dffbfff000= 0 > > > (129022 GB) > > > [ 0.000000] .text : 0xffff000008080000 - 0xffff000008d3000= 0 > > > ( 12992 KB) > > > [ 0.000000] .rodata : 0xffff000008d30000 - 0xffff00000925000= 0 > > > ( 5248 KB) > > > [ 0.000000] .init : 0xffff000009250000 - 0xffff00000940000= 0 > > > ( 1728 KB) > > > [ 0.000000] .data : 0xffff000009400000 - 0xffff0000095d5a0= 0 > > > ( 1879 KB) > > > [ 0.000000] .bss : 0xffff0000095d5a00 - 0xffff00000a1e6dd= 0 > > > ( 12357 KB) > > > [ 0.000000] fixed : 0xffff7dfffe7f9000 - 0xffff7dfffec0000= 0 > > > ( 4124 KB) > > > [ 0.000000] PCI I/O : 0xffff7dfffee00000 - 0xffff7dffffe0000= 0 > > > ( 16 MB) > > > [ 0.000000] vmemmap : 0xffff7e0000000000 - 0xffff80000000000= 0 > > > ( 2048 GB maximum) > > > [ 0.000000] 0xffff7e0000000000 - 0xffff7e002600000= 0 > > > ( 608 MB actual) > > > [ 0.000000] memory : 0xffff800000000000 - 0xffff80098000000= 0 > > > ( 38912 MB) > > > [ 0.000000] Unable to handle kernel NULL pointer dereference at > > > virtual address 00000510 > > > [ 0.000000] Mem abort info: > > > [ 0.000000] Exception class =3D DABT (current EL), IL =3D 32 b= its > > > [ 0.000000] SET =3D 0, FnV =3D 0 > > > [ 0.000000] EA =3D 0, S1PTW =3D 0 > > > [ 0.000000] Data abort info: > > > [ 0.000000] ISV =3D 0, ISS =3D 0x00000004 > > > [ 0.000000] CM =3D 0, WnR =3D 0 > > > [ 0.000000] [0000000000000510] user address but active_mm is swa= pper > > > [ 0.000000] Internal error: Oops: 96000004 [#1] PREEMPT SMP > > > [ 0.000000] Modules linked in: > > > [ 0.000000] Process swapper (pid: 0, stack limit =3D 0xffff00000= 9400000) > > > [ 0.000000] CPU: 0 PID: 0 Comm: swapper Not tainted 4.14.154-rc1= #1 > > > [ 0.000000] Hardware name: ARM Juno development board (r2) (DT) > > > [ 0.000000] task: ffff000009419780 task.stack: ffff000009400000 > > > [ 0.000000] PC is at __rmqueue+0x3c4/0x908 > > > [ 0.000000] LR is at __rmqueue+0x384/0x908 > > > [ 0.000000] pc : [] lr : [] > > > pstate: 600000c5 > > > [ 0.000000] sp : ffff000009403b10 > > > [ 0.000000] x29: ffff000009403b10 x28: 0000000000000000 > > > [ 0.000000] x27: 000000000000000a x26: ffff80097ffc7700 > > > [ 0.000000] x25: 00007ff6800387c0 x24: 0000000000000000 > > > [ 0.000000] x23: ffff00000940f000 x22: ffff80097ffc7800 > > > [ 0.000000] x21: ffffffffffffff00 x20: ffff80097ffc7840 > > > [ 0.000000] x19: ffff0000093ef000 x18: 0000000000000001 > > > [ 0.000000] x17: 000000000000001c x16: 000000000000001b > > > [ 0.000000] x15: 000000000000001a x14: ffff0000096833f8 > > > [ 0.000000] x13: ffff0000095e3198 x12: 000000000c67c24e > > > [ 0.000000] x11: ffff000009419fb0 x10: ffff00000a174000 > > > [ 0.000000] x9 : ffff00000988b728 x8 : 0000000000000000 > > > [ 0.000000] x7 : ffff0000092cf3a4 x6 : 0000000000000000 > > > [ 0.000000] x5 : fffffffffffff1ff x4 : ffff7e0025de0020 > > > [ 0.000000] x3 : ffff7e0025dd0020 x2 : 000000000000000a > > > [ 0.000000] x1 : 000000000000001e x0 : 0000000000000410 > > > [ 0.000000] Call trace: > > > [ 0.000000] Exception stack(0xffff0000094039d0 to 0xffff00000940= 3b10) > > > [ 0.000000] 39c0: > > > 0000000000000410 000000000000001e > > > [ 0.000000] 39e0: 000000000000000a ffff7e0025dd0020 > > > ffff7e0025de0020 fffffffffffff1ff > > > [ 0.000000] 3a00: 0000000000000000 ffff0000092cf3a4 > > > 0000000000000000 ffff00000988b728 > > > [ 0.000000] 3a20: ffff00000a174000 ffff000009419fb0 > > > 000000000c67c24e ffff0000095e3198 > > > [ 0.000000] 3a40: ffff0000096833f8 000000000000001a > > > 000000000000001b 000000000000001c > > > [ 0.000000] 3a60: 0000000000000001 ffff0000093ef000 > > > ffff80097ffc7840 ffffffffffffff00 > > > [ 0.000000] 3a80: ffff80097ffc7800 ffff00000940f000 > > > 0000000000000000 00007ff6800387c0 > > > [ 0.000000] 3aa0: ffff80097ffc7700 000000000000000a > > > 0000000000000000 ffff000009403b10 > > > [ 0.000000] 3ac0: ffff0000082594ac ffff000009403b10 > > > ffff0000082594ec 00000000600000c5 > > > [ 0.000000] 3ae0: ffffffffffffff00 ffff80097ffc7800 > > > ffffffffffffffff ffff0000082594ac > > > [ 0.000000] 3b00: ffff000009403b10 ffff0000082594ec > > > [ 0.000000] [] __rmqueue+0x3c4/0x908 > > > [ 0.000000] [] get_page_from_freelist+0x468/0x= cb8 > > > [ 0.000000] [] __alloc_pages_nodemask+0x12c/0x= 1248 > > > [ 0.000000] [] new_slab+0xc0/0x568 > > > [ 0.000000] [] __kmem_cache_create+0x2e0/0x628 > > > [ 0.000000] [] create_boot_cache+0xa8/0xdc > > > [ 0.000000] [] kmem_cache_init+0x58/0x120 > > > [ 0.000000] [] start_kernel+0x200/0x3d8 > > > [ 0.000000] Code: 8b000401 8b010800 d37df000 8b081000 (f9408000) > > > [ 0.000000] random: get_random_bytes called from > > > print_oops_end_marker+0x54/0x70 with crng_init=3D0 > > > [ 0.000000] ---[ end trace c75a488acdeef932 ]--- > > > [ 0.000000] Kernel panic - not syncing: Attempted to kill the id= le task! > > > [ 0.000000] ---[ end Kernel panic - not syncing: Attempted to ki= ll > > > the idle task! > > > > > > > > > Full test log link, > > > https://lkft.validation.linaro.org/scheduler/job/1004132#L482 > > > > Any chance you can bisect? >=20 > Reverting 61dbb1f20417 ("mm, meminit: recalculate pcpu batch and high > limits after init completes") got the system working again. Yeah, I messed that one up :( I'm pushing out a -rc2 now to hopefully fix this up, thanks! greg k-h