From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=BAYES_00, FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C8911C48BE5 for ; Sat, 12 Jun 2021 02:11:34 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id EC83B60C3E for ; Sat, 12 Jun 2021 02:11:33 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org EC83B60C3E Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=sina.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 440DF6B006C; Fri, 11 Jun 2021 22:11:33 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 3EF636B006E; Fri, 11 Jun 2021 22:11:33 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 290906B0070; Fri, 11 Jun 2021 22:11:33 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0072.hostedemail.com [216.40.44.72]) by kanga.kvack.org (Postfix) with ESMTP id EADA56B006C for ; Fri, 11 Jun 2021 22:11:32 -0400 (EDT) Received: from smtpin06.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay01.hostedemail.com (Postfix) with ESMTP id 251671812D473 for ; Sat, 12 Jun 2021 02:11:31 +0000 (UTC) X-FDA: 78243445182.06.70E79B5 Received: from r3-11.sinamail.sina.com.cn (r3-11.sinamail.sina.com.cn [202.108.3.11]) by imf06.hostedemail.com (Postfix) with SMTP id E299FC005A20 for ; Sat, 12 Jun 2021 02:11:23 +0000 (UTC) Received: from unknown (HELO localhost.localdomain)([111.194.182.121]) by sina.com (172.16.97.27) with ESMTP id 60C417CD0003072A; Sat, 12 Jun 2021 10:11:27 +0800 (CST) X-Sender: hdanton@sina.com X-Auth-ID: hdanton@sina.com X-SMAIL-MID: 48950149283210 From: Hillf Danton To: Nathan Chancellor Cc: "K. Y. Srinivasan" , Haiyang Zhang , Stephen Hemminger , Wei Liu , Dexuan Cui , linux-hyperv@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: vmemmap alloc failure in hot_add_req() Date: Sat, 12 Jun 2021 10:11:15 +0800 Message-Id: <20210612021115.2136-1-hdanton@sina.com> In-Reply-To: References: MIME-Version: 1.0 Authentication-Results: imf06.hostedemail.com; dkim=none; spf=pass (imf06.hostedemail.com: domain of hdanton@sina.com designates 202.108.3.11 as permitted sender) smtp.mailfrom=hdanton@sina.com; dmarc=none X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: E299FC005A20 X-Stat-Signature: zw3u5hewboqy9fsrnsiygz7hqmarz4rq X-HE-Tag: 1623463883-367504 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000280, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, 11 Jun 2021 12:48:26 -0700 Nathan Chancellor wrote: > Hi all, >=20 > I am occasionally seeing a kernel warning when running virtual machines > in Hyper-V, which usually happens a minute or so after boot. It does no= t > happen on every boot and it is reproducible on at least v5.10. I think > it might have something to do with constant reboots, which I do when > testing various kernels. >=20 > The stack trace is as follows: >=20 > [ 49.215291] kworker/0:1: vmemmap alloc failure: order:9, mode:0x4cc0= (GFP_KERNEL|__GFP_RETRY_MAYFAIL), nodemask=3D(null),cpuset=3D/,mems_allow= ed=3D0 > [ 49.215299] CPU: 0 PID: 18 Comm: kworker/0:1 Not tainted 5.13.0-rc5 = #1 > [ 49.215301] Hardware name: Microsoft Corporation Virtual Machine/Vir= tual Machine, BIOS Hyper-V UEFI Release v4.0 11/01/2019 > [ 49.215302] Workqueue: events hot_add_req [hv_balloon] Apart from order:9 (mm Cced), events_unbound is the right workqueue inste= ad because the report shows the risk that hot_add_req could block other pend= ing events longer than thought. Any special reason for the events wq? > [ 49.215307] Call Trace: > [ 49.215310] dump_stack+0x76/0x94 > [ 49.215314] warn_alloc.cold+0x78/0xdc > [ 49.215316] ? __alloc_pages+0x200/0x230 > [ 49.215319] vmemmap_alloc_block+0x86/0xdc > [ 49.215323] vmemmap_populate+0x10e/0x31c > [ 49.215324] __populate_section_memmap+0x38/0x4e > [ 49.215326] sparse_add_section+0x12c/0x1cf > [ 49.215329] __add_pages+0xa9/0x130 > [ 49.215330] add_pages+0x12/0x60 > [ 49.215333] add_memory_resource+0x180/0x300 > [ 49.215335] __add_memory+0x3b/0x80 > [ 49.215336] add_memory+0x2e/0x50 > [ 49.215337] hot_add_req+0x3fc/0x5a0 [hv_balloon] > [ 49.215340] process_one_work+0x214/0x3e0 > [ 49.215342] worker_thread+0x4d/0x3d0 > [ 49.215344] ? process_one_work+0x3e0/0x3e0 > [ 49.215345] kthread+0x133/0x150 > [ 49.215347] ? kthread_associate_blkcg+0xc0/0xc0 > [ 49.215348] ret_from_fork+0x22/0x30 > [ 49.215351] Mem-Info: > [ 49.215352] active_anon:251 inactive_anon:140868 isolated_anon:0 > active_file:47497 inactive_file:88505 isolated_file:0 > unevictable:8 dirty:14 writeback:0 > slab_reclaimable:12013 slab_unreclaimable:11403 > mapped:131701 shmem:12671 pagetables:3140 bounce:0 > free:41388 free_pcp:37 free_cma:0 > [ 49.215355] Node 0 active_anon:1004kB inactive_anon:563472kB active_= file:189988kB inactive_file:354020kB unevictable:32kB isolated(anon):0kB = isolated(file):0kB mapped:526804kB dirty:56kB writeback:0kB shmem:50684kB= shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kern= el_stack:5904kB pagetables:12560kB all_unreclaimable? no > [ 49.215358] Node 0 DMA free:6496kB min:480kB low:600kB high:720kB re= served_highatomic:0KB active_anon:0kB inactive_anon:3120kB active_file:25= 84kB inactive_file:2792kB unevictable:0kB writepending:0kB present:15996k= B managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_= cma:0kB > [ 49.215361] lowmem_reserve[]: 0 1384 1384 1384 1384 > [ 49.215364] Node 0 DMA32 free:159056kB min:44572kB low:55712kB high:= 66852kB reserved_highatomic:0KB active_anon:1004kB inactive_anon:560352kB= active_file:187004kB inactive_file:350864kB unevictable:32kB writependin= g:56kB present:1555760kB managed:1432388kB mlocked:32kB bounce:0kB free_p= cp:172kB local_pcp:0kB free_cma:0kB > [ 49.215367] lowmem_reserve[]: 0 0 0 0 0 > [ 49.215369] Node 0 DMA: 17*4kB (UM) 13*8kB (M) 10*16kB (M) 3*32kB (M= E) 3*64kB (UME) 4*128kB (UME) 1*256kB (E) 2*512kB (UE) 2*1024kB (ME) 1*20= 48kB (E) 0*4096kB =3D 6508kB > [ 49.215377] Node 0 DMA32: 8061*4kB (UME) 5892*8kB (UME) 2449*16kB (U= ME) 604*32kB (UME) 207*64kB (UME) 49*128kB (UM) 7*256kB (M) 1*512kB (M) 0= *1024kB 0*2048kB 0*4096kB =3D 159716kB > [ 49.215388] 148696 total pagecache pages > [ 49.215388] 0 pages in swap cache > [ 49.215389] Swap cache stats: add 0, delete 0, find 0/0 > [ 49.215390] Free swap =3D 0kB > [ 49.215390] Total swap =3D 0kB > [ 49.215391] 392939 pages RAM > [ 49.215391] 0 pages HighMem/MovableOnly > [ 49.215391] 31002 pages reserved > [ 49.215392] 0 pages cma reserved > [ 49.215393] 0 pages hwpoisoned >=20 > Is this a known issue and/or am I doing something wrong? I only noticed > this because there are times when I am compiling something intensive in > the VM such as LLVM and the VM runs out of memory even though I have > plenty of free memory on the host but I am not sure if this warning is > related to that issue. >=20 > I do not have much experience with Hyper-V so it is possible I do not > have something configured properly or there is some other issue going > on. Let me know if there is any further information I can provide or > help debug in any way. >=20 > Cheers, > Nathan >=20