From: Markus Linnala <markus.linnala@gmail.com>
To: Vitaly Wool <vitalywool@gmail.com>
Cc: Michal Hocko <mhocko@kernel.org>, Linux-MM <linux-mm@kvack.org>,
Dan Streetman <ddstreet@ieee.org>,
Seth Jennings <sjenning@redhat.com>
Subject: Re: PROBLEM: zswap with z3fold makes swap stuck
Date: Mon, 19 Aug 2019 21:28:10 +0300 [thread overview]
Message-ID: <CAH6yVy3R9DXsxT9PXS5ySj3mkjEaE0H8K53fSASsO+w-EvOPZA@mail.gmail.com> (raw)
In-Reply-To: <CAH6yVy2T6rtcXgC+DRR=nRHCE-NFyiXELYf1PMhrR5=uF1eQOQ@mail.gmail.com>
[-- Attachment #1: Type: text/plain, Size: 13223 bytes --]
ma 19. elok. 2019 klo 21.27 Markus Linnala (markus.linnala@gmail.com) kirjoitti:
>
> I got different call trace. Attached as console-1566238241.520493280.log
>
> [ 460.814661] kernel BUG at lib/list_debug.c:51!
> [ 460.815798] invalid opcode: 0000 [#1] SMP PTI
> [ 460.816417] CPU: 0 PID: 1829 Comm: stress Tainted: G W
> 5.3.0-rc5+ #71
> [ 460.817470] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009),
> BIOS 1.12.0-2.fc30 04/01/2014
> [ 460.818658] RIP: 0010:__list_del_entry_valid.cold+0x31/0x55
> [ 460.819500] Code: fc 11 a6 e8 34 7d bf ff 0f 0b 48 c7 c7 a0 fd 11
> a6 e8 26 7d bf ff 0f 0b 48 89 f2 48 89 fe 48 c7 c7 60 fd 11 a6 e8 12
> 7d bf ff <0f> 0b 48 89 fe 4c 89 c2 48 c7 c7 28 fd 11 a6 e8 fe 7c bf ff
> 0f 0b
> [ 460.822146] RSP: 0018:ffffbdad80947b20 EFLAGS: 00010046
> [ 460.822908] RAX: 0000000000000054 RBX: ffffa03f75f1fe00 RCX: 0000000000000000
> [ 460.823919] RDX: 0000000000000000 RSI: ffffa03f7e5d89c8 RDI: ffffa03f7e5d89c8
> [ 460.824931] RBP: ffffa03f75f1fe08 R08: ffffa03f7e5d89c8 R09: 0000000000000001
> [ 460.825954] R10: 0000000000000001 R11: 0000000000000000 R12: ffffa03f55c08058
> [ 460.826975] R13: ffffa03f55c08000 R14: ffffa03f55c08010 R15: 0000000000000000
> [ 460.828008] FS: 00007fe19aa85740(0000) GS:ffffa03f7e400000(0000)
> knlGS:0000000000000000
> [ 460.829160] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 460.830011] CR2: 00007fe19ac482c8 CR3: 0000000035a1c002 CR4: 0000000000160ef0
> [ 460.831032] Call Trace:
> [ 460.831380] z3fold_zpool_free+0x234/0x323
> [ 460.831969] zswap_free_entry+0x43/0x50
> [ 460.832522] zswap_frontswap_invalidate_page+0x8c/0x90
> [ 460.833261] __frontswap_invalidate_page+0x56/0x90
> [ 460.833963] swap_range_free+0xb2/0xd0
> [ 460.834494] swapcache_free_entries+0x128/0x1a0
> [ 460.835167] free_swap_slot+0xd5/0xf0
> [ 460.835706] __swap_entry_free.constprop.0+0x8c/0xa0
> [ 460.836418] free_swap_and_cache+0x35/0x70
> [ 460.837020] unmap_page_range+0x4c8/0xd00
> [ 460.837595] unmap_vmas+0x70/0xd0
> [ 460.838042] unmap_region+0xa8/0x110
> [ 460.838533] __do_munmap+0x297/0x460
> [ 460.839008] __vm_munmap+0x6a/0xc0
> [ 460.839462] __x64_sys_munmap+0x28/0x30
> [ 460.839982] do_syscall_64+0x5a/0x220
> [ 460.840488] entry_SYSCALL_64_after_hwframe+0x49/0xbe
> [ 460.841147] RIP: 0033:0x7fe19ab7e1eb
> [ 460.841646] Code: 8b 15 a1 9c 0c 00 f7 d8 64 89 02 48 c7 c0 ff ff
> ff ff eb 89 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa b8 0b 00 00
> 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 6d 9c 0c 00 f7 d8 64 89
> 01 48
> [ 460.844838] RSP: 002b:00007fffd016cc18 EFLAGS: 00000206 ORIG_RAX:
> 000000000000000b
> [ 460.845657] RAX: ffffffffffffffda RBX: ffffffffffffffff RCX: 00007fe19ab7e1eb
> [ 460.846424] RDX: 000000000000000f RSI: 000000000b87f000 RDI: 00007fe18f206000
> [ 460.850824] RBP: 00007fe18f206010 R08: 00007fe18f206000 R09: 0000000000000000
> [ 460.855463] R10: 00007fe19aa84010 R11: 0000000000000206 R12: 000056292b3c8004
> [ 460.860138] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
> [ 460.864922] Modules linked in: ip6t_rpfilter ip6t_REJECT
> nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat
> ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat
> iptable_mangle iptable_raw iptable_security nf_conntrack
> nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink
> ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul
> crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon
> net_failover failover intel_agp intel_gtt qxl drm_kms_helper
> syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel
> serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
> [ 460.903490] ---[ end trace bd72aa26a921e57c ]---
>
>
> (gdb) l *z3fold_zpool_free+0x234
> 0xffffffff81339be4 is in z3fold_zpool_free
> (/src/linux/include/linux/list.h:190).
> 185 * list_del_init - deletes entry from list and reinitialize it.
> 186 * @entry: the element to delete from the list.
> 187 */
> 188 static inline void list_del_init(struct list_head *entry)
> 189 {
> 190 __list_del_entry(entry);
> 191 INIT_LIST_HEAD(entry);
> 192 }
> 193
> 194 /**
> (gdb) l *zswap_free_entry+0x43
> 0xffffffff812e7ed3 is in zswap_free_entry (/src/linux/mm/zswap.c:329).
> 324 {
> 325 if (!entry->length)
> 326 atomic_dec(&zswap_same_filled_pages);
> 327 else {
> 328 zpool_free(entry->pool->zpool, entry->handle);
> 329 zswap_pool_put(entry->pool);
> 330 }
> 331 zswap_entry_cache_free(entry);
> 332 atomic_dec(&zswap_stored_pages);
> 333 zswap_update_total_size();
> (gdb) l *zswap_frontswap_invalidate_page+0x8c
> 0xffffffff812e7f9c is in zswap_frontswap_invalidate_page
> (/src/linux/include/linux/spinlock.h:378).
> 373 raw_spin_lock_irqsave_nested(spinlock_check(lock), flags, subclass); \
> 374 } while (0)
> 375
> 376 static __always_inline void spin_unlock(spinlock_t *lock)
> 377 {
> 378 raw_spin_unlock(&lock->rlock);
> 379 }
> 380
> 381 static __always_inline void spin_unlock_bh(spinlock_t *lock)
> 382 {
>
> ma 19. elok. 2019 klo 20.49 Markus Linnala (markus.linnala@gmail.com) kirjoitti:
> >
> > I have applied your patch against vanilla v5.3-rc5. There was no config changes.
> >
> > So far I've gotten couple of these GPF. I guess this is different
> > issue. It will take several hours to get full view.
> >
> > I've attached one full console log as: console-1566235171.001993084.log
> >
> > [ 13.821223] general protection fault: 0000 [#1] SMP PTI
> > [ 13.821882] CPU: 0 PID: 151 Comm: kswapd0 Tainted: G W
> > 5.3.0-rc5+ #71
> > [ 13.822755] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009),
> > BIOS 1.12.0-2.fc30 04/01/2014
> > [ 13.824272] RIP: 0010:handle_to_buddy+0x20/0x30
> > [ 13.824786] Code: 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44 00 00 53
> > 48 89 fb 83 e7 01 0f 85 31 26 00 00 48 8b 03 5b 48 89 c2 48 81 e2 00
> > f0 ff ff <0f> b6 92 ca 00 00 00 29 d0 83 e0 03 c3 0f 1f 00 0f 1f 44 00
> > 00 55
> > [ 13.826854] RSP: 0000:ffffb18cc01977f0 EFLAGS: 00010206
> > [ 13.827452] RAX: 00ffff97dd890fd0 RBX: fffff63080243f40 RCX: 0000000000000000
> > [ 13.828256] RDX: 00ffff97dd890000 RSI: ffff97ddbe5d89c8 RDI: ffff97ddbe5d89c8
> > [ 13.829056] RBP: ffff97dd890fd000 R08: ffff97ddbe5d89c8 R09: 0000000000000000
> > [ 13.829860] R10: 0000000000000000 R11: 0000000000000000 R12: ffff97dd890fd001
> > [ 13.830660] R13: ffff97dd890fd010 R14: ffff97ddb5f96408 R15: ffffb18cc0197838
> > [ 13.831468] FS: 0000000000000000(0000) GS:ffff97ddbe400000(0000)
> > knlGS:0000000000000000
> > [ 13.832673] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [ 13.833593] CR2: 00007fec8745f010 CR3: 0000000006212004 CR4: 0000000000160ef0
> > [ 13.834508] Call Trace:
> > [ 13.834828] z3fold_zpool_map+0x76/0x110
> > [ 13.835332] zswap_writeback_entry+0x50/0x410
> > [ 13.835888] z3fold_zpool_shrink+0x3d1/0x570
> > [ 13.836434] ? sched_clock_cpu+0xc/0xc0
> > [ 13.836919] zswap_frontswap_store+0x424/0x7c1
> > [ 13.837484] __frontswap_store+0xc4/0x162
> > [ 13.837992] swap_writepage+0x39/0x70
> > [ 13.838460] pageout.isra.0+0x12c/0x5d0
> > [ 13.838950] shrink_page_list+0x1124/0x1830
> > [ 13.839484] shrink_inactive_list+0x1da/0x460
> > [ 13.840036] shrink_node_memcg+0x202/0x770
> > [ 13.840746] shrink_node+0xdf/0x490
> > [ 13.841931] balance_pgdat+0x2db/0x580
> > [ 13.842396] kswapd+0x239/0x500
> > [ 13.842772] ? finish_wait+0x90/0x90
> > [ 13.847323] kthread+0x108/0x140
> > [ 13.848358] ? balance_pgdat+0x580/0x580
> > [ 13.849626] ? kthread_park+0x80/0x80
> > [ 13.850352] ret_from_fork+0x3a/0x50
> > [ 13.851086] Modules linked in: ip6t_rpfilter ip6t_REJECT
> > nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat
> > ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat
> > iptable_mangle iptable_raw iptable_security nf_conntrack
> > nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink
> > ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul
> > crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon
> > net_failover failover intel_agp intel_gtt qxl drm_kms_helper
> > syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel
> > virtio_blk virtio_console serio_raw agpgart qemu_fw_cfg
> > [ 13.857818] ---[ end trace 4517028df5e476fe ]---
> > [ 13.858400] RIP: 0010:handle_to_buddy+0x20/0x30
> > [ 13.859761] Code: 84 00 00 00 00 00 0f 1f 40 00 0f 1f 44 00 00 53
> > 48 89 fb 83 e7 01 0f 85 31 26 00 00 48 8b 03 5b 48 89 c2 48 81 e2 00
> > f0 ff ff <0f> b6 92 ca 00 00 00 29 d0 83 e0 03 c3 0f 1f 00 0f 1f 44 00
> > 00 55
> > [ 13.862703] RSP: 0000:ffffb18cc01977f0 EFLAGS: 00010206
> > [ 13.864232] RAX: 00ffff97dd890fd0 RBX: fffff63080243f40 RCX: 0000000000000000
> > [ 13.865834] RDX: 00ffff97dd890000 RSI: ffff97ddbe5d89c8 RDI: ffff97ddbe5d89c8
> > [ 13.867362] RBP: ffff97dd890fd000 R08: ffff97ddbe5d89c8 R09: 0000000000000000
> > [ 13.869121] R10: 0000000000000000 R11: 0000000000000000 R12: ffff97dd890fd001
> > [ 13.871091] R13: ffff97dd890fd010 R14: ffff97ddb5f96408 R15: ffffb18cc0197838
> > [ 13.872742] FS: 0000000000000000(0000) GS:ffff97ddbe400000(0000)
> > knlGS:0000000000000000
> > [ 13.874448] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [ 13.876382] CR2: 00007fec8745f010 CR3: 0000000006212004 CR4: 0000000000160ef0
> > [ 13.878007] ------------[ cut here ]------------
> >
> >
> > (gdb) l *handle_to_buddy+0x20
> > 0xffffffff813376b0 is in handle_to_buddy (/src/linux/mm/z3fold.c:429).
> > 424 unsigned long addr;
> > 425
> > 426 WARN_ON(handle & (1 << PAGE_HEADLESS));
> > 427 addr = *(unsigned long *)handle;
> > 428 zhdr = (struct z3fold_header *)(addr & PAGE_MASK);
> > 429 return (addr - zhdr->first_num) & BUDDY_MASK;
> > 430 }
> > 431
> > 432 static inline struct z3fold_pool *zhdr_to_pool(struct z3fold_header *zhdr)
> > 433 {
> > (gdb) l *z3fold_zpool_map+0x76
> > 0xffffffff81337cb6 is in z3fold_zpool_map (/src/linux/mm/z3fold.c:1257).
> > 1252 if (test_bit(PAGE_HEADLESS, &page->private))
> > 1253 goto out;
> > 1254
> > 1255 z3fold_page_lock(zhdr);
> > 1256 buddy = handle_to_buddy(handle);
> > 1257 switch (buddy) {
> > 1258 case FIRST:
> > 1259 addr += ZHDR_SIZE_ALIGNED;
> > 1260 break;
> > 1261 case MIDDLE:
> > (gdb) l *zswap_writeback_entry+0x50
> > 0xffffffff812e8260 is in zswap_writeback_entry (/src/linux/mm/zswap.c:858).
> > 853 .sync_mode = WB_SYNC_NONE,
> > 854 };
> > 855
> > 856 /* extract swpentry from data */
> > 857 zhdr = zpool_map_handle(pool, handle, ZPOOL_MM_RO);
> > 858 swpentry = zhdr->swpentry; /* here */
> > 859 zpool_unmap_handle(pool, handle);
> > 860 tree = zswap_trees[swp_type(swpentry)];
> > 861 offset = swp_offset(swpentry);
> > (gdb) l *z3fold_zpool_shrink+0x3d1
> > 0xffffffff81338821 is in z3fold_zpool_shrink (/src/linux/mm/z3fold.c:1186).
> > 1181 ret = pool->ops->evict(pool, middle_handle);
> > 1182 if (ret)
> > 1183 goto next;
> > 1184 }
> > 1185 if (first_handle) {
> > 1186 ret = pool->ops->evict(pool, first_handle);
> > 1187 if (ret)
> > 1188 goto next;
> > 1189 }
> > 1190 if (last_handle) {
> >
> >
> > To compare, I got following Call Trace "signatures" against vanilla
> > v5.3-rc5. Some of them might not be related to zswap at all.
> >
> > [ 15.469831] Call Trace:
> > [ 15.470171] migrate_pages+0x20c/0xfb0
> > [ 15.470678] ? isolate_freepages_block+0x410/0x410
> > [ 15.471344] ? __ClearPageMovable+0x90/0x90
> > [ 15.471914] compact_zone+0x74c/0xef0
> > --
> > [ 105.611480] Call Trace:
> > [ 105.611817] zswap_writeback_entry+0x50/0x410
> > [ 105.612417] z3fold_zpool_shrink+0x29d/0x540
> > [ 105.612947] zswap_frontswap_store+0x424/0x7c1
> > [ 105.613494] __frontswap_store+0xc4/0x162
> > --
> > [ 15.103942] Call Trace:
> > [ 15.104280] z3fold_zpool_map+0x76/0x110
> > [ 15.104824] zswap_writeback_entry+0x50/0x410
> > [ 15.105398] z3fold_zpool_shrink+0x3c4/0x540
> > [ 15.105960] zswap_frontswap_store+0x424/0x7c1
> > --
> > [ 632.066122] Call Trace:
> > [ 632.066124] z3fold_zpool_map+0x76/0x110
> > [ 632.066128] zswap_writeback_entry+0x50/0x410
> > [ 632.069101] do_user_addr_fault+0x1fe/0x480
> > [ 632.069650] z3fold_zpool_shrink+0x3c4/0x540
> > --
> > [ 133.419601] Call Trace:
> > [ 133.420199] zswap_writeback_entry+0x50/0x410
> > [ 133.421244] z3fold_zpool_shrink+0x4a6/0x540
> > [ 133.422266] zswap_frontswap_store+0x424/0x7c1
> > [ 133.423386] __frontswap_store+0xc4/0x162
> > --
> > [ 155.374773] Call Trace:
> > [ 155.375122] get_page_from_freelist+0x57d/0x1a40
> > [ 155.375725] __alloc_pages_nodemask+0x19d/0x400
> > [ 155.376354] alloc_pages_vma+0xcc/0x170
> > [ 155.376854] __read_swap_cache_async+0x1e9/0x3e0
> > --
> > [ 23.849834] Call Trace:
> > [ 23.851038] get_page_from_freelist+0x57d/0x1a40
> > [ 23.853300] ? wake_all_kswapds+0x54/0xb0
> > [ 23.855280] __alloc_pages_slowpath+0x1ae/0x1000
> > [ 23.857512] ? __lock_acquire+0x247/0x1900
> > --
> > [ 197.206331] Call Trace:
> > [ 197.207923] __release_z3fold_page.constprop.0+0x7e/0x130
> > [ 197.211387] do_compact_page+0x2c9/0x430
> > [ 197.213830] process_one_work+0x272/0x5a0
> > [ 197.216392] worker_thread+0x50/0x3b0
[-- Attachment #2: console-1566238241.520493280.log --]
[-- Type: text/x-log, Size: 77917 bytes --]
Fedora 30 (Thirty)
Kernel 5.3.0-rc5+ on an x86_64 (ttyS0)
localhost login: [ 460.814661] kernel BUG at lib/list_debug.c:51!
[ 460.815798] invalid opcode: 0000 [#1] SMP PTI
[ 460.816417] CPU: 0 PID: 1829 Comm: stress Tainted: G W 5.3.0-rc5+ #71
[ 460.817470] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 460.818658] RIP: 0010:__list_del_entry_valid.cold+0x31/0x55
[ 460.819500] Code: fc 11 a6 e8 34 7d bf ff 0f 0b 48 c7 c7 a0 fd 11 a6 e8 26 7d bf ff 0f 0b 48 89 f2 48 89 fe 48 c7 c7 60 fd 11 a6 e8 12 7d bf ff <0f> 0b 48 89 fe 4c 89 c2 48 c7 c7 28 fd 11 a6 e8 fe 7c bf ff 0f 0b
[ 460.822146] RSP: 0018:ffffbdad80947b20 EFLAGS: 00010046
[ 460.822908] RAX: 0000000000000054 RBX: ffffa03f75f1fe00 RCX: 0000000000000000
[ 460.823919] RDX: 0000000000000000 RSI: ffffa03f7e5d89c8 RDI: ffffa03f7e5d89c8
[ 460.824931] RBP: ffffa03f75f1fe08 R08: ffffa03f7e5d89c8 R09: 0000000000000001
[ 460.825954] R10: 0000000000000001 R11: 0000000000000000 R12: ffffa03f55c08058
[ 460.826975] R13: ffffa03f55c08000 R14: ffffa03f55c08010 R15: 0000000000000000
[ 460.828008] FS: 00007fe19aa85740(0000) GS:ffffa03f7e400000(0000) knlGS:0000000000000000
[ 460.829160] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 460.830011] CR2: 00007fe19ac482c8 CR3: 0000000035a1c002 CR4: 0000000000160ef0
[ 460.831032] Call Trace:
[ 460.831380] z3fold_zpool_free+0x234/0x323
[ 460.831969] zswap_free_entry+0x43/0x50
[ 460.832522] zswap_frontswap_invalidate_page+0x8c/0x90
[ 460.833261] __frontswap_invalidate_page+0x56/0x90
[ 460.833963] swap_range_free+0xb2/0xd0
[ 460.834494] swapcache_free_entries+0x128/0x1a0
[ 460.835167] free_swap_slot+0xd5/0xf0
[ 460.835706] __swap_entry_free.constprop.0+0x8c/0xa0
[ 460.836418] free_swap_and_cache+0x35/0x70
[ 460.837020] unmap_page_range+0x4c8/0xd00
[ 460.837595] unmap_vmas+0x70/0xd0
[ 460.838042] unmap_region+0xa8/0x110
[ 460.838533] __do_munmap+0x297/0x460
[ 460.839008] __vm_munmap+0x6a/0xc0
[ 460.839462] __x64_sys_munmap+0x28/0x30
[ 460.839982] do_syscall_64+0x5a/0x220
[ 460.840488] entry_SYSCALL_64_after_hwframe+0x49/0xbe
[ 460.841147] RIP: 0033:0x7fe19ab7e1eb
[ 460.841646] Code: 8b 15 a1 9c 0c 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb 89 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa b8 0b 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 6d 9c 0c 00 f7 d8 64 89 01 48
[ 460.844838] RSP: 002b:00007fffd016cc18 EFLAGS: 00000206 ORIG_RAX: 000000000000000b
[ 460.845657] RAX: ffffffffffffffda RBX: ffffffffffffffff RCX: 00007fe19ab7e1eb
[ 460.846424] RDX: 000000000000000f RSI: 000000000b87f000 RDI: 00007fe18f206000
[ 460.850824] RBP: 00007fe18f206010 R08: 00007fe18f206000 R09: 0000000000000000
[ 460.855463] R10: 00007fe19aa84010 R11: 0000000000000206 R12: 000056292b3c8004
[ 460.860138] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 460.864922] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 460.903490] ---[ end trace bd72aa26a921e57c ]---
[ 460.907158] RIP: 0010:__list_del_entry_valid.cold+0x31/0x55
[ 460.911418] Code: fc 11 a6 e8 34 7d bf ff 0f 0b 48 c7 c7 a0 fd 11 a6 e8 26 7d bf ff 0f 0b 48 89 f2 48 89 fe 48 c7 c7 60 fd 11 a6 e8 12 7d bf ff <0f> 0b 48 89 fe 4c 89 c2 48 c7 c7 28 fd 11 a6 e8 fe 7c bf ff 0f 0b
[ 460.925231] RSP: 0018:ffffbdad80947b20 EFLAGS: 00010046
[ 460.929299] RAX: 0000000000000054 RBX: ffffa03f75f1fe00 RCX: 0000000000000000
[ 460.935051] RDX: 0000000000000000 RSI: ffffa03f7e5d89c8 RDI: ffffa03f7e5d89c8
[ 460.940531] RBP: ffffa03f75f1fe08 R08: ffffa03f7e5d89c8 R09: 0000000000000001
[ 460.945822] R10: 0000000000000001 R11: 0000000000000000 R12: ffffa03f55c08058
[ 460.951101] R13: ffffa03f55c08000 R14: ffffa03f55c08010 R15: 0000000000000000
[ 460.956403] FS: 00007fe19aa85740(0000) GS:ffffa03f7e400000(0000) knlGS:0000000000000000
[ 460.962345] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 460.966729] CR2: 00007fe19ac482c8 CR3: 0000000035a1c002 CR4: 0000000000160ef0
[ 460.972014] BUG: sleeping function called from invalid context at include/linux/percpu-rwsem.h:38
[ 460.978467] in_atomic(): 1, irqs_disabled(): 1, pid: 1829, name: stress
[ 460.983423] INFO: lockdep is turned off.
[ 460.986640] irq event stamp: 52028096
[ 460.989707] hardirqs last enabled at (52028095): [<ffffffffa59d6b09>] _raw_spin_unlock_irq+0x29/0x40
[ 460.996733] hardirqs last disabled at (52028096): [<ffffffffa59d6891>] _raw_spin_lock_irq+0x11/0x80
[ 461.003277] softirqs last enabled at (52027220): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 461.009791] softirqs last disabled at (52027211): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 461.016173] CPU: 0 PID: 1829 Comm: stress Tainted: G D W 5.3.0-rc5+ #71
[ 461.022219] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 461.028686] Call Trace:
[ 461.031075] dump_stack+0x67/0x90
[ 461.033975] ___might_sleep.cold+0x9f/0xaf
[ 461.037340] exit_signals+0x30/0x330
[ 461.040366] do_exit+0xcb/0xcd0
[ 461.043119] rewind_stack_do_exit+0x17/0x20
[ 461.046577] note: stress[1829] exited with preempt_count 6
[ 488.148101] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [stress:1829]
[ 488.153533] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 488.193249] irq event stamp: 52028096
[ 488.196631] hardirqs last enabled at (52028095): [<ffffffffa59d6b09>] _raw_spin_unlock_irq+0x29/0x40
[ 488.203238] hardirqs last disabled at (52028096): [<ffffffffa59d6891>] _raw_spin_lock_irq+0x11/0x80
[ 488.210099] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [stress:1825]
[ 488.210220] softirqs last enabled at (52027220): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 488.212660] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 488.218222] softirqs last disabled at (52027211): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 488.218224] CPU: 0 PID: 1829 Comm: stress Tainted: G D W 5.3.0-rc5+ #71
[ 488.234635] irq event stamp: 51916057
[ 488.234639] hardirqs last enabled at (51916057): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 488.239880] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 488.242469] hardirqs last disabled at (51916055): [<ffffffffa5c002ca>] __do_softirq+0x2ca/0x451
[ 488.242470] softirqs last enabled at (51916056): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 488.245149] RIP: 0010:queued_spin_lock_slowpath+0x184/0x1e0
[ 488.248141] softirqs last disabled at (51916051): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 488.248143] CPU: 1 PID: 1825 Comm: stress Tainted: G D W 5.3.0-rc5+ #71
[ 488.253347] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb
[ 488.256135] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 488.256138] RIP: 0010:queued_spin_lock_slowpath+0x42/0x1e0
[ 488.261296] RSP: 0018:ffffbdad80947c80 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 488.263386] Code: 49 f0 0f ba 2f 08 0f 92 c0 0f b6 c0 c1 e0 08 89 c2 8b 07 30 e4 09 d0 a9 00 01 ff ff 75 23 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 65 48 ff 05 e8 f7 09 5b
[ 488.268511] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000040000
[ 488.268512] RDX: ffffa03f7e5ec400 RSI: 0000000000000003 RDI: ffffa03f72a78140
[ 488.271098] watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [stress:1828]
[ 488.271099] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 488.271112] irq event stamp: 48861275
[ 488.271114] hardirqs last enabled at (48861275): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 488.271115] RSP: 0000:ffffbdad808ffd30 EFLAGS: 00000202
[ 488.271118] hardirqs last disabled at (48861273): [<ffffffffa5c002ca>] __do_softirq+0x2ca/0x451
[ 488.271118] ORIG_RAX: ffffffffffffff13
[ 488.271119] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 8888888888888889
[ 488.271120] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 488.271120] RBP: ffffa03f72a78140 R08: 0000006b4aaec605 R09: 0000000000000000
[ 488.271121] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 488.271121] R13: 0000000000054742 R14: 0000000000054742 R15: ffffef5bc0a37000
[ 488.271125] FS: 00007fe19aa85740(0000) GS:ffffa03f7e600000(0000) knlGS:0000000000000000
[ 488.271125] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 488.271126] CR2: 00007fe1966e7010 CR3: 000000002f44c002 CR4: 0000000000160ee0
[ 488.271127] Call Trace:
[ 488.271129] do_raw_spin_lock+0xab/0xb0
[ 488.271133] _raw_spin_lock+0x63/0x80
[ 488.271136] __swap_entry_free.constprop.0+0x82/0xa0
[ 488.271162] do_swap_page+0x608/0xc20
[ 488.271165] __handle_mm_fault+0x8da/0x1900
[ 488.271169] handle_mm_fault+0x159/0x340
[ 488.271172] do_user_addr_fault+0x1fe/0x480
[ 488.271175] do_page_fault+0x31/0x210
[ 488.271176] page_fault+0x3e/0x50
[ 488.271178] RIP: 0033:0x56292b3c6298
[ 488.271180] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 488.271180] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 488.271181] RAX: 00000000074e1000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 488.271182] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 488.271182] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 488.271183] R10: 00007fe1966e6010 R11: 0000000000000246 R12: 000056292b3c8004
[ 488.271184] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 488.282882] RBP: ffffa03f72a78140 R08: 0000000000040000 R09: 0000000000000000
[ 488.282883] R10: 0000000000000000 R11: 0000000000000000 R12: ffffa03f72a78158
[ 488.285702] softirqs last enabled at (48861274): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 488.285704] softirqs last disabled at (48861267): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 488.289269] R13: 00000000000368f5 R14: 00000000000368f5 R15: 07fffffff92e1402
[ 488.289272] FS: 0000000000000000(0000) GS:ffffa03f7e400000(0000) knlGS:0000000000000000
[ 488.291839] CPU: 2 PID: 1828 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 488.303782] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 488.306278] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 488.306281] RIP: 0010:queued_spin_lock_slowpath+0x124/0x1e0
[ 488.310726] CR2: 00007fe19ac482c8 CR3: 0000000015212003 CR4: 0000000000160ef0
[ 488.310729] Call Trace:
[ 488.313183] Code: 00 89 1d 00 eb a1 41 83 c0 01 c1 e1 10 41 c1 e0 12 44 09 c1 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3c 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 74 64 c6 07 01
[ 488.332099] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [stress:1826]
[ 488.332100] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 488.332121] irq event stamp: 54583407
[ 488.332124] hardirqs last enabled at (54583407): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 488.332125] hardirqs last disabled at (54583406): [<ffffffffa5001c8a>] trace_hardirqs_off_thunk+0x1a/0x20
[ 488.332126] softirqs last enabled at (54583144): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 488.332129] softirqs last disabled at (54583095): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 488.332130] CPU: 3 PID: 1826 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 488.332131] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 488.332133] RIP: 0010:queued_spin_lock_slowpath+0x184/0x1e0
[ 488.332135] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb
[ 488.332135] RSP: 0000:ffffbdad8090f678 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 488.332136] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000100000
[ 488.332137] RDX: ffffa03f7ebec400 RSI: 0000000000000002 RDI: ffffa03f72a78140
[ 488.332137] RBP: ffffa03f72a78140 R08: 0000000000100000 R09: 0000000000000000
[ 488.332138] R10: 0000000000000005 R11: 0000000000000000 R12: ffffa03f72a78158
[ 488.332138] R13: ffffa03f72140a28 R14: 0000000000000001 R15: 00000007fe192300
[ 488.332141] FS: 00007fe19aa85740(0000) GS:ffffa03f7ea00000(0000) knlGS:0000000000000000
[ 488.332141] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 488.332142] CR2: 00007fe19a8e3010 CR3: 000000003747e001 CR4: 0000000000160ee0
[ 488.332143] Call Trace:
[ 488.332145] do_raw_spin_lock+0xab/0xb0
[ 488.332147] _raw_spin_lock+0x63/0x80
[ 488.332150] __swap_duplicate+0x163/0x220
[ 488.332152] swap_duplicate+0x16/0x40
[ 488.332154] try_to_unmap_one+0x81c/0xe20
[ 488.332159] rmap_walk_anon+0x173/0x390
[ 488.332161] try_to_unmap+0xfe/0x150
[ 488.332163] ? page_remove_rmap+0x490/0x490
[ 488.332164] ? page_not_mapped+0x20/0x20
[ 488.332165] ? page_get_anon_vma+0x1c0/0x1c0
[ 488.332176] shrink_page_list+0xf2f/0x1830
[ 488.332180] shrink_inactive_list+0x1da/0x460
[ 488.332183] shrink_node_memcg+0x202/0x770
[ 488.332188] shrink_node+0xdf/0x490
[ 488.332192] do_try_to_free_pages+0xdb/0x3c0
[ 488.332194] try_to_free_pages+0x112/0x2e0
[ 488.332198] __alloc_pages_slowpath+0x422/0x1000
[ 488.332200] ? __lock_acquire+0x247/0x1900
[ 488.332205] __alloc_pages_nodemask+0x37f/0x400
[ 488.332209] alloc_pages_vma+0xcc/0x170
[ 488.332210] ? _raw_spin_unlock+0x24/0x30
[ 488.332213] __handle_mm_fault+0x996/0x1900
[ 488.332217] handle_mm_fault+0x159/0x340
[ 488.332219] do_user_addr_fault+0x1fe/0x480
[ 488.332222] do_page_fault+0x31/0x210
[ 488.332223] page_fault+0x3e/0x50
[ 488.332225] RIP: 0033:0x56292b3c6250
[ 488.332233] Code: 0f 84 88 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f f1 00 00 00 31 c0 4d 85 ff 7e 12 0f 1f 44 00 00 <c6> 44 05 00 5a 4c 01 f0 49 39 c7 7f f3 48 85 db 0f 84 dd 01 00 00
[ 488.332234] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 488.332234] RAX: 00000000057fa000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 488.332235] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 488.332236] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 488.332236] R10: 0000000000000022 R11: 0000000000000246 R12: 000056292b3c8004
[ 488.332237] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 488.345800] do_raw_spin_lock+0xab/0xb0
[ 488.347587] RSP: 0000:ffffbdad80927ba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 488.354018] _raw_spin_lock+0x63/0x80
[ 488.356176] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 00000000000c0000
[ 488.356177] RDX: ffffa03f7e9ec400 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 488.361705] __swap_entry_free.constprop.0+0x82/0xa0
[ 488.363569] RBP: ffffa03f72a78140 R08: 00000000000c0000 R09: 0000000000000000
[ 488.363570] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 488.368500] free_swap_and_cache+0x35/0x70
[ 488.371110] R13: ffffa03f72a78140 R14: 0000000000003008 R15: 0000000000000000
[ 488.371113] FS: 00007fe19aa85740(0000) GS:ffffa03f7e800000(0000) knlGS:0000000000000000
[ 488.375916] unmap_page_range+0x4c8/0xd00
[ 488.378492] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 488.378493] CR2: 00007fe195b80010 CR3: 0000000032d2a004 CR4: 0000000000160ee0
[ 488.383267] unmap_vmas+0x70/0xd0
[ 488.386035] Call Trace:
[ 488.389941] exit_mmap+0x9d/0x190
[ 488.392463] do_raw_spin_lock+0xab/0xb0
[ 488.394644] mmput+0x74/0x150
[ 488.396407] _raw_spin_lock+0x63/0x80
[ 488.399253] do_exit+0x2e0/0xcd0
[ 488.401264] __swp_swapcount+0xb9/0xf0
[ 488.403912] rewind_stack_do_exit+0x17/0x20
[ 488.405708] __read_swap_cache_async+0xc0/0x3e0
[ 488.633361] swap_cluster_readahead+0x184/0x330
[ 488.634918] ? find_held_lock+0x32/0x90
[ 488.636320] swapin_readahead+0x2b4/0x4e0
[ 488.637780] ? sched_clock_cpu+0xc/0xc0
[ 488.639181] do_swap_page+0x3ac/0xc20
[ 488.640540] __handle_mm_fault+0x8da/0x1900
[ 488.642018] handle_mm_fault+0x159/0x340
[ 488.643436] do_user_addr_fault+0x1fe/0x480
[ 488.644927] do_page_fault+0x31/0x210
[ 488.646289] page_fault+0x3e/0x50
[ 488.647570] RIP: 0033:0x56292b3c6298
[ 488.648902] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 488.654251] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 488.656017] RAX: 000000000697a000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 488.658225] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 488.660412] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 488.662584] R10: 00007fe195b7f010 R11: 0000000000000246 R12: 000056292b3c8004
[ 488.664745] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 516.148174] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [stress:1829]
[ 516.153388] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 516.191484] irq event stamp: 52028096
[ 516.194510] hardirqs last enabled at (52028095): [<ffffffffa59d6b09>] _raw_spin_unlock_irq+0x29/0x40
[ 516.201176] hardirqs last disabled at (52028096): [<ffffffffa59d6891>] _raw_spin_lock_irq+0x11/0x80
[ 516.207720] softirqs last enabled at (52027220): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 516.210173] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [stress:1825]
[ 516.214015] softirqs last disabled at (52027211): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 516.216268] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 516.222299] CPU: 0 PID: 1829 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 516.237904] irq event stamp: 51916057
[ 516.237907] hardirqs last enabled at (51916057): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 516.243664] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 516.245201] hardirqs last disabled at (51916055): [<ffffffffa5c002ca>] __do_softirq+0x2ca/0x451
[ 516.245203] softirqs last enabled at (51916056): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 516.252089] RIP: 0010:queued_spin_lock_slowpath+0x184/0x1e0
[ 516.254778] softirqs last disabled at (51916051): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 516.254780] CPU: 1 PID: 1825 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 516.261182] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb
[ 516.263914] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 516.263917] RIP: 0010:queued_spin_lock_slowpath+0x42/0x1e0
[ 516.268303] RSP: 0018:ffffbdad80947c80 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 516.270962] Code: 49 f0 0f ba 2f 08 0f 92 c0 0f b6 c0 c1 e0 08 89 c2 8b 07 30 e4 09 d0 a9 00 01 ff ff 75 23 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 65 48 ff 05 e8 f7 09 5b
[ 516.271172] watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [stress:1828]
[ 516.271173] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 516.271184] irq event stamp: 48861275
[ 516.271187] hardirqs last enabled at (48861275): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 516.271188] hardirqs last disabled at (48861273): [<ffffffffa5c002ca>] __do_softirq+0x2ca/0x451
[ 516.271189] softirqs last enabled at (48861274): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 516.271191] softirqs last disabled at (48861267): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 516.271192] CPU: 2 PID: 1828 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 516.271192] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 516.271194] RIP: 0010:queued_spin_lock_slowpath+0x126/0x1e0
[ 516.271196] Code: 1d 00 eb a1 41 83 c0 01 c1 e1 10 41 c1 e0 12 44 09 c1 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3c 31 f6 eb 02 f3 90 8b 07 <66> 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 74 64 c6 07 01 48 85
[ 516.271196] RSP: 0000:ffffbdad80927ba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 516.271197] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 00000000000c0000
[ 516.271198] RDX: ffffa03f7e9ec400 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 516.271198] RBP: ffffa03f72a78140 R08: 00000000000c0000 R09: 0000000000000000
[ 516.271199] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 516.271199] R13: ffffa03f72a78140 R14: 0000000000003008 R15: 0000000000000000
[ 516.271202] FS: 00007fe19aa85740(0000) GS:ffffa03f7e800000(0000) knlGS:0000000000000000
[ 516.271203] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 516.271203] CR2: 00007fe195b80010 CR3: 0000000032d2a004 CR4: 0000000000160ee0
[ 516.271204] Call Trace:
[ 516.271206] do_raw_spin_lock+0xab/0xb0
[ 516.271209] _raw_spin_lock+0x63/0x80
[ 516.271212] __swp_swapcount+0xb9/0xf0
[ 516.271214] __read_swap_cache_async+0xc0/0x3e0
[ 516.271217] swap_cluster_readahead+0x184/0x330
[ 516.271218] ? find_held_lock+0x32/0x90
[ 516.271222] swapin_readahead+0x2b4/0x4e0
[ 516.271224] ? sched_clock_cpu+0xc/0xc0
[ 516.271228] do_swap_page+0x3ac/0xc20
[ 516.271231] __handle_mm_fault+0x8da/0x1900
[ 516.271235] handle_mm_fault+0x159/0x340
[ 516.271238] do_user_addr_fault+0x1fe/0x480
[ 516.271240] do_page_fault+0x31/0x210
[ 516.271242] page_fault+0x3e/0x50
[ 516.271244] RIP: 0033:0x56292b3c6298
[ 516.271245] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 516.271246] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 516.271246] RAX: 000000000697a000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 516.271247] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 516.271248] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 516.271248] R10: 00007fe195b7f010 R11: 0000000000000246 R12: 000056292b3c8004
[ 516.271249] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 516.276777] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000040000
[ 516.276779] RDX: ffffa03f7e5ec400 RSI: 0000000000000003 RDI: ffffa03f72a78140
[ 516.282646] RSP: 0000:ffffbdad808ffd30 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 516.289011] RBP: ffffa03f72a78140 R08: 0000000000040000 R09: 0000000000000000
[ 516.291092] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 8888888888888889
[ 516.291094] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 516.296866] R10: 0000000000000000 R11: 0000000000000000 R12: ffffa03f72a78158
[ 516.302889] RBP: ffffa03f72a78140 R08: 0000006b4aaec605 R09: 0000000000000000
[ 516.302891] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 516.308297] R13: 00000000000368f5 R14: 00000000000368f5 R15: 07fffffff92e1402
[ 516.325212] R13: 0000000000054742 R14: 0000000000054742 R15: ffffef5bc0a37000
[ 516.325215] FS: 00007fe19aa85740(0000) GS:ffffa03f7e600000(0000) knlGS:0000000000000000
[ 516.328603] FS: 0000000000000000(0000) GS:ffffa03f7e400000(0000) knlGS:0000000000000000
[ 516.331742] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 516.331743] CR2: 00007fe1966e7010 CR3: 000000002f44c002 CR4: 0000000000160ee0
[ 516.332173] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [stress:1826]
[ 516.332174] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 516.332199] irq event stamp: 54583407
[ 516.332202] hardirqs last enabled at (54583407): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 516.332203] hardirqs last disabled at (54583406): [<ffffffffa5001c8a>] trace_hardirqs_off_thunk+0x1a/0x20
[ 516.332205] softirqs last enabled at (54583144): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 516.332207] softirqs last disabled at (54583095): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 516.332208] CPU: 3 PID: 1826 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 516.332209] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 516.332211] RIP: 0010:queued_spin_lock_slowpath+0x184/0x1e0
[ 516.332212] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb
[ 516.332213] RSP: 0000:ffffbdad8090f678 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 516.332214] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000100000
[ 516.332215] RDX: ffffa03f7ebec400 RSI: 0000000000000002 RDI: ffffa03f72a78140
[ 516.332215] RBP: ffffa03f72a78140 R08: 0000000000100000 R09: 0000000000000000
[ 516.332216] R10: 0000000000000005 R11: 0000000000000000 R12: ffffa03f72a78158
[ 516.332216] R13: ffffa03f72140a28 R14: 0000000000000001 R15: 00000007fe192300
[ 516.332219] FS: 00007fe19aa85740(0000) GS:ffffa03f7ea00000(0000) knlGS:0000000000000000
[ 516.332219] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 516.332220] CR2: 00007fe19a8e3010 CR3: 000000003747e001 CR4: 0000000000160ee0
[ 516.332220] Call Trace:
[ 516.332222] do_raw_spin_lock+0xab/0xb0
[ 516.332224] _raw_spin_lock+0x63/0x80
[ 516.332226] __swap_duplicate+0x163/0x220
[ 516.332229] swap_duplicate+0x16/0x40
[ 516.332231] try_to_unmap_one+0x81c/0xe20
[ 516.332236] rmap_walk_anon+0x173/0x390
[ 516.332247] try_to_unmap+0xfe/0x150
[ 516.332248] ? page_remove_rmap+0x490/0x490
[ 516.332249] ? page_not_mapped+0x20/0x20
[ 516.332250] ? page_get_anon_vma+0x1c0/0x1c0
[ 516.332252] shrink_page_list+0xf2f/0x1830
[ 516.332256] shrink_inactive_list+0x1da/0x460
[ 516.332260] shrink_node_memcg+0x202/0x770
[ 516.332265] shrink_node+0xdf/0x490
[ 516.332269] do_try_to_free_pages+0xdb/0x3c0
[ 516.332271] try_to_free_pages+0x112/0x2e0
[ 516.332274] __alloc_pages_slowpath+0x422/0x1000
[ 516.332276] ? __lock_acquire+0x247/0x1900
[ 516.332281] __alloc_pages_nodemask+0x37f/0x400
[ 516.332285] alloc_pages_vma+0xcc/0x170
[ 516.332286] ? _raw_spin_unlock+0x24/0x30
[ 516.332288] __handle_mm_fault+0x996/0x1900
[ 516.332297] handle_mm_fault+0x159/0x340
[ 516.332300] do_user_addr_fault+0x1fe/0x480
[ 516.332312] do_page_fault+0x31/0x210
[ 516.332313] page_fault+0x3e/0x50
[ 516.332315] RIP: 0033:0x56292b3c6250
[ 516.332316] Code: 0f 84 88 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f f1 00 00 00 31 c0 4d 85 ff 7e 12 0f 1f 44 00 00 <c6> 44 05 00 5a 4c 01 f0 49 39 c7 7f f3 48 85 db 0f 84 dd 01 00 00
[ 516.332317] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 516.332318] RAX: 00000000057fa000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 516.332318] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 516.332319] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 516.332319] R10: 0000000000000022 R11: 0000000000000246 R12: 000056292b3c8004
[ 516.332320] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 516.338349] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 516.338350] CR2: 00007fe19ac482c8 CR3: 0000000015212003 CR4: 0000000000160ef0
[ 516.341302] Call Trace:
[ 516.347629] Call Trace:
[ 516.350360] do_raw_spin_lock+0xab/0xb0
[ 516.356883] do_raw_spin_lock+0xab/0xb0
[ 516.359133] _raw_spin_lock+0x63/0x80
[ 516.373316] _raw_spin_lock+0x63/0x80
[ 516.376023] __swap_entry_free.constprop.0+0x82/0xa0
[ 516.381629] __swap_entry_free.constprop.0+0x82/0xa0
[ 516.384205] do_swap_page+0x608/0xc20
[ 516.389782] free_swap_and_cache+0x35/0x70
[ 516.392331] __handle_mm_fault+0x8da/0x1900
[ 516.397886] unmap_page_range+0x4c8/0xd00
[ 516.400653] handle_mm_fault+0x159/0x340
[ 516.405319] unmap_vmas+0x70/0xd0
[ 516.407861] do_user_addr_fault+0x1fe/0x480
[ 516.410355] exit_mmap+0x9d/0x190
[ 516.412126] do_page_fault+0x31/0x210
[ 516.415383] mmput+0x74/0x150
[ 516.417091] page_fault+0x3e/0x50
[ 516.420883] do_exit+0x2e0/0xcd0
[ 516.422731] RIP: 0033:0x56292b3c6298
[ 516.426019] rewind_stack_do_exit+0x17/0x20
[ 516.427725] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 516.656942] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 516.658617] RAX: 00000000074e1000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 516.660742] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 516.662867] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 516.664988] R10: 00007fe1966e6010 R11: 0000000000000246 R12: 000056292b3c8004
[ 516.667110] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 525.813198] rcu: INFO: rcu_sched self-detected stall on CPU
[ 525.815037] rcu: 1-...!: (64463 ticks this GP) idle=b16/1/0x4000000000000002 softirq=395100/395100 fqs=0
[ 525.817772] (t=65004 jiffies g=178453 q=78)
[ 525.819273] rcu: rcu_sched kthread starved for 65006 jiffies! g178453 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=3
[ 525.822181] rcu: RCU grace-period kthread stack dump:
[ 525.823890] rcu_sched R running task 14000 10 2 0x80004000
[ 525.826070] Call Trace:
[ 525.827197] ? __schedule+0x329/0x8a0
[ 525.828581] ? sched_clock_cpu+0xc/0xc0
[ 525.829990] schedule+0x3a/0xb0
[ 525.831222] schedule_timeout+0x1b8/0x3c0
[ 525.832654] ? __next_timer_interrupt+0xd0/0xd0
[ 525.834198] rcu_gp_kthread+0x4a8/0xa60
[ 525.835588] kthread+0x108/0x140
[ 525.836838] ? rcu_barrier_func+0xa0/0xa0
[ 525.838262] ? kthread_park+0x80/0x80
[ 525.839598] ret_from_fork+0x3a/0x50
[ 525.840915] NMI backtrace for cpu 1
[ 525.842196] CPU: 1 PID: 1825 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 525.844470] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 525.846940] Call Trace:
[ 525.848032] <IRQ>
[ 525.849016] dump_stack+0x67/0x90
[ 525.850303] nmi_cpu_backtrace.cold+0x14/0x53
[ 525.851833] ? lapic_can_unplug_cpu.cold+0x45/0x45
[ 525.853465] nmi_trigger_cpumask_backtrace+0xe9/0xeb
[ 525.855138] rcu_dump_cpu_stacks+0x9b/0xc9
[ 525.856616] rcu_sched_clock_irq.cold+0x1ba/0x3b9
[ 525.858231] update_process_times+0x29/0x60
[ 525.859734] tick_sched_handle+0x22/0x60
[ 525.861166] tick_sched_timer+0x38/0x80
[ 525.862578] ? tick_sched_do_timer+0x70/0x70
[ 525.864089] __hrtimer_run_queues+0x110/0x450
[ 525.865629] hrtimer_interrupt+0x10e/0x240
[ 525.867106] smp_apic_timer_interrupt+0x7b/0x220
[ 525.868707] apic_timer_interrupt+0xf/0x20
[ 525.870187] </IRQ>
[ 525.871206] RIP: 0010:queued_spin_lock_slowpath+0x42/0x1e0
[ 525.873012] Code: 49 f0 0f ba 2f 08 0f 92 c0 0f b6 c0 c1 e0 08 89 c2 8b 07 30 e4 09 d0 a9 00 01 ff ff 75 23 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 65 48 ff 05 e8 f7 09 5b
[ 525.878434] RSP: 0000:ffffbdad808ffd30 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 525.880734] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 8888888888888889
[ 525.882933] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 525.885125] RBP: ffffa03f72a78140 R08: 0000006b4aaec605 R09: 0000000000000000
[ 525.887323] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 525.889520] R13: 0000000000054742 R14: 0000000000054742 R15: ffffef5bc0a37000
[ 525.891721] do_raw_spin_lock+0xab/0xb0
[ 525.893160] _raw_spin_lock+0x63/0x80
[ 525.894550] __swap_entry_free.constprop.0+0x82/0xa0
[ 525.896231] do_swap_page+0x608/0xc20
[ 525.897599] __handle_mm_fault+0x8da/0x1900
[ 525.899075] handle_mm_fault+0x159/0x340
[ 525.900478] do_user_addr_fault+0x1fe/0x480
[ 525.901939] do_page_fault+0x31/0x210
[ 525.903267] page_fault+0x3e/0x50
[ 525.904517] RIP: 0033:0x56292b3c6298
[ 525.905830] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 525.911162] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 525.912905] RAX: 00000000074e1000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 525.915091] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 525.917282] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 525.919470] R10: 00007fe1966e6010 R11: 0000000000000246 R12: 000056292b3c8004
[ 525.921669] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 544.148249] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [stress:1829]
[ 544.151074] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 544.170667] irq event stamp: 52028096
[ 544.172464] hardirqs last enabled at (52028095): [<ffffffffa59d6b09>] _raw_spin_unlock_irq+0x29/0x40
[ 544.176033] hardirqs last disabled at (52028096): [<ffffffffa59d6891>] _raw_spin_lock_irq+0x11/0x80
[ 544.179486] softirqs last enabled at (52027220): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 544.182873] softirqs last disabled at (52027211): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 544.186058] CPU: 0 PID: 1829 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 544.189152] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 544.192491] RIP: 0010:queued_spin_lock_slowpath+0x184/0x1e0
[ 544.194962] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb
[ 544.202225] RSP: 0018:ffffbdad80947c80 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 544.205295] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000040000
[ 544.208308] RDX: ffffa03f7e5ec400 RSI: 0000000000000003 RDI: ffffa03f72a78140
[ 544.211280] RBP: ffffa03f72a78140 R08: 0000000000040000 R09: 0000000000000000
[ 544.214217] R10: 0000000000000000 R11: 0000000000000000 R12: ffffa03f72a78158
[ 544.217157] R13: 00000000000368f5 R14: 00000000000368f5 R15: 07fffffff92e1402
[ 544.220096] FS: 0000000000000000(0000) GS:ffffa03f7e400000(0000) knlGS:0000000000000000
[ 544.223337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 544.225894] CR2: 00007fe19ac482c8 CR3: 0000000015212003 CR4: 0000000000160ef0
[ 544.228880] Call Trace:
[ 544.230360] do_raw_spin_lock+0xab/0xb0
[ 544.232294] _raw_spin_lock+0x63/0x80
[ 544.234171] __swap_entry_free.constprop.0+0x82/0xa0
[ 544.236413] free_swap_and_cache+0x35/0x70
[ 544.238414] unmap_page_range+0x4c8/0xd00
[ 544.240363] unmap_vmas+0x70/0xd0
[ 544.242100] exit_mmap+0x9d/0x190
[ 544.243863] mmput+0x74/0x150
[ 544.245510] do_exit+0x2e0/0xcd0
[ 544.247213] rewind_stack_do_exit+0x17/0x20
[ 544.271246] watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [stress:1828]
[ 544.272755] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 544.282518] irq event stamp: 48861275
[ 544.283704] hardirqs last enabled at (48861275): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 544.285546] hardirqs last disabled at (48861273): [<ffffffffa5c002ca>] __do_softirq+0x2ca/0x451
[ 544.287303] softirqs last enabled at (48861274): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 544.289064] softirqs last disabled at (48861267): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 544.290785] CPU: 2 PID: 1828 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 544.292434] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 544.294171] RIP: 0010:queued_spin_lock_slowpath+0x124/0x1e0
[ 544.295556] Code: 00 89 1d 00 eb a1 41 83 c0 01 c1 e1 10 41 c1 e0 12 44 09 c1 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3c 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 74 64 c6 07 01
[ 544.299176] RSP: 0000:ffffbdad80927ba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 544.300793] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 00000000000c0000
[ 544.302348] RDX: ffffa03f7e9ec400 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 544.303892] RBP: ffffa03f72a78140 R08: 00000000000c0000 R09: 0000000000000000
[ 544.305434] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 544.306996] R13: ffffa03f72a78140 R14: 0000000000003008 R15: 0000000000000000
[ 544.308548] FS: 00007fe19aa85740(0000) GS:ffffa03f7e800000(0000) knlGS:0000000000000000
[ 544.310205] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 544.311583] CR2: 00007fe195b80010 CR3: 0000000032d2a004 CR4: 0000000000160ee0
[ 544.313123] Call Trace:
[ 544.314114] do_raw_spin_lock+0xab/0xb0
[ 544.315249] _raw_spin_lock+0x63/0x80
[ 544.316348] __swp_swapcount+0xb9/0xf0
[ 544.317448] __read_swap_cache_async+0xc0/0x3e0
[ 544.318640] swap_cluster_readahead+0x184/0x330
[ 544.319824] ? find_held_lock+0x32/0x90
[ 544.320929] swapin_readahead+0x2b4/0x4e0
[ 544.322049] ? sched_clock_cpu+0xc/0xc0
[ 544.323149] do_swap_page+0x3ac/0xc20
[ 544.324214] __handle_mm_fault+0x8da/0x1900
[ 544.325333] handle_mm_fault+0x159/0x340
[ 544.326415] do_user_addr_fault+0x1fe/0x480
[ 544.327527] do_page_fault+0x31/0x210
[ 544.328579] page_fault+0x3e/0x50
[ 544.329587] RIP: 0033:0x56292b3c6298
[ 544.330620] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 544.332777] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [stress:1826]
[ 544.334051] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 544.339223] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 544.340484] RAX: 000000000697a000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 544.340486] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 544.378414] irq event stamp: 54583407
[ 544.379941] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 544.379942] R10: 00007fe195b7f010 R11: 0000000000000246 R12: 000056292b3c8004
[ 544.385253] hardirqs last enabled at (54583407): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 544.385255] hardirqs last disabled at (54583406): [<ffffffffa5001c8a>] trace_hardirqs_off_thunk+0x1a/0x20
[ 544.386363] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 544.416008] softirqs last enabled at (54583144): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 544.422311] softirqs last disabled at (54583095): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 544.428328] CPU: 3 PID: 1826 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 544.434008] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 544.440168] RIP: 0010:queued_spin_lock_slowpath+0x184/0x1e0
[ 544.444438] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb
[ 544.457352] RSP: 0000:ffffbdad8090f678 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 544.462906] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000100000
[ 544.468187] RDX: ffffa03f7ebec400 RSI: 0000000000000002 RDI: ffffa03f72a78140
[ 544.473467] RBP: ffffa03f72a78140 R08: 0000000000100000 R09: 0000000000000000
[ 544.478750] R10: 0000000000000005 R11: 0000000000000000 R12: ffffa03f72a78158
[ 544.484030] R13: ffffa03f72140a28 R14: 0000000000000001 R15: 00000007fe192300
[ 544.489384] FS: 00007fe19aa85740(0000) GS:ffffa03f7ea00000(0000) knlGS:0000000000000000
[ 544.495368] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 544.499834] CR2: 00007fe19a8e3010 CR3: 000000003747e001 CR4: 0000000000160ee0
[ 544.505211] Call Trace:
[ 544.507539] do_raw_spin_lock+0xab/0xb0
[ 544.510776] _raw_spin_lock+0x63/0x80
[ 544.513883] __swap_duplicate+0x163/0x220
[ 544.517215] swap_duplicate+0x16/0x40
[ 544.520330] try_to_unmap_one+0x81c/0xe20
[ 544.523665] rmap_walk_anon+0x173/0x390
[ 544.526886] try_to_unmap+0xfe/0x150
[ 544.529938] ? page_remove_rmap+0x490/0x490
[ 544.533372] ? page_not_mapped+0x20/0x20
[ 544.536652] ? page_get_anon_vma+0x1c0/0x1c0
[ 544.540150] shrink_page_list+0xf2f/0x1830
[ 544.543438] shrink_inactive_list+0x1da/0x460
[ 544.547003] shrink_node_memcg+0x202/0x770
[ 544.550394] shrink_node+0xdf/0x490
[ 544.553379] do_try_to_free_pages+0xdb/0x3c0
[ 544.556855] try_to_free_pages+0x112/0x2e0
[ 544.560222] __alloc_pages_slowpath+0x422/0x1000
[ 544.563911] ? __lock_acquire+0x247/0x1900
[ 544.567241] __alloc_pages_nodemask+0x37f/0x400
[ 544.570825] alloc_pages_vma+0xcc/0x170
[ 544.573938] ? _raw_spin_unlock+0x24/0x30
[ 544.577144] __handle_mm_fault+0x996/0x1900
[ 544.580438] handle_mm_fault+0x159/0x340
[ 544.583554] do_user_addr_fault+0x1fe/0x480
[ 544.586849] do_page_fault+0x31/0x210
[ 544.589793] page_fault+0x3e/0x50
[ 544.592500] RIP: 0033:0x56292b3c6250
[ 544.595373] Code: 0f 84 88 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f f1 00 00 00 31 c0 4d 85 ff 7e 12 0f 1f 44 00 00 <c6> 44 05 00 5a 4c 01 f0 49 39 c7 7f f3 48 85 db 0f 84 dd 01 00 00
[ 544.610200] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 544.614208] RAX: 00000000057fa000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 544.619442] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 544.624677] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 544.629895] R10: 0000000000000022 R11: 0000000000000246 R12: 000056292b3c8004
[ 544.635032] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 552.210269] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! [stress:1825]
[ 552.215166] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 552.252061] irq event stamp: 51916057
[ 552.254983] hardirqs last enabled at (51916057): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 552.261612] hardirqs last disabled at (51916055): [<ffffffffa5c002ca>] __do_softirq+0x2ca/0x451
[ 552.267735] softirqs last enabled at (51916056): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 552.273848] softirqs last disabled at (51916051): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 552.279594] CPU: 1 PID: 1825 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 552.285094] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 552.291100] RIP: 0010:queued_spin_lock_slowpath+0x42/0x1e0
[ 552.295185] Code: 49 f0 0f ba 2f 08 0f 92 c0 0f b6 c0 c1 e0 08 89 c2 8b 07 30 e4 09 d0 a9 00 01 ff ff 75 23 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 65 48 ff 05 e8 f7 09 5b
[ 552.308319] RSP: 0000:ffffbdad808ffd30 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 552.313768] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 8888888888888889
[ 552.318937] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 552.324119] RBP: ffffa03f72a78140 R08: 0000006b4aaec605 R09: 0000000000000000
[ 552.329303] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 552.334511] R13: 0000000000054742 R14: 0000000000054742 R15: ffffef5bc0a37000
[ 552.339706] FS: 00007fe19aa85740(0000) GS:ffffa03f7e600000(0000) knlGS:0000000000000000
[ 552.345512] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 552.349834] CR2: 00007fe1966e7010 CR3: 000000002f44c002 CR4: 0000000000160ee0
[ 552.355045] Call Trace:
[ 552.357296] do_raw_spin_lock+0xab/0xb0
[ 552.360434] _raw_spin_lock+0x63/0x80
[ 552.363453] __swap_entry_free.constprop.0+0x82/0xa0
[ 552.367305] do_swap_page+0x608/0xc20
[ 552.370333] __handle_mm_fault+0x8da/0x1900
[ 552.373694] handle_mm_fault+0x159/0x340
[ 552.376883] do_user_addr_fault+0x1fe/0x480
[ 552.380248] do_page_fault+0x31/0x210
[ 552.383279] page_fault+0x3e/0x50
[ 552.386087] RIP: 0033:0x56292b3c6298
[ 552.389059] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 552.402388] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 552.406445] RAX: 00000000074e1000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 552.411710] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 552.416954] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 552.422186] R10: 00007fe1966e6010 R11: 0000000000000246 R12: 000056292b3c8004
[ 552.427421] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 572.148323] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [stress:1829]
[ 572.152844] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 572.185489] irq event stamp: 52028096
[ 572.188266] hardirqs last enabled at (52028095): [<ffffffffa59d6b09>] _raw_spin_unlock_irq+0x29/0x40
[ 572.194061] hardirqs last disabled at (52028096): [<ffffffffa59d6891>] _raw_spin_lock_irq+0x11/0x80
[ 572.199707] softirqs last enabled at (52027220): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 572.205131] softirqs last disabled at (52027211): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 572.210291] CPU: 0 PID: 1829 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 572.215218] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 572.220547] RIP: 0010:queued_spin_lock_slowpath+0x184/0x1e0
[ 572.224284] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb
[ 572.235954] RSP: 0018:ffffbdad80947c80 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 572.240795] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000040000
[ 572.245362] RDX: ffffa03f7e5ec400 RSI: 0000000000000003 RDI: ffffa03f72a78140
[ 572.249959] RBP: ffffa03f72a78140 R08: 0000000000040000 R09: 0000000000000000
[ 572.254502] R10: 0000000000000000 R11: 0000000000000000 R12: ffffa03f72a78158
[ 572.259069] R13: 00000000000368f5 R14: 00000000000368f5 R15: 07fffffff92e1402
[ 572.263658] FS: 0000000000000000(0000) GS:ffffa03f7e400000(0000) knlGS:0000000000000000
[ 572.268756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 572.271321] watchdog: BUG: soft lockup - CPU#2 stuck for 22s! [stress:1828]
[ 572.272557] CR2: 00007fe19ac482c8 CR3: 0000000015212003 CR4: 0000000000160ef0
[ 572.274147] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 572.278468] Call Trace:
[ 572.289766] irq event stamp: 48861275
[ 572.289770] hardirqs last enabled at (48861275): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 572.291800] do_raw_spin_lock+0xab/0xb0
[ 572.293120] hardirqs last disabled at (48861273): [<ffffffffa5c002ca>] __do_softirq+0x2ca/0x451
[ 572.293122] softirqs last enabled at (48861274): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 572.298696] _raw_spin_lock+0x63/0x80
[ 572.300067] softirqs last disabled at (48861267): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 572.300069] CPU: 2 PID: 1828 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 572.305251] __swap_entry_free.constprop.0+0x82/0xa0
[ 572.307283] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 572.307286] RIP: 0010:queued_spin_lock_slowpath+0x124/0x1e0
[ 572.309978] free_swap_and_cache+0x35/0x70
[ 572.312004] Code: 00 89 1d 00 eb a1 41 83 c0 01 c1 e1 10 41 c1 e0 12 44 09 c1 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3c 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 74 64 c6 07 01
[ 572.316733] unmap_page_range+0x4c8/0xd00
[ 572.318274] RSP: 0000:ffffbdad80927ba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 572.323421] unmap_vmas+0x70/0xd0
[ 572.325061] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 00000000000c0000
[ 572.325062] RDX: ffffa03f7e9ec400 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 572.327971] exit_mmap+0x9d/0x190
[ 572.332322] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [stress:1826]
[ 572.332322] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 572.332334] irq event stamp: 54583407
[ 572.332336] hardirqs last enabled at (54583407): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 572.332338] hardirqs last disabled at (54583406): [<ffffffffa5001c8a>] trace_hardirqs_off_thunk+0x1a/0x20
[ 572.332339] softirqs last enabled at (54583144): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 572.332341] softirqs last disabled at (54583095): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 572.332342] CPU: 3 PID: 1826 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 572.332343] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 572.332345] RIP: 0010:queued_spin_lock_slowpath+0x187/0x1e0
[ 572.332346] Code: 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 8b 42 08 <85> c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb 89 b9 01
[ 572.332347] RSP: 0000:ffffbdad8090f678 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 572.332348] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000100000
[ 572.332349] RDX: ffffa03f7ebec400 RSI: 0000000000000002 RDI: ffffa03f72a78140
[ 572.332349] RBP: ffffa03f72a78140 R08: 0000000000100000 R09: 0000000000000000
[ 572.332350] R10: 0000000000000005 R11: 0000000000000000 R12: ffffa03f72a78158
[ 572.332350] R13: ffffa03f72140a28 R14: 0000000000000001 R15: 00000007fe192300
[ 572.332353] FS: 00007fe19aa85740(0000) GS:ffffa03f7ea00000(0000) knlGS:0000000000000000
[ 572.332354] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 572.332354] CR2: 00007fe19a8e3010 CR3: 000000003747e001 CR4: 0000000000160ee0
[ 572.332355] Call Trace:
[ 572.332356] do_raw_spin_lock+0xab/0xb0
[ 572.332359] _raw_spin_lock+0x63/0x80
[ 572.332361] __swap_duplicate+0x163/0x220
[ 572.332363] swap_duplicate+0x16/0x40
[ 572.332365] try_to_unmap_one+0x81c/0xe20
[ 572.332370] rmap_walk_anon+0x173/0x390
[ 572.332370] RBP: ffffa03f72a78140 R08: 00000000000c0000 R09: 0000000000000000
[ 572.332371] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 572.332372] try_to_unmap+0xfe/0x150
[ 572.332374] ? page_remove_rmap+0x490/0x490
[ 572.332375] ? page_not_mapped+0x20/0x20
[ 572.332376] ? page_get_anon_vma+0x1c0/0x1c0
[ 572.332378] shrink_page_list+0xf2f/0x1830
[ 572.332382] shrink_inactive_list+0x1da/0x460
[ 572.332386] shrink_node_memcg+0x202/0x770
[ 572.332390] shrink_node+0xdf/0x490
[ 572.332394] do_try_to_free_pages+0xdb/0x3c0
[ 572.332396] try_to_free_pages+0x112/0x2e0
[ 572.332400] __alloc_pages_slowpath+0x422/0x1000
[ 572.332402] ? __lock_acquire+0x247/0x1900
[ 572.332407] __alloc_pages_nodemask+0x37f/0x400
[ 572.332411] alloc_pages_vma+0xcc/0x170
[ 572.332412] ? _raw_spin_unlock+0x24/0x30
[ 572.332414] __handle_mm_fault+0x996/0x1900
[ 572.332418] handle_mm_fault+0x159/0x340
[ 572.332421] do_user_addr_fault+0x1fe/0x480
[ 572.332424] do_page_fault+0x31/0x210
[ 572.332426] page_fault+0x3e/0x50
[ 572.332427] RIP: 0033:0x56292b3c6250
[ 572.332429] Code: 0f 84 88 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f f1 00 00 00 31 c0 4d 85 ff 7e 12 0f 1f 44 00 00 <c6> 44 05 00 5a 4c 01 f0 49 39 c7 7f f3 48 85 db 0f 84 dd 01 00 00
[ 572.332429] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 572.332430] RAX: 00000000057fa000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 572.332431] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 572.332431] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 572.332432] R10: 0000000000000022 R11: 0000000000000246 R12: 000056292b3c8004
[ 572.332432] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 572.335268] mmput+0x74/0x150
[ 572.337196] R13: ffffa03f72a78140 R14: 0000000000003008 R15: 0000000000000000
[ 572.337199] FS: 00007fe19aa85740(0000) GS:ffffa03f7e800000(0000) knlGS:0000000000000000
[ 572.339758] do_exit+0x2e0/0xcd0
[ 572.341634] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 572.341635] CR2: 00007fe195b80010 CR3: 0000000032d2a004 CR4: 0000000000160ee0
[ 572.346096] rewind_stack_do_exit+0x17/0x20
[ 572.347398] Call Trace:
[ 572.461377] do_raw_spin_lock+0xab/0xb0
[ 572.462412] _raw_spin_lock+0x63/0x80
[ 572.463435] __swp_swapcount+0xb9/0xf0
[ 572.464434] __read_swap_cache_async+0xc0/0x3e0
[ 572.465574] swap_cluster_readahead+0x184/0x330
[ 572.466702] ? find_held_lock+0x32/0x90
[ 572.467752] swapin_readahead+0x2b4/0x4e0
[ 572.468816] ? sched_clock_cpu+0xc/0xc0
[ 572.469864] do_swap_page+0x3ac/0xc20
[ 572.470874] __handle_mm_fault+0x8da/0x1900
[ 572.471944] handle_mm_fault+0x159/0x340
[ 572.472965] do_user_addr_fault+0x1fe/0x480
[ 572.474035] do_page_fault+0x31/0x210
[ 572.475040] page_fault+0x3e/0x50
[ 572.476005] RIP: 0033:0x56292b3c6298
[ 572.477006] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 572.480612] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 572.481891] RAX: 000000000697a000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 572.483447] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 572.484978] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 572.486533] R10: 00007fe195b7f010 R11: 0000000000000246 R12: 000056292b3c8004
[ 572.488068] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 580.210343] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! [stress:1825]
[ 580.215303] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 580.253056] irq event stamp: 51916057
[ 580.256090] hardirqs last enabled at (51916057): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 580.262915] hardirqs last disabled at (51916055): [<ffffffffa5c002ca>] __do_softirq+0x2ca/0x451
[ 580.269199] softirqs last enabled at (51916056): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 580.275464] softirqs last disabled at (51916051): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 580.281432] CPU: 1 PID: 1825 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 580.287069] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 580.293221] RIP: 0010:queued_spin_lock_slowpath+0x42/0x1e0
[ 580.297420] Code: 49 f0 0f ba 2f 08 0f 92 c0 0f b6 c0 c1 e0 08 89 c2 8b 07 30 e4 09 d0 a9 00 01 ff ff 75 23 85 c0 74 0e 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 65 48 ff 05 e8 f7 09 5b
[ 580.310858] RSP: 0000:ffffbdad808ffd30 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 580.316441] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 8888888888888889
[ 580.321732] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 580.327024] RBP: ffffa03f72a78140 R08: 0000006b4aaec605 R09: 0000000000000000
[ 580.332311] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 580.337595] R13: 0000000000054742 R14: 0000000000054742 R15: ffffef5bc0a37000
[ 580.342881] FS: 00007fe19aa85740(0000) GS:ffffa03f7e600000(0000) knlGS:0000000000000000
[ 580.348786] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 580.353182] CR2: 00007fe1966e7010 CR3: 000000002f44c002 CR4: 0000000000160ee0
[ 580.358487] Call Trace:
[ 580.360768] do_raw_spin_lock+0xab/0xb0
[ 580.363953] _raw_spin_lock+0x63/0x80
[ 580.367026] __swap_entry_free.constprop.0+0x82/0xa0
[ 580.370937] do_swap_page+0x608/0xc20
[ 580.374014] __handle_mm_fault+0x8da/0x1900
[ 580.377421] handle_mm_fault+0x159/0x340
[ 580.380655] do_user_addr_fault+0x1fe/0x480
[ 580.384063] do_page_fault+0x31/0x210
[ 580.387133] page_fault+0x3e/0x50
[ 580.389980] RIP: 0033:0x56292b3c6298
[ 580.392988] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 580.406532] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 580.410655] RAX: 00000000074e1000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 580.415998] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 580.421322] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 580.426638] R10: 00007fe1966e6010 R11: 0000000000000246 R12: 000056292b3c8004
[ 580.431941] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 600.148397] watchdog: BUG: soft lockup - CPU#0 stuck for 22s! [stress:1829]
[ 600.152651] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 600.183217] irq event stamp: 52028096
[ 600.185806] hardirqs last enabled at (52028095): [<ffffffffa59d6b09>] _raw_spin_unlock_irq+0x29/0x40
[ 600.191147] hardirqs last disabled at (52028096): [<ffffffffa59d6891>] _raw_spin_lock_irq+0x11/0x80
[ 600.196357] softirqs last enabled at (52027220): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 600.201424] softirqs last disabled at (52027211): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 600.206253] CPU: 0 PID: 1829 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 600.210853] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 600.215858] RIP: 0010:queued_spin_lock_slowpath+0x184/0x1e0
[ 600.219425] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb
[ 600.230335] RSP: 0018:ffffbdad80947c80 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 600.234884] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000040000
[ 600.239182] RDX: ffffa03f7e5ec400 RSI: 0000000000000003 RDI: ffffa03f72a78140
[ 600.243452] RBP: ffffa03f72a78140 R08: 0000000000040000 R09: 0000000000000000
[ 600.247715] R10: 0000000000000000 R11: 0000000000000000 R12: ffffa03f72a78158
[ 600.251974] R13: 00000000000368f5 R14: 00000000000368f5 R15: 07fffffff92e1402
[ 600.256284] FS: 0000000000000000(0000) GS:ffffa03f7e400000(0000) knlGS:0000000000000000
[ 600.261069] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 600.264635] CR2: 00007fe19ac482c8 CR3: 0000000015212003 CR4: 0000000000160ef0
[ 600.268896] Call Trace:
[ 600.270844] do_raw_spin_lock+0xab/0xb0
[ 600.271395] watchdog: BUG: soft lockup - CPU#2 stuck for 23s! [stress:1828]
[ 600.273433] _raw_spin_lock+0x63/0x80
[ 600.274902] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 600.277428] __swap_entry_free.constprop.0+0x82/0xa0
[ 600.287959] irq event stamp: 48861275
[ 600.287963] hardirqs last enabled at (48861275): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 600.291248] free_swap_and_cache+0x35/0x70
[ 600.292575] hardirqs last disabled at (48861273): [<ffffffffa5c002ca>] __do_softirq+0x2ca/0x451
[ 600.292577] softirqs last enabled at (48861274): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 600.298178] unmap_page_range+0x4c8/0xd00
[ 600.299600] softirqs last disabled at (48861267): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 600.299602] CPU: 2 PID: 1828 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 600.304843] unmap_vmas+0x70/0xd0
[ 600.306905] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 600.306908] RIP: 0010:queued_spin_lock_slowpath+0x124/0x1e0
[ 600.309746] exit_mmap+0x9d/0x190
[ 600.311722] Code: 00 89 1d 00 eb a1 41 83 c0 01 c1 e1 10 41 c1 e0 12 44 09 c1 89 c8 c1 e8 10 66 87 47 02 89 c6 c1 e6 10 75 3c 31 f6 eb 02 f3 90 <8b> 07 66 85 c0 75 f7 41 89 c0 66 45 31 c0 41 39 c8 74 64 c6 07 01
[ 600.316430] mmput+0x74/0x150
[ 600.317712] RSP: 0000:ffffbdad80927ba8 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[ 600.322866] do_exit+0x2e0/0xcd0
[ 600.324479] RAX: 0000000000040101 RBX: ffffa03f72a78140 RCX: 00000000000c0000
[ 600.324480] RDX: ffffa03f7e9ec400 RSI: 0000000000000000 RDI: ffffa03f72a78140
[ 600.327009] rewind_stack_do_exit+0x17/0x20
[ 600.331338] RBP: ffffa03f72a78140 R08: 00000000000c0000 R09: 0000000000000000
[ 600.331339] R10: 0000000000000002 R11: 0000000000000000 R12: ffffa03f72a78158
[ 600.332395] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [stress:1826]
[ 600.332396] Modules linked in: ip6t_rpfilter ip6t_REJECT nf_reject_ipv6 ipt_REJECT nf_reject_ipv4 xt_conntrack ip6table_nat ip6table_mangle ip6table_raw ip6table_security iptable_nat nf_nat iptable_mangle iptable_raw iptable_security nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c ip_set nfnetlink ip6table_filter ip6_tables iptable_filter ip_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_net virtio_balloon net_failover failover intel_agp intel_gtt qxl drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm crc32c_intel serio_raw virtio_blk virtio_console agpgart qemu_fw_cfg
[ 600.332408] irq event stamp: 54583407
[ 600.332411] hardirqs last enabled at (54583407): [<ffffffffa5001c6a>] trace_hardirqs_on_thunk+0x1a/0x20
[ 600.332412] hardirqs last disabled at (54583406): [<ffffffffa5001c8a>] trace_hardirqs_off_thunk+0x1a/0x20
[ 600.332414] softirqs last enabled at (54583144): [<ffffffffa5c00351>] __do_softirq+0x351/0x451
[ 600.332415] softirqs last disabled at (54583095): [<ffffffffa50c9821>] irq_exit+0xf1/0x100
[ 600.332417] CPU: 3 PID: 1826 Comm: stress Tainted: G D W L 5.3.0-rc5+ #71
[ 600.332417] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.12.0-2.fc30 04/01/2014
[ 600.332419] RIP: 0010:queued_spin_lock_slowpath+0x184/0x1e0
[ 600.332421] Code: c1 ee 12 83 e0 03 83 ee 01 48 c1 e0 04 48 63 f6 48 05 00 c4 1e 00 48 03 04 f5 a0 96 18 a6 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8b 48 89 c6 0f 18 08 eb
[ 600.332421] RSP: 0000:ffffbdad8090f678 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[ 600.332422] RAX: 0000000000000000 RBX: ffffa03f72a78140 RCX: 0000000000100000
[ 600.332423] RDX: ffffa03f7ebec400 RSI: 0000000000000002 RDI: ffffa03f72a78140
[ 600.332423] RBP: ffffa03f72a78140 R08: 0000000000100000 R09: 0000000000000000
[ 600.332424] R10: 0000000000000005 R11: 0000000000000000 R12: ffffa03f72a78158
[ 600.332424] R13: ffffa03f72140a28 R14: 0000000000000001 R15: 00000007fe192300
[ 600.332427] FS: 00007fe19aa85740(0000) GS:ffffa03f7ea00000(0000) knlGS:0000000000000000
[ 600.332428] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 600.332428] CR2: 00007fe19a8e3010 CR3: 000000003747e001 CR4: 0000000000160ee0
[ 600.332429] Call Trace:
[ 600.332430] do_raw_spin_lock+0xab/0xb0
[ 600.332433] _raw_spin_lock+0x63/0x80
[ 600.332435] __swap_duplicate+0x163/0x220
[ 600.332437] swap_duplicate+0x16/0x40
[ 600.332438] try_to_unmap_one+0x81c/0xe20
[ 600.332443] rmap_walk_anon+0x173/0x390
[ 600.332446] try_to_unmap+0xfe/0x150
[ 600.332447] ? page_remove_rmap+0x490/0x490
[ 600.332448] ? page_not_mapped+0x20/0x20
[ 600.332449] ? page_get_anon_vma+0x1c0/0x1c0
[ 600.332451] shrink_page_list+0xf2f/0x1830
[ 600.332455] shrink_inactive_list+0x1da/0x460
[ 600.332459] shrink_node_memcg+0x202/0x770
[ 600.332464] shrink_node+0xdf/0x490
[ 600.332468] do_try_to_free_pages+0xdb/0x3c0
[ 600.332470] try_to_free_pages+0x112/0x2e0
[ 600.332473] __alloc_pages_slowpath+0x422/0x1000
[ 600.332476] ? __lock_acquire+0x247/0x1900
[ 600.332481] __alloc_pages_nodemask+0x37f/0x400
[ 600.332484] alloc_pages_vma+0xcc/0x170
[ 600.332486] ? _raw_spin_unlock+0x24/0x30
[ 600.332488] __handle_mm_fault+0x996/0x1900
[ 600.332492] handle_mm_fault+0x159/0x340
[ 600.332495] do_user_addr_fault+0x1fe/0x480
[ 600.332498] do_page_fault+0x31/0x210
[ 600.332499] page_fault+0x3e/0x50
[ 600.332501] RIP: 0033:0x56292b3c6250
[ 600.332502] Code: 0f 84 88 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f f1 00 00 00 31 c0 4d 85 ff 7e 12 0f 1f 44 00 00 <c6> 44 05 00 5a 4c 01 f0 49 39 c7 7f f3 48 85 db 0f 84 dd 01 00 00
[ 600.332503] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 600.332504] RAX: 00000000057fa000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 600.332504] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 600.332505] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 600.332505] R10: 0000000000000022 R11: 0000000000000246 R12: 000056292b3c8004
[ 600.332506] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
[ 600.442875] R13: ffffa03f72a78140 R14: 0000000000003008 R15: 0000000000000000
[ 600.444392] FS: 00007fe19aa85740(0000) GS:ffffa03f7e800000(0000) knlGS:0000000000000000
[ 600.446002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 600.447311] CR2: 00007fe195b80010 CR3: 0000000032d2a004 CR4: 0000000000160ee0
[ 600.448821] Call Trace:
[ 600.449660] do_raw_spin_lock+0xab/0xb0
[ 600.450668] _raw_spin_lock+0x63/0x80
[ 600.451646] __swp_swapcount+0xb9/0xf0
[ 600.452623] __read_swap_cache_async+0xc0/0x3e0
[ 600.453721] swap_cluster_readahead+0x184/0x330
[ 600.454802] ? find_held_lock+0x32/0x90
[ 600.455809] swapin_readahead+0x2b4/0x4e0
[ 600.456819] ? sched_clock_cpu+0xc/0xc0
[ 600.457816] do_swap_page+0x3ac/0xc20
[ 600.458779] __handle_mm_fault+0x8da/0x1900
[ 600.459809] handle_mm_fault+0x159/0x340
[ 600.460816] do_user_addr_fault+0x1fe/0x480
[ 600.461872] do_page_fault+0x31/0x210
[ 600.462845] page_fault+0x3e/0x50
[ 600.463755] RIP: 0033:0x56292b3c6298
[ 600.464692] Code: 7e 01 00 00 89 df e8 47 e1 ff ff 44 8b 2d 84 4d 00 00 4d 85 ff 7e 40 31 c0 eb 0f 0f 1f 80 00 00 00 00 4c 01 f0 49 39 c7 7e 2d <80> 7c 05 00 5a 4c 8d 54 05 00 74 ec 4c 89 14 24 45 85 ed 0f 89 de
[ 600.468249] RSP: 002b:00007fffd016cc20 EFLAGS: 00010206
[ 600.469475] RAX: 000000000697a000 RBX: ffffffffffffffff RCX: 00007fe19ab7e156
[ 600.470991] RDX: 0000000000000000 RSI: 000000000b87f000 RDI: 0000000000000000
[ 600.472491] RBP: 00007fe18f206010 R08: 00007fe18f206010 R09: 0000000000000000
[ 600.474035] R10: 00007fe195b7f010 R11: 0000000000000246 R12: 000056292b3c8004
[ 600.475588] R13: 0000000000000002 R14: 0000000000001000 R15: 000000000b87ec00
next prev parent reply other threads:[~2019-08-19 18:28 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-08-18 18:36 Markus Linnala
2019-08-19 7:34 ` Michal Hocko
2019-08-19 14:42 ` Vitaly Wool
2019-08-19 15:27 ` Vitaly Wool
2019-08-19 16:53 ` Markus Linnala
2019-08-19 17:11 ` Vitaly Wool
2019-08-19 17:49 ` Markus Linnala
2019-08-19 18:27 ` Markus Linnala
2019-08-19 18:28 ` Markus Linnala [this message]
2019-08-19 19:22 ` Markus Linnala
2019-08-19 19:44 ` Vitaly Wool
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAH6yVy3R9DXsxT9PXS5ySj3mkjEaE0H8K53fSASsO+w-EvOPZA@mail.gmail.com \
--to=markus.linnala@gmail.com \
--cc=ddstreet@ieee.org \
--cc=linux-mm@kvack.org \
--cc=mhocko@kernel.org \
--cc=sjenning@redhat.com \
--cc=vitalywool@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox