From: Christian Kujau <lists@nerdbynature.de>
To: Benjamin Herrenschmidt <benh@kernel.crashing.org>
Cc: Eric Dumazet <eric.dumazet@gmail.com>,
Christoph Lameter <cl@linux.com>,
Markus Trippelsdorf <markus@trippelsdorf.de>,
"Alex,Shi" <alex.shi@intel.com>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"linux-mm@kvack.org" <linux-mm@kvack.org>,
Pekka Enberg <penberg@kernel.org>, Matt Mackall <mpm@selenic.com>,
"netdev@vger.kernel.org" <netdev@vger.kernel.org>,
Tejun Heo <tj@kernel.org>
Subject: Re: WARNING: at mm/slub.c:3357, kernel BUG at mm/slub.c:3413
Date: Tue, 22 Nov 2011 21:51:56 -0800 (PST) [thread overview]
Message-ID: <alpine.DEB.2.01.1111222145470.8000@trent.utfs.org> (raw)
In-Reply-To: <1322007501.14573.15.camel@pasglop>
[-- Attachment #1: Type: TEXT/PLAIN, Size: 1132 bytes --]
On Wed, 23 Nov 2011 at 11:18, Benjamin Herrenschmidt wrote:
> I'd say only this one liner for now, just don't do slabinfo :-) I just
> want to see whether your network + heavy IO load problem goes away with
> that one patch.
OK, with Christoph's patch applied, 3.2.0-rc2-00274-g6fe4c6d-dirty survives
on this machine, with the disk & cpu workload that caused the machine to
panic w/o the patch. Load was at 4-5 this time, which is expected for this
box. I'll run a few more tests later on, but it seems ok for now.
I couldn't resist and ran "slabinfo" anyway (after the workload!) - the
box survived, nothing was printed in syslog either. Output attached.
Thanks!
Christian.
--- linux-2.6.orig/mm/slub.c 2011-11-21 21:15:41.575673204 -0600
+++ linux-2.6/mm/slub.c 2011-11-21 21:16:33.442336849 -0600
@@ -1969,7 +1969,7 @@
page->pobjects = pobjects;
page->next = oldpage;
- } while (this_cpu_cmpxchg(s->cpu_slab->partial, oldpage, page) != oldpage);
+ } while (irqsafe_cpu_cmpxchg(s->cpu_slab->partial, oldpage, page) != oldpage);
stat(s, CPU_PARTIAL_FREE);
return pobjects;
}
--
BOFH excuse #6:
global warming
[-- Attachment #2: Type: TEXT/plain, Size: 6091 bytes --]
Name Objects Objsize Space Slabs/Part/Cpu O/S O %Fr %Ef Flg
:at-0000040 102 36 4.0K 0/0/1 102 0 0 89 *a
:at-0000064 41288 64 4.0M 964/565/15 64 0 57 65 *a
:t-0000008 2048 8 16.3K 4294967078/0/222 512 0 0 100 *
:t-0000016 2624 16 94.2K 4294967069/15/250 256 0 65 44 *
:t-0000024 3279 24 98.3K 19/17/5 170 0 70 80 *
:t-0000032 750 32 28.6K 4294967175/4/128 128 0 57 83 *
:t-0000056 771 56 69.6K 17/7/0 73 0 41 62 *
:t-0000064 5226 64 610.3K 137/101/12 64 0 67 54 *
:t-0000072 112 72 8.1K 4294967253/0/45 56 0 0 98 *
:t-0000088 4013 88 360.4K 69/3/19 46 0 3 97 *
:t-0000096 9184 96 1.0M 239/72/23 42 0 27 82 *
:t-0000104 26 104 4.0K 1/1/0 39 0 100 66 *
:t-0000128 2127 128 512.0K 106/91/19 32 0 72 53 *
:t-0000144 56 144 8.1K 4294967269/0/29 28 0 0 98 *
:t-0000152 430 152 147.4K 11/29/25 26 0 80 44 *
:t-0000160 7000 160 1.1M 268/0/12 25 0 0 97 *A
:t-0000192 2959 192 638.9K 147/24/9 21 0 15 88 *
:t-0000320 9482 320 3.6M 879/167/0 12 0 18 84 *A
:t-0000352 31 352 24.5K 4/4/2 11 0 66 44 *A
:t-0000480 36 480 20.4K 5/1/0 8 0 20 84 *A
:t-0000736 2 728 8.1K 1/1/0 11 1 100 17 *A
:t-0000768 268 768 253.9K 25/9/6 10 1 29 81 *A
:t-0002048 256 2048 573.4K 31/6/4 8 2 17 91 *
:t-0004096 168 4096 720.8K 20/1/2 8 3 4 95 *
anon_vma 2117 88 217.0K 51/4/2 42 0 7 85
arp_cache 6 380 4.0K 1/1/0 10 0 100 55 A
bdev_cache 25 744 24.5K 3/1/0 10 1 33 75 Aa
biovec-128 20 1536 32.7K 4294967287/0/11 10 2 0 93 A
biovec-256 98 3072 360.4K 11/2/0 10 3 18 83 A
blkdev_queue 15 1240 32.7K 2/1/0 13 2 50 56
blkdev_requests 62 216 24.5K 4294967273/3/29 18 0 50 54
dentry 219259 160 36.3M 8842/224/21 25 0 2 96 a
eventpoll_pwq 92 36 20.4K 5/5/0 102 0 100 16
ext4_allocation_context 0 108 4.0K 1/1/0 36 0 100 0 a
ext4_groupinfo_4k 7498 148 1.1M 289/1/0 26 0 0 93 a
ext4_inode_cache 206222 936 199.6M 12177/159/8 17 2 1 10 a
ext4_io_end 13 592 8.1K 0/0/1 13 1 0 93 a
ext4_io_page 512 8 4.0K 0/0/1 512 0 0 100 a
ext4_prealloc_space 17 96 4.0K 1/1/0 42 0 100 39 a
files_cache 90 208 20.4K 4294967288/0/13 18 0 0 91 A
inode_cache 3735 512 2.0M 248/0/1 15 1 0 93 a
jbd2_revoke_record 0 24 4.0K 1/1/0 128 0 100 0 Aa
jbd2_revoke_table 4 12 4.0K 1/1/0 256 0 100 1 a
kmalloc-1024 310 1024 352.2K 36/7/7 8 1 16 90
kmalloc-256 110 256 65.5K 4/13/12 16 0 81 42
kmalloc-512 532 512 282.6K 58/5/11 8 0 7 96
kmalloc-8192 7 8192 98.3K 3/2/0 4 3 66 58
kmem_cache 28 116 4.0K 1/1/0 32 0 100 79 *A
kmem_cache_node 100 60 8.1K 2/1/0 64 0 50 73 *A
mm_struct 70 540 49.1K 4/4/2 15 1 66 76 A
mqueue_inode_cache 1 744 8.1K 1/1/0 10 1 100 9 A
ndisc_cache 2 392 8.1K 1/1/0 19 1 100 9 A
posix_timers_cache 0 136 4.0K 1/1/0 30 0 100 0
proc_inode_cache 1194 544 753.6K 79/24/13 14 1 26 86 a
radix_tree_node 17934 296 6.8M 1669/962/14 13 0 57 77 a
RAWv6 5 896 8.1K 1/1/0 9 1 100 54 A
rpc_inode_cache 12 680 16.3K 2/1/0 11 1 50 49 Aa
sgpool-128 2 2560 32.7K 1/1/0 12 3 100 15 A
sgpool-32 2 640 8.1K 1/1/0 12 1 100 15 A
sgpool-64 2 1280 16.3K 1/1/0 12 2 100 15 A
shmem_inode_cache 700 576 409.6K 42/0/8 14 1 0 98
sighand_cache 141 1356 229.3K 3/3/4 23 3 42 83 A
sock_inode_cache 225 544 155.6K 1/7/18 14 1 36 78 Aa
task_delay_info 159 112 20.4K 4294967295/1/6 36 0 20 86
task_struct 143 2992 524.2K 11/5/5 10 3 31 81
taskstats 1 328 4.0K 1/1/0 12 0 100 8
TCP 59 1480 262.1K 2/6/6 21 3 75 33 A
TCPv6 6 1616 16.3K 1/1/0 10 2 100 59 A
tw_sock_TCP 10 104 4.0K 1/1/0 32 0 100 25 A
UDP 30 744 24.5K 2/0/1 10 1 0 90 A
UDPv6 9 880 8.1K 0/0/1 9 1 0 96 A
xfs_da_state 0 392 4.0K 1/1/0 10 0 100 0
xfs_inode 192270 984 200.9M 24533/1199/0 8 1 4 8 Aa
xfs_log_ticket 1 208 4.0K 1/1/0 19 0 100 5
next prev parent reply other threads:[~2011-11-23 5:52 UTC|newest]
Thread overview: 109+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-11-18 7:25 Markus Trippelsdorf
2011-11-18 7:55 ` Markus Trippelsdorf
2011-11-18 8:43 ` Alex,Shi
2011-11-18 8:54 ` Markus Trippelsdorf
2011-11-18 8:57 ` Markus Trippelsdorf
2011-11-18 12:02 ` Markus Trippelsdorf
2011-11-21 0:44 ` Alex,Shi
2011-11-21 7:29 ` Markus Trippelsdorf
2011-11-21 8:05 ` Markus Trippelsdorf
2011-11-21 8:24 ` Markus Trippelsdorf
2011-11-21 8:56 ` Eric Dumazet
2011-11-21 9:16 ` Eric Dumazet
2011-11-21 13:15 ` Markus Trippelsdorf
2011-11-21 14:16 ` Eric Dumazet
2011-11-21 14:21 ` Markus Trippelsdorf
2011-11-21 15:36 ` Markus Trippelsdorf
2011-11-21 15:48 ` Eric Dumazet
2011-11-21 16:10 ` Markus Trippelsdorf
2011-11-21 16:34 ` Markus Trippelsdorf
2011-11-22 8:36 ` Markus Trippelsdorf
2011-12-19 3:21 ` Eric W. Biederman
2011-12-19 9:19 ` Markus Trippelsdorf
2011-12-19 9:06 ` Eric W. Biederman
2011-11-21 16:52 ` Eric Dumazet
2011-11-21 17:15 ` Eric Dumazet
2011-11-21 17:35 ` Markus Trippelsdorf
2011-11-21 18:39 ` Eric Dumazet
2011-11-21 18:52 ` Markus Trippelsdorf
2011-11-21 19:51 ` Markus Trippelsdorf
2011-11-21 20:27 ` Benjamin Herrenschmidt
2011-11-21 21:30 ` Pekka Enberg
2011-11-21 21:43 ` Christoph Lameter
2011-11-22 0:21 ` Christian Kujau
2011-11-22 0:42 ` Christian Kujau
2011-11-22 2:17 ` Benjamin Herrenschmidt
2011-11-22 8:37 ` Christian Kujau
2011-11-22 3:18 ` Christoph Lameter
2011-11-22 7:48 ` Eric Dumazet
2011-11-22 7:51 ` Markus Trippelsdorf
2011-11-22 8:27 ` Eric Dumazet
2011-11-23 7:13 ` Markus Trippelsdorf
2011-11-23 7:20 ` Eric Dumazet
2011-11-22 8:39 ` Christian Kujau
2011-11-22 22:16 ` Benjamin Herrenschmidt
2011-11-22 22:31 ` Eric Dumazet
2011-11-22 22:32 ` Christoph Lameter
2011-11-22 21:58 ` Benjamin Herrenschmidt
2011-11-22 23:12 ` Christian Kujau
2011-11-23 0:18 ` Benjamin Herrenschmidt
2011-11-23 1:22 ` Christian Kujau
2011-11-23 1:43 ` Benjamin Herrenschmidt
2011-11-23 5:51 ` Christian Kujau [this message]
2011-11-23 6:59 ` Pekka Enberg
2011-11-23 15:14 ` slub: use irqsafe_cpu_cmpxchg for put_cpu_partial Christoph Lameter
2011-11-23 16:04 ` Eric Dumazet
2011-11-23 18:33 ` Christian Kujau
2011-11-24 6:45 ` Pekka Enberg
2011-11-23 23:15 ` David Rientjes
2011-11-22 8:45 ` WARNING: at mm/slub.c:3357, kernel BUG at mm/slub.c:3413 Markus Trippelsdorf
2011-11-22 9:25 ` Eric Dumazet
2011-11-22 9:27 ` Eric Dumazet
2011-11-22 9:38 ` Eric Dumazet
2011-11-22 9:46 ` Eric Dumazet
2011-11-22 14:46 ` Christoph Lameter
2011-11-22 14:52 ` Eric Dumazet
2011-11-22 15:02 ` Christoph Lameter
2011-11-22 15:07 ` Christoph Lameter
2011-11-22 16:20 ` Christoph Lameter
2011-11-22 16:32 ` Eric Dumazet
2011-11-22 16:36 ` Christoph Lameter
2011-11-22 16:41 ` Christoph Lameter
2011-11-22 16:53 ` slub: Lockout validation scans during freeing of object Christoph Lameter
2011-11-22 17:21 ` Eric Dumazet
2011-11-22 17:40 ` Christoph Lameter
2011-11-22 18:55 ` Markus Trippelsdorf
2011-11-22 19:20 ` Christoph Lameter
2011-11-22 19:32 ` Markus Trippelsdorf
2011-11-22 19:46 ` Christoph Lameter
2011-11-22 17:59 ` Christoph Lameter
2011-11-22 11:21 ` WARNING: at mm/slub.c:3357, kernel BUG at mm/slub.c:3413 Markus Trippelsdorf
2011-11-22 14:50 ` Christoph Lameter
2011-11-22 14:44 ` Christoph Lameter
2011-11-21 15:51 ` Markus Trippelsdorf
2011-11-23 16:03 ` Markus Trippelsdorf
2011-11-23 16:06 ` Christoph Lameter
2011-11-24 8:50 ` Markus Trippelsdorf
2011-12-01 8:44 ` Markus Trippelsdorf
2011-12-01 8:53 ` Pekka Enberg
2011-12-02 19:43 ` Jerome Glisse
2011-12-02 20:06 ` Markus Trippelsdorf
2011-12-02 20:48 ` Markus Trippelsdorf
2011-12-07 14:32 ` Robert Richter
2011-12-07 14:39 ` Markus Trippelsdorf
2011-12-02 23:04 ` Jerome Glisse
2011-12-03 9:28 ` Markus Trippelsdorf
2011-12-03 12:20 ` Dave Airlie
2011-12-03 12:29 ` Markus Trippelsdorf
2011-12-03 19:31 ` Jerome Glisse
2011-12-03 19:32 ` Jerome Glisse
2011-12-04 1:02 ` Markus Trippelsdorf
2011-12-04 17:32 ` Jerome Glisse
2011-12-05 17:10 ` Jerome Glisse
2011-12-05 18:15 ` Markus Trippelsdorf
2011-12-05 18:43 ` Jerome Glisse
2011-12-05 19:11 ` Jerome Glisse
2011-12-05 19:27 ` Markus Trippelsdorf
2011-12-05 20:10 ` Pekka Enberg
2011-12-05 20:20 ` Jerome Glisse
2011-12-05 10:44 ` David Laight
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=alpine.DEB.2.01.1111222145470.8000@trent.utfs.org \
--to=lists@nerdbynature.de \
--cc=alex.shi@intel.com \
--cc=benh@kernel.crashing.org \
--cc=cl@linux.com \
--cc=eric.dumazet@gmail.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=markus@trippelsdorf.de \
--cc=mpm@selenic.com \
--cc=netdev@vger.kernel.org \
--cc=penberg@kernel.org \
--cc=tj@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox