From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail.serc.iisc.ernet.in (serc.iisc.ernet.in [10.16.25.10]) by relay.iisc.ernet.in (8.13.1/8.13.1) with ESMTP id m69EDH18021373 for ; Wed, 9 Jul 2008 19:43:17 +0530 Received: from mail.serc.iisc.ernet.in (mail.serc.iisc.ernet.in [10.16.25.10]) by mail.serc.iisc.ernet.in (8.13.1/8.13.1) with ESMTP id m69ERe4n015242 for ; Wed, 9 Jul 2008 19:57:40 +0530 Message-ID: <2206.10.16.10.158.1215613660.squirrel@mail.serc.iisc.ernet.in> Date: Wed, 9 Jul 2008 19:57:40 +0530 (IST) Subject: [Bug]: Oops on ppc64 2.6.5-7.244-pseries64 in mm/objrmap.c From: kiran@serc.iisc.ernet.in MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7BIT Sender: owner-linux-mm@kvack.org Return-Path: To: linux-mm@kvack.org List-ID: -------------- System crashes with Oops message "kernel: kernel BUG in page_add_rmap at mm/objrmap.c" Full Description of the problem: -------------------------------------------- This problem is reported for a particular user executable and it will be always at 4:15 am when cron.daily runs. After this system will crash. key words: ---------------- Related to kernel virtual memory issue Output of Oops: ---------------------- ============================== # ksymoops -k /proc/kallsyms >NIP; c0000000000bb02c <.page_add_rmap+1b4/220> <===== >>GPR2; c00000000071dcc8 >>GPR5; 100037d8 <__crc_journal_start+13fabc/15e971> >>GPR8; 8000000000009032 <__crc_set_user_nice+7fffffff0018cf93/bfffffff00183f61> >>GPR11; 7263f900 <__crc_dequeue_signal+463f3/1f6604> >>GPR12; 28004488 <__crc_xprt_destroy+ec49/4d190e> >>GPR13; c00000000049d000 >>GPR14; 100289f0 <__crc_proc_root+6363/16d759> >>GPR16; 0000000148ce5008 <__crc_set_user_nice+48e68f69/bfffffff00183f61> >>GPR17; 00000001494872a8 <__crc_set_user_nice+4960b209/bfffffff00183f61> >>GPR18; 0000000148e38000 <__crc_set_user_nice+48fbbf61/bfffffff00183f61> >>GPR22; 100037d8 <__crc_journal_start+13fabc/15e971> >>GPR26; 10003000 <__crc_journal_start+13f2e4/15e971> >>GPR28; 000000043b5c0313 <__crc_set_user_nice+33b744274/bfffffff00183f61> >>GPR30; c000000000622100 Trace; c0000000423e7a10 Trace; c0000000000affa4 <.do_no_page+31c/d90> Trace; c0000000423e7b00 Trace; c0000000000b16bc <.handle_mm_fault+228/11f4> Trace; c0000000423e7bd0 Trace; c000000000046b40 <.do_page_fault+4ec/714> Trace; c0000000423e7d10 Trace; c00000000000ae40 2 warnings issued. Results may not be reliable. =================================== Environment: ----------------------- We have IBM open power p720 cluster, running SLES 9 SP3. Software: ----------------------------- cnode41:/usr/src/linux # sh scripts/ver_linux If some fields are empty or look unusual you may have an old version. Compare to the current minimal requirements in Documentation/Changes. Linux cnode41 2.6.5-7.244-pseries64 #1 SMP Mon Dec 12 18:32:25 UTC 2005 ppc64 ppc64 ppc64 GNU/Linux Gnu C 3.3.3 Gnu make 3.80 binutils 2.15.90.0.1.1 util-linux 2.12 mount 2.12 module-init-tools 3.0-pre10 e2fsprogs 1.38 jfsutils 1.1.7 xfsprogs 2.6.25 quota-tools 3.11. PPP 2.4.2 isdn4k-utils 3.4 nfs-utils 1.0.6 Linux C Library x 1 root root 1433982 Aug 9 2006 /lib/tls/ libc.so.6 Dynamic linker (ldd) 2.3.5 Linux C++ Library 5.0.6 Procps 3.2.5 Net-tools 1.60 Kbd 1.12 Sh-utils 5.2.1 Modules Loaded autofs evdev joydev st e1000 pata_pdc2027x libata ehci_hcd ohci_hcd usbcore sg subfs dm_mod ipr firmware_class sr_mod sd_mod scsi_mod Processor information --------------------------------- processor : 0 cpu : POWER5 (gr) clock : 1654.344000MHz revision : 2.3 processor : 2 cpu : POWER5 (gr) clock : 1654.344000MHz revision : 2.3 processor : 4 cpu : POWER5 (gr) clock : 1654.344000MHz revision : 2.2 processor : 6 cpu : POWER5 (gr) clock : 1654.344000MHz revision : 2.2 timebase : 207048000 machine : CHRP IBM,9124-720 Module Informaiton: ----------------------------- autofs 44336 4 - Live 0xd000000000c65000 evdev 31032 0 - Live 0xd000000000c4d000 joydev 31136 0 - Live 0xd000000000c44000 st 73080 0 - Live 0xd000000000bcb000 e1000 207268 0 - Live 0xd000000000c7a000 pata_pdc2027x 33524 1 - Live 0xd000000000bc1000 libata 99632 1 pata_pdc2027x, Live 0xd000000000c20000 ehci_hcd 62332 0 - Live 0xd000000000c0f000 ohci_hcd 45740 0 - Live 0xd000000000bb4000 usbcore 184636 4 ehci_hcd,ohci_hcd, Live 0xd000000000be0000 sg 74048 0 - Live 0xd000000000791000 subfs 29784 1 - Live 0xd00000000062c000 dm_mod 112104 7 - Live 0xd0000000000be000 ipr 107808 2 - Live 0xd0000000000e0000 firmware_class 31872 1 ipr, Live 0xd00000000006e000 sr_mod 44124 0 - Live 0xd00000000004a000 sd_mod 44352 3 - Live 0xd000000000057000 scsi_mod 197464 6 st,libata,sg,ipr,sr_mod,sd_mod, Live 0xd00000000008c000 Loaded driver and hardware information --------------------------------------------------------- cat /proc/modules autofs 44336 4 - Live 0xd000000000c65000 evdev 31032 0 - Live 0xd000000000c4d000 joydev 31136 0 - Live 0xd000000000c44000 st 73080 0 - Live 0xd000000000bcb000 e1000 207268 0 - Live 0xd000000000c7a000 pata_pdc2027x 33524 1 - Live 0xd000000000bc1000 libata 99632 1 pata_pdc2027x, Live 0xd000000000c20000 ehci_hcd 62332 0 - Live 0xd000000000c0f000 ohci_hcd 45740 0 - Live 0xd000000000bb4000 usbcore 184636 4 ehci_hcd,ohci_hcd, Live 0xd000000000be0000 sg 74048 0 - Live 0xd000000000791000 subfs 29784 1 - Live 0xd00000000062c000 dm_mod 112104 7 - Live 0xd0000000000be000 ipr 107808 2 - Live 0xd0000000000e0000 firmware_class 31872 1 ipr, Live 0xd00000000006e000 sr_mod 44124 0 - Live 0xd00000000004a000 sd_mod 44352 3 - Live 0xd000000000057000 scsi_mod 197464 6 st,libata,sg,ipr,sr_mod,sd_mod, Live 0xd00000000008c000 cnode41:/usr/src/linux # cat /proc/ioports 00000000-000fffff : /pci[at]800000020000002 000b0000-000bffff : PCI Bus 0000:d8 000c0000-000cffff : PCI Bus 0000:d0 000d0000-000dffff : PCI Bus 0000:c0 000e0000-000effff : PCI Bus 0000:cc 000eec00-000eec03 : 0000:cc:01.0 000eec00-000eec03 : pata_pdc2027x 000ef000-000ef003 : 0000:cc:01.0 000ef000-000ef003 : pata_pdc2027x 000ef400-000ef407 : 0000:cc:01.0 000ef400-000ef407 : pata_pdc2027x 000ef800-000ef807 : 0000:cc:01.0 000ef800-000ef807 : pata_pdc2027x 000efc00-000efc0f : 0000:cc:01.0 000efc00-000efc0f : pata_pdc2027x 000f0000-000fffff : PCI Bus 0000:c8 00100000-001fffff : /pci[at]800000020000003 001c0000-001cffff : PCI Bus 0001:d8 001d0000-001dffff : PCI Bus 0001:c0 001e0000-001effff : PCI Bus 0001:d0 001f0000-001fffff : PCI Bus 0001:c8 001ff800-001ff83f : 0001:c8:01.0 001ff800-001ff83f : e1000 001ffc00-001ffc3f : 0001:c8:01.1 001ffc00-001ffc3f : e1000 cat /proc/iomem 40080000000-400bfffffff : /pci[at]800000020000002 40080000000-4009fffffff : PCI Bus 0000:d8 400a0000000-400a7ffffff : PCI Bus 0000:d0 400a8000000-400afffffff : PCI Bus 0000:c0 400b0000000-400b7ffffff : PCI Bus 0000:cc 400b0000000-400b0003fff : 0000:cc:01.0 400b0000000-400b0003fff : pata_pdc2027x 400b8000000-400bfefffff : PCI Bus 0000:c8 400b8000000-400b8000fff : 0000:c8:01.1 400b8000000-400b8000fff : ohci_hcd 400b8001000-400b8001fff : 0000:c8:01.0 400b8001000-400b8001fff : ohci_hcd 400b8002000-400b80020ff : 0000:c8:01.2 400b8002000-400b80020ff : ehci_hcd 401c0000000-401ffffffff : /pci[at]800000020000003 401c0000000-401e7ffffff : PCI Bus 0001:d8 401e8000000-401efffffff : PCI Bus 0001:c0 401f0000000-401f7ffffff : PCI Bus 0001:d0 401f0000000-401f07fffff : 0001:d0:01.0 401f0800000-401f08fffff : 0001:d0:01.0 401f0900000-401f093ffff : 0001:d0:01.0 401f0900000-401f093ffff : ipr 401f8000000-401ffefffff : PCI Bus 0001:c8 401f8000000-401f803ffff : 0001:c8:01.1 401f8040000-401f807ffff : 0001:c8:01.1 401f8040000-401f807ffff : e1000 401f8080000-401f80bffff : 0001:c8:01.0 401f80c0000-401f80fffff : 0001:c8:01.0 401f80c0000-401f80fffff : e1000 401f8100000-401f811ffff : 0001:c8:01.1 401f8100000-401f811ffff : e1000 401f8120000-401f813ffff : 0001:c8:01.0 401f8120000-401f813ffff : e1000 PCI infomation ------------------- lspci -vvv 0000:00:02.0 PCI bridge: IBM EADS-X PCI-X to PCI-X Bridge (rev 03) (prog-if 0f) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=slow >TAbort- SERR- (64-bit, prefetchable) Bus: primary=00, secondary=c0, subordinate=c3, sec-latency=0 I/O behind bridge: 000d0000-000dffff Memory behind bridge: e8000000-efffffff Prefetchable memory behind bridge: 0000000000100000-0000000000000000 BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset+ FastB2B- Capabilities: [a0] 0000:00:02.2 PCI bridge: IBM EADS-X PCI-X to PCI-X Bridge (rev 03) (prog-if 0f) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=slow >TAbort- SERR- (64-bit, prefetchable) Bus: primary=00, secondary=c8, subordinate=cb, sec-latency=0 I/O behind bridge: 000f0000-000fffff Memory behind bridge: f8000000-ffefffff Prefetchable memory behind bridge: 0000000000100000-0000000000000000 BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset- FastB2B- Capabilities: [a0] 0000:00:02.3 PCI bridge: IBM EADS-X PCI-X to PCI-X Bridge (rev 03) (prog-if 0f) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=slow >TAbort- SERR- (64-bit, prefetchable) Bus: primary=00, secondary=cc, subordinate=cf, sec-latency=0 I/O behind bridge: 000e0000-000effff Memory behind bridge: f0000000-f7ffffff Prefetchable memory behind bridge: 0000000000100000-0000000000000000 BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset- FastB2B- Capabilities: [a0] 0000:00:02.4 PCI bridge: IBM EADS-X PCI-X to PCI-X Bridge (rev 03) (prog-if 0f) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=slow >TAbort- SERR- (64-bit, prefetchable) Bus: primary=00, secondary=d0, subordinate=d3, sec-latency=0 I/O behind bridge: 000c0000-000cffff Memory behind bridge: e0000000-e7ffffff Prefetchable memory behind bridge: 0000000000100000-0000000000000000 BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset+ FastB2B- Capabilities: [a0] 0000:00:02.6 PCI bridge: IBM EADS-X PCI-X to PCI-X Bridge (rev 03) (prog-if 0f) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=slow >TAbort- SERR- (64-bit, prefetchable) Bus: primary=00, secondary=d8, subordinate=db, sec-latency=0 I/O behind bridge: 000b0000-000bffff Memory behind bridge: c0000000-dfffffff Prefetchable memory behind bridge: 0000000000100000-0000000000000000 BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset+ FastB2B- Capabilities: [a0] 0000:c8:01.0 USB Controller: NEC Corporation USB (rev 43) (prog-if 10 [OHCI]) Subsystem: NEC Corporation USB Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- TAbort- SERR- (64-bit, prefetchable) Bus: primary=00, secondary=c0, subordinate=c3, sec-latency=0 I/O behind bridge: 000d0000-000dffff Memory behind bridge: e8000000-efffffff Prefetchable memory behind bridge: 0000000000100000-0000000000000000 BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset+ FastB2B- Capabilities: [a0] 0001:00:02.2 PCI bridge: IBM EADS-X PCI-X to PCI-X Bridge (rev 03) (prog-if 0f) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=slow >TAbort- SERR- (64-bit, prefetchable) Bus: primary=00, secondary=c8, subordinate=cb, sec-latency=0 I/O behind bridge: 000f0000-000fffff Memory behind bridge: f8000000-ffefffff Prefetchable memory behind bridge: 0000000000100000-0000000000000000 BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset- FastB2B- Capabilities: [a0] 0001:00:02.4 PCI bridge: IBM EADS-X PCI-X to PCI-X Bridge (rev 03) (prog-if 0f) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=slow >TAbort- SERR- (64-bit, prefetchable) Bus: primary=00, secondary=d0, subordinate=d3, sec-latency=0 I/O behind bridge: 000e0000-000effff Memory behind bridge: f0000000-f7ffffff Prefetchable memory behind bridge: 0000000000100000-0000000000000000 BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset- FastB2B- Capabilities: [a0] 0001:00:02.6 PCI bridge: IBM EADS-X PCI-X to PCI-X Bridge (rev 03) (prog-if 0f) Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=slow >TAbort- SERR- (64-bit, prefetchable) Bus: primary=00, secondary=d8, subordinate=db, sec-latency=0 I/O behind bridge: 000c0000-000cffff Memory behind bridge: c0000000-e7ffffff Prefetchable memory behind bridge: 0000000000100000-0000000000000000 BridgeCtl: Parity+ SERR- NoISA- VGA- MAbort- >Reset+ FastB2B- Capabilities: [a0] 0001:c8:01.0 Ethernet controller: Intel Corporation 82546EB Gigabit Ethernet Controller (Copper) (rev 01) Subsystem: IBM: Unknown device 0289 Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- Status: Cap+ 66Mhz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- SERR- TAbort- SERR- TAbort- SERR- email@kvack.org