MCE boot crash in qemu
From: Vegard Nossum
Date: Mon Jun 15 2009 - 07:59:22 EST
Hi,
I get an MCE-related crash like this in latest linus tree:
[ 0.115341] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.116396] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.120570] mce: CPU supports 0 MCE banks
[ 0.124870] BUG: unable to handle kernel NULL pointer dereference at 00000000
00000010
[ 0.128001] IP: [<ffffffff813b98ad>] mcheck_init+0x278/0x320
[ 0.128001] PGD 0
[ 0.128001] Thread overran stack, or stack corrupted
[ 0.128001] Oops: 0002 [#1] PREEMPT SMP
[ 0.128001] last sysfs file:
[ 0.128001] CPU 0
[ 0.128001] Modules linked in:
[ 0.128001] Pid: 0, comm: swapper Not tainted 2.6.30 #426
[ 0.128001] RIP: 0010:[<ffffffff813b98ad>] [<ffffffff813b98ad>] mcheck_init+
0x278/0x320
[ 0.128001] RSP: 0018:ffffffff81595e38 EFLAGS: 00000246
[ 0.128001] RAX: 0000000000000010 RBX: ffffffff8158f900 RCX: 0000000000000000
[ 0.128001] RDX: 0000000000000000 RSI: 00000000000000ff RDI: 0000000000000010
[ 0.128001] RBP: ffffffff81595e68 R08: 0000000000000001 R09: 0000000000000000
[ 0.128001] R10: 0000000000000010 R11: 0000000000000000 R12: 0000000000000000
[ 0.128001] R13: 00000000ffffffff R14: 0000000000000000 R15: 0000000000000000
[ 0.128001] FS: 0000000000000000(0000) GS:ffff880002288000(0000) knlGS:00000
00000000000
[ 0.128001] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
[ 0.128001] CR2: 0000000000000010 CR3: 0000000001001000 CR4: 00000000000006b0
[ 0.128001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 0.128001] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000
[ 0.128001] Process swapper (pid: 0, threadinfo ffffffff81594000, task ffffff
ff8152a4a0)
[ 0.128001] Stack:
[ 0.128001] 0000000081595e68 5aa50ed3b4ddbe6e ffffffff8158f900 ffffffff8158f
914
[ 0.128001] ffffffff8158f948 0000000000000000 ffffffff81595eb8 ffffffff813b8
69c
[ 0.128001] 5aa50ed3b4ddbe6e 00000001078bfbfd 0000062300000800 5aa50ed3b4ddb
e6e
[ 0.128001] Call Trace:
[ 0.128001] [<ffffffff813b869c>] identify_cpu+0x331/0x392
[ 0.128001] [<ffffffff815a1445>] identify_boot_cpu+0x23/0x6e
[ 0.128001] [<ffffffff815a14ac>] check_bugs+0x1c/0x60
[ 0.128001] [<ffffffff8159c075>] start_kernel+0x403/0x46e
[ 0.128001] [<ffffffff8159b2ac>] x86_64_start_reservations+0xac/0xd5
[ 0.128001] [<ffffffff8159b3ea>] x86_64_start_kernel+0x115/0x14b
[ 0.128001] [<ffffffff8159b140>] ? early_idt_handler+0x0/0x71
[ 0.128001] Code: c7 48 89 05 9e 71 40 00 74 2a 48 63 15 91 71 40 00 be ff 00
00 00 48 c1 e2 03 e8 bf a1 e2 ff e9 3f fe ff ff 48 8b 05 7b 71 40 00 <48> c7 00
00 00 00 00 eb 84 c7 05 40 71 40 00 01 00 00 00 e9 2b
[ 0.128001] RIP [<ffffffff813b98ad>] mcheck_init+0x278/0x320
[ 0.128001] RSP <ffffffff81595e38>
[ 0.128001] CR2: 0000000000000010
[ 0.129306] ---[ end trace a7919e7f17c0a725 ]---
It's this:
/*
* Various K7s with broken bank 0 around. Always disable
* by default.
*/
if (c->x86 == 6)
bank[0] = 0;
in mce_cpu_quirks() in arch/x86/kernel/cpu/mcheck/mce.c around line
1217. Strange that it thinks this is AMD cpu, though?
Attached full boot log.
Vegard
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Linux version 2.6.30 (vegard@damson) (gcc version 4.3.2 20081105 (Red Hat 4.3.2-7) (GCC) ) #426 SMP PREEMPT Mon Jun 15 13:34:20 CEST 2009
[ 0.000000] Command line: root=/dev/sda1 console=ttyS0 console=tty0 ignore_loglevel acpi=force no_console_suspend resume=/dev/sdb1 init=/getty.sh kmemcheck=0
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
[ 0.000000] BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
[ 0.000000] BIOS-e820: 00000000000e8000 - 0000000000100000 (reserved)
[ 0.000000] BIOS-e820: 0000000000100000 - 0000000007ff0000 (usable)
[ 0.000000] BIOS-e820: 0000000007ff0000 - 0000000008000000 (ACPI data)
[ 0.000000] BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
[ 0.000000] debug: ignoring loglevel setting.
[ 0.000000] last_pfn = 0x7ff0 max_arch_pfn = 0x400000000
[ 0.000000] initial memory mapped : 0 - 20000000
[ 0.000000] init_memory_mapping: 0000000000000000-0000000007ff0000
[ 0.000000] 0000000000 - 0007ff0000 page 4k
[ 0.000000] kernel direct mapping tables up to 7ff0000 @ 8000-4a000
[ 0.000000] (5 early reservations) ==> bootmem [0000000000 - 0007ff0000]
[ 0.000000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
[ 0.000000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
[ 0.000000] #2 [0001000000 - 00022819fc] TEXT DATA BSS ==> [0001000000 - 00022819fc]
[ 0.000000] #3 [000009fc00 - 0000100000] BIOS reserved ==> [000009fc00 - 0000100000]
[ 0.000000] #4 [0000008000 - 0000048000] PGTABLE ==> [0000008000 - 0000048000]
[ 0.000000] found SMP MP-table at [ffff8800000fa6d0] fa6d0
[ 0.000000] [ffffea0000000000-ffffea00003fffff] PMD -> [ffff880002800000-ffff880002bfffff] on node 0
[ 0.000000] Zone PFN ranges:
[ 0.000000] DMA 0x00000000 -> 0x00001000
[ 0.000000] DMA32 0x00001000 -> 0x00100000
[ 0.000000] Normal 0x00100000 -> 0x00100000
[ 0.000000] Movable zone start PFN for each node
[ 0.000000] early_node_map[2] active PFN ranges
[ 0.000000] 0: 0x00000000 -> 0x0000009f
[ 0.000000] 0: 0x00000100 -> 0x00007ff0
[ 0.000000] On node 0 totalpages: 32655
[ 0.000000] DMA zone: 112 pages used for memmap
[ 0.000000] DMA zone: 163 pages reserved
[ 0.000000] DMA zone: 3724 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 784 pages used for memmap
[ 0.000000] DMA32 zone: 27872 pages, LIFO batch:7
[ 0.000000] Intel MultiProcessor Specification v1.4
[ 0.000000] MPTABLE: OEM ID: QEMUCPU
[ 0.000000] MPTABLE: Product ID: 0.1
[ 0.000000] MPTABLE: APIC at: 0xFEE00000
[ 0.000000] Processor #0 (Bootup-CPU)
[ 0.000000] Processor #1
[ 0.000000] I/O APIC #2 Version 17 at 0xFEC00000.
[ 0.000000] Processors: 2
[ 0.000000] SMP: Allowing 2 CPUs, 0 hotplug CPUs
[ 0.000000] nr_irqs_gsi: 24
[ 0.000000] Allocating PCI resources starting at 8000000 (gap: 8000000:f7fc0000)
[ 0.000000] NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:2 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 474 pages at ffff880002288000, static data 1909152 bytes
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 31596
[ 0.000000] Kernel command line: root=/dev/sda1 console=ttyS0 console=tty0 ignore_loglevel acpi=force no_console_suspend resume=/dev/sdb1 init=/getty.sh kmemcheck=0
[ 0.000000] PID hash table entries: 512 (order: 9, 4096 bytes)
[ 0.000000] Dentry cache hash table entries: 16384 (order: 5, 131072 bytes)
[ 0.000000] Inode-cache hash table entries: 8192 (order: 4, 65536 bytes)
[ 0.000000] Initializing CPU#0
[ 0.000000] Checking aperture...
[ 0.000000] No AGP bridge found
[ 0.000000] Memory: 103132k/131008k available (3866k kernel code, 388k absent, 27348k reserved, 1818k data, 2176k init)
[ 0.000000] Experimental hierarchical RCU implementation.
[ 0.000000] Experimental hierarchical RCU init done.
[ 0.000000] NR_IRQS:4352 nr_irqs:424
[ 0.000000] Fast TSC calibration using PIT
[ 0.000000] Detected 1462.925 MHz processor.
[ 0.004000] Console: colour VGA+ 80x25
[ 0.004000] console [tty0] enabled
[ 0.004000] console [ttyS0] enabled
[ 0.004000] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
[ 0.004000] ... MAX_LOCKDEP_SUBCLASSES: 8
[ 0.004000] ... MAX_LOCK_DEPTH: 48
[ 0.004000] ... MAX_LOCKDEP_KEYS: 8191
[ 0.004000] ... CLASSHASH_SIZE: 4096
[ 0.004000] ... MAX_LOCKDEP_ENTRIES: 16384
[ 0.004000] ... MAX_LOCKDEP_CHAINS: 32768
[ 0.004000] ... CHAINHASH_SIZE: 16384
[ 0.004000] memory used by lock dependency info: 6207 kB
[ 0.004000] per task-struct memory footprint: 2688 bytes
[ 0.004000] ------------------------
[ 0.004000] | Locking API testsuite:
[ 0.004000] ----------------------------------------------------------------------------
[ 0.004000] | spin |wlock |rlock |mutex | wsem | rsem |
[ 0.004000] --------------------------------------------------------------------------
[ 0.004000] A-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.004000] A-B-B-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.004000] A-B-B-C-C-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.004000] A-B-C-A-B-C deadlock: ok | ok | ok | ok | ok | ok |
[ 0.004000] A-B-B-C-C-D-D-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.004000] A-B-C-D-B-D-D-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.004000] A-B-C-D-B-C-D-A deadlock: ok | ok | ok | ok | ok | ok |
[ 0.004000] double unlock: ok | ok | ok | ok | ok | ok |
[ 0.004000] initialize held: ok | ok | ok | ok | ok | ok |
[ 0.004000] bad unlock order: ok | ok | ok | ok | ok | ok |
[ 0.004000] --------------------------------------------------------------------------
[ 0.004000] recursive read-lock: | ok | | ok |
[ 0.004000] recursive read-lock #2: | ok | | ok |
[ 0.004000] mixed read-write-lock: | ok | | ok |
[ 0.004000] mixed write-read-lock: | ok | | ok |
[ 0.004000] --------------------------------------------------------------------------
[ 0.004000] hard-irqs-on + irq-safe-A/12: ok | ok | ok |
[ 0.004000] soft-irqs-on + irq-safe-A/12: ok | ok | ok |
[ 0.004000] hard-irqs-on + irq-safe-A/21: ok | ok | ok |
[ 0.004000] soft-irqs-on + irq-safe-A/21: ok | ok | ok |
[ 0.004000] sirq-safe-A => hirqs-on/12: ok | ok | ok |
[ 0.004000] sirq-safe-A => hirqs-on/21: ok | ok | ok |
[ 0.004000] hard-safe-A + irqs-on/12: ok | ok | ok |
[ 0.004000] soft-safe-A + irqs-on/12: ok | ok | ok |
[ 0.004000] hard-safe-A + irqs-on/21: ok | ok | ok |
[ 0.004000] soft-safe-A + irqs-on/21: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #1/123: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #1/123: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #1/132: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #1/132: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #1/213: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #1/213: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #1/231: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #1/231: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #1/312: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #1/312: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #1/321: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #1/321: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #2/123: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #2/123: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #2/132: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #2/132: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #2/213: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #2/213: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #2/231: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #2/231: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #2/312: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #2/312: ok | ok | ok |
[ 0.004000] hard-safe-A + unsafe-B #2/321: ok | ok | ok |
[ 0.004000] soft-safe-A + unsafe-B #2/321: ok | ok | ok |
[ 0.004000] hard-irq lock-inversion/123: ok | ok | ok |
[ 0.004000] soft-irq lock-inversion/123: ok | ok | ok |
[ 0.004000] hard-irq lock-inversion/132: ok | ok | ok |
[ 0.004000] soft-irq lock-inversion/132: ok | ok | ok |
[ 0.004000] hard-irq lock-inversion/213: ok | ok | ok |
[ 0.004000] soft-irq lock-inversion/213: ok | ok | ok |
[ 0.004000] hard-irq lock-inversion/231: ok | ok | ok |
[ 0.004000] soft-irq lock-inversion/231: ok | ok | ok |
[ 0.004000] hard-irq lock-inversion/312: ok | ok | ok |
[ 0.004000] soft-irq lock-inversion/312: ok | ok | ok |
[ 0.004000] hard-irq lock-inversion/321: ok | ok | ok |
[ 0.004000] soft-irq lock-inversion/321: ok | ok | ok |
[ 0.004000] hard-irq read-recursion/123: ok |
[ 0.004000] soft-irq read-recursion/123: ok |
[ 0.004000] hard-irq read-recursion/132: ok |
[ 0.004000] soft-irq read-recursion/132: ok |
[ 0.004000] hard-irq read-recursion/213: ok |
[ 0.004000] soft-irq read-recursion/213: ok |
[ 0.004000] hard-irq read-recursion/231: ok |
[ 0.004000] soft-irq read-recursion/231: ok |
[ 0.004000] hard-irq read-recursion/312: ok |
[ 0.004000] soft-irq read-recursion/312: ok |
[ 0.004000] hard-irq read-recursion/321: ok |
[ 0.004000] soft-irq read-recursion/321: ok |
[ 0.004000] -------------------------------------------------------
[ 0.004000] Good, all 218 testcases passed! |
[ 0.004000] ---------------------------------
[ 0.004000] allocated 1310720 bytes of page_cgroup
[ 0.004000] please try cgroup_disable=memory option if you don't want
[ 0.008988] Calibrating delay loop (skipped), value calculated using timer frequency.. 2925.85 BogoMIPS (lpj=5851700)
[ 0.030071] Security Framework initialized
[ 0.033281] TOMOYO Linux initialized
[ 0.045394] Mount-cache hash table entries: 256
[ 0.097008] Initializing cgroup subsys debug
[ 0.098789] Initializing cgroup subsys ns
[ 0.100572] Initializing cgroup subsys cpuacct
[ 0.105127] Initializing cgroup subsys memory
[ 0.110394] Initializing cgroup subsys freezer
[ 0.115341] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
[ 0.116396] CPU: L2 Cache: 512K (64 bytes/line)
[ 0.120570] mce: CPU supports 0 MCE banks
[ 0.124870] BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
[ 0.128001] IP: [<ffffffff813b98ad>] mcheck_init+0x278/0x320
[ 0.128001] PGD 0
[ 0.128001] Thread overran stack, or stack corrupted
[ 0.128001] Oops: 0002 [#1] PREEMPT SMP
[ 0.128001] last sysfs file:
[ 0.128001] CPU 0
[ 0.128001] Modules linked in:
[ 0.128001] Pid: 0, comm: swapper Not tainted 2.6.30 #426
[ 0.128001] RIP: 0010:[<ffffffff813b98ad>] [<ffffffff813b98ad>] mcheck_init+0x278/0x320
[ 0.128001] RSP: 0018:ffffffff81595e38 EFLAGS: 00000246
[ 0.128001] RAX: 0000000000000010 RBX: ffffffff8158f900 RCX: 0000000000000000
[ 0.128001] RDX: 0000000000000000 RSI: 00000000000000ff RDI: 0000000000000010
[ 0.128001] RBP: ffffffff81595e68 R08: 0000000000000001 R09: 0000000000000000
[ 0.128001] R10: 0000000000000010 R11: 0000000000000000 R12: 0000000000000000
[ 0.128001] R13: 00000000ffffffff R14: 0000000000000000 R15: 0000000000000000
[ 0.128001] FS: 0000000000000000(0000) GS:ffff880002288000(0000) knlGS:0000000000000000
[ 0.128001] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
[ 0.128001] CR2: 0000000000000010 CR3: 0000000001001000 CR4: 00000000000006b0
[ 0.128001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 0.128001] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000
[ 0.128001] Process swapper (pid: 0, threadinfo ffffffff81594000, task ffffffff8152a4a0)
[ 0.128001] Stack:
[ 0.128001] 0000000081595e68 5aa50ed3b4ddbe6e ffffffff8158f900 ffffffff8158f914
[ 0.128001] ffffffff8158f948 0000000000000000 ffffffff81595eb8 ffffffff813b869c
[ 0.128001] 5aa50ed3b4ddbe6e 00000001078bfbfd 0000062300000800 5aa50ed3b4ddbe6e
[ 0.128001] Call Trace:
[ 0.128001] [<ffffffff813b869c>] identify_cpu+0x331/0x392
[ 0.128001] [<ffffffff815a1445>] identify_boot_cpu+0x23/0x6e
[ 0.128001] [<ffffffff815a14ac>] check_bugs+0x1c/0x60
[ 0.128001] [<ffffffff8159c075>] start_kernel+0x403/0x46e
[ 0.128001] [<ffffffff8159b2ac>] x86_64_start_reservations+0xac/0xd5
[ 0.128001] [<ffffffff8159b3ea>] x86_64_start_kernel+0x115/0x14b
[ 0.128001] [<ffffffff8159b140>] ? early_idt_handler+0x0/0x71
[ 0.128001] Code: c7 48 89 05 9e 71 40 00 74 2a 48 63 15 91 71 40 00 be ff 00 00 00 48 c1 e2 03 e8 bf a1 e2 ff e9 3f fe ff ff 48 8b 05 7b 71 40 00 <48> c7 00 00 00 00 00 eb 84 c7 05 40 71 40 00 01 00 00 00 e9 2b
[ 0.128001] RIP [<ffffffff813b98ad>] mcheck_init+0x278/0x320
[ 0.128001] RSP <ffffffff81595e38>
[ 0.128001] CR2: 0000000000000010
[ 0.129306] ---[ end trace a7919e7f17c0a725 ]---
[ 0.132404] Kernel panic - not syncing: Attempted to kill the idle task!
[ 0.140325] Pid: 0, comm: swapper Tainted: G D 2.6.30 #426
[ 0.142882] Call Trace:
[ 0.144307] [<ffffffff813bf004>] panic+0x94/0x170
[ 0.146152] [<ffffffff81051951>] do_exit+0x6c1/0x870
[ 0.148287] [<ffffffff81010e8e>] oops_end+0xce/0xe0
[ 0.150202] [<ffffffff8102f7c8>] no_context+0x108/0x290
[ 0.152298] [<ffffffff8102fabd>] __bad_area_nosemaphore+0x16d/0x210
[ 0.154691] [<ffffffff813c2953>] ? trace_hardirqs_on_thunk+0x3a/0x3f
[ 0.156289] [<ffffffff8107c004>] ? tick_nohz_stop_sched_tick+0x154/0x3e0
[ 0.160282] [<ffffffff8100c4d4>] ? restore_args+0x0/0x30
[ 0.162375] [<ffffffff8102ff75>] ? do_page_fault+0x1b5/0x310
[ 0.164286] [<ffffffff8102fb81>] bad_area_nosemaphore+0x21/0x40
[ 0.168316] [<ffffffff8107dce7>] ? trace_hardirqs_off_caller+0xa7/0xe0
[ 0.172326] [<ffffffff8103001e>] do_page_fault+0x25e/0x310
[ 0.176305] [<ffffffff813c2992>] ? trace_hardirqs_off_thunk+0x3a/0x3c
[ 0.178663] [<ffffffff813c42f5>] page_fault+0x25/0x30
[ 0.180296] [<ffffffff813b98ad>] ? mcheck_init+0x278/0x320
[ 0.184295] [<ffffffff813b98a1>] ? mcheck_init+0x26c/0x320
[ 0.186424] [<ffffffff813b869c>] identify_cpu+0x331/0x392
[ 0.188322] [<ffffffff815a1445>] identify_boot_cpu+0x23/0x6e
[ 0.190602] [<ffffffff815a14ac>] check_bugs+0x1c/0x60
[ 0.192287] [<ffffffff8159c075>] start_kernel+0x403/0x46e
[ 0.196301] [<ffffffff8159b2ac>] x86_64_start_reservations+0xac/0xd5
[ 0.198909] [<ffffffff8159b3ea>] x86_64_start_kernel+0x115/0x14b
[ 0.200338] [<ffffffff8159b140>] ? early_idt_handler+0x0/0x71