BUG spinlock lockup, rtc related, 3.0-rc7+

From: Ben Greear
Date: Wed Jul 13 2011 - 13:29:21 EST


This is on the same nfs testing machine I've been posting about. This
has some additional nfs patches included, running tests to mount, do io, unmount
over and over again. Seems that the NFS bugs might be finally fixed, but
system is still un-stable in general when under load.

This info was printed after several other warnings that I previously posted
to lkml.

This one appears to lock up the machine pretty badly though...can't ssh into
it anymore, and similar messages keep spewing every few minutes.

I *think* the BUG at the end of this email is the important part, but
maybe it's just a symptom of something else...

lockdep has already been disabled due to the issues it finds in
scheduling (already being discussed on LKML in a different thread).


INFO: rcu_preempt_state detected stalls on CPUs/tasks: { 0 4} (detected by 2, t=65002 jiffies)
sending NMI to all CPUs:
NMI backtrace for cpu 4
CPU 4
Modules linked in: 8021q garp xt_addrtype xt_TPROXY nf_tproxy_core xt_socket nf_defrag_ipv6 xt_set ip_set nfnetlink xt_connlimit macvlan ip6table_filter ip6_tables ebtable_nat ebtables pktgen fuse iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi stp llc nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipv6 kvm_intel kvm uinput i5k_amb i5000_edac ioatdma pcspkr iTCO_wdt e1000e dca iTCO_vendor_support edac_core microcode shpchp i2c_i801 floppy radeon ttm drm_kms_helper drm hwmon i2c_algo_bit i2c_core [last unloaded: xt_connmark]

Pid: 18179, comm: btserver Tainted: G W 3.0.0-rc7+ #23 Supermicro X7DBU/X7DBU
RIP: 0010:[<ffffffff8107b4f8>] [<ffffffff8107b4f8>] lock_acquire+0x107/0x14b
RSP: 0018:ffff8800adaf1c18 EFLAGS: 00000092
RAX: ffff8800a8a61150 RBX: ffff88012fc0e940 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff88012fc0e958
RBP: ffff8800adaf1c88 R08: 0000000000000002 R09: 0000000000000001
R10: ffff88010bfebc10 R11: ffff8800adaf1ce8 R12: 0000000000000000
R13: ffffffff8106aed5 R14: 0000000000000002 R15: 0000000000000000
FS: 00007fd787ebb740(0000) GS:ffff88012fd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007fb80b67f000 CR3: 0000000001a03000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process btserver (pid: 18179, threadinfo ffff8800adaf0000, task ffff8800a8a61150)
Stack:
0000000000000000 ffffffff8106aed5 ffff880000000000 ffffffff8122c805
ffff8800adaf1c88 0000000000000000 ffff88012fc0e958 0000000000000046
ffff880124ee6a40 ffff88012fc0e940 0000000000000082 ffff8800adaf1d10
Call Trace:
[<ffffffff8106aed5>] ? lock_hrtimer_base+0x25/0x4b
[<ffffffff8122c805>] ? __delay+0xa/0xc
[<ffffffff8147e7e5>] _raw_spin_lock_irqsave+0x4e/0x60
[<ffffffff8106aed5>] ? lock_hrtimer_base+0x25/0x4b
[<ffffffff8106aed5>] lock_hrtimer_base+0x25/0x4b
[<ffffffff8106af50>] hrtimer_try_to_cancel+0x15/0x46
[<ffffffff8106af95>] hrtimer_cancel+0x14/0x20
[<ffffffff81370abf>] rtc_irq_set_state+0x8b/0xaf
[<ffffffff81371c10>] rtc_dev_release+0x35/0x58
[<ffffffff8111b07c>] fput+0x117/0x1b2
[<ffffffff81117b56>] filp_close+0x6d/0x78
[<ffffffff8104c2f7>] put_files_struct+0xca/0x190
[<ffffffff8104c403>] exit_files+0x46/0x4e
[<ffffffff8104deb7>] do_exit+0x2b5/0x760
[<ffffffff8111b108>] ? fput+0x1a3/0x1b2
[<ffffffff8122d744>] ? lockdep_sys_exit_thunk+0x35/0x67
[<ffffffff8104e3e0>] do_group_exit+0x7e/0xa9
[<ffffffff8104e41d>] sys_exit_group+0x12/0x16
[<ffffffff81484fd2>] system_call_fastpath+0x16/0x1b
Code: 6c 24 08 49 c1 e9 09 4c 89 24 24 49 83 f1 01 41 83 e1 01 e8 27 ed ff ff 65 48 8b 04 25 00 cd 00 00 c7 80 dc 05 00 00 00 00 00 00
8b 7d c8 57 9d 66 66 90 66 90 eb 28 65 48 8b 04 25 08 cd 00
Call Trace:
[<ffffffff8106aed5>] ? lock_hrtimer_base+0x25/0x4b
[<ffffffff8122c805>] ? __delay+0xa/0xc
[<ffffffff8147e7e5>] _raw_spin_lock_irqsave+0x4e/0x60
[<ffffffff8106aed5>] ? lock_hrtimer_base+0x25/0x4b
[<ffffffff8106aed5>] lock_hrtimer_base+0x25/0x4b
[<ffffffff8106af50>] hrtimer_try_to_cancel+0x15/0x46
[<ffffffff8106af95>] hrtimer_cancel+0x14/0x20
[<ffffffff81370abf>] rtc_irq_set_state+0x8b/0xaf
[<ffffffff81371c10>] rtc_dev_release+0x35/0x58
[<ffffffff8111b07c>] fput+0x117/0x1b2
[<ffffffff81117b56>] filp_close+0x6d/0x78
[<ffffffff8104c2f7>] put_files_struct+0xca/0x190
[<ffffffff8104c403>] exit_files+0x46/0x4e
[<ffffffff8104deb7>] do_exit+0x2b5/0x760
[<ffffffff8111b108>] ? fput+0x1a3/0x1b2
[<ffffffff8122d744>] ? lockdep_sys_exit_thunk+0x35/0x67
[<ffffffff8104e3e0>] do_group_exit+0x7e/0xa9
[<ffffffff8104e41d>] sys_exit_group+0x12/0x16
[<ffffffff81484fd2>] system_call_fastpath+0x16/0x1b
NMI backtrace for cpu 0
CPU 0
Modules linked in: 8021q garp xt_addrtype xt_TPROXY nf_tproxy_core xt_socket nf_defrag_ipv6 xt_set ip_set nfnetlink xt_connlimit macvlan ip6table_filter ip6_tables ebtable_nat ebtables pktgen fuse iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi stp llc nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipv6 kvm_intel kvm uinput i5k_amb i5000_edac ioatdma pcspkr iTCO_wdt e1000e dca iTCO_vendor_support edac_core microcode shpchp i2c_i801 floppy radeon ttm drm_kms_helper drm hwmon i2c_algo_bit i2c_core [last unloaded: xt_connmark]

Pid: 0, comm: swapper Tainted: G W 3.0.0-rc7+ #23 Supermicro X7DBU/X7DBU
RIP: 0010:[<ffffffff81481e7b>] [<ffffffff81481e7b>] do_page_fault+0x374/0x374
RSP: 0018:ffff88012fc03d90 EFLAGS: 00000012
RAX: 0000000000000030 RBX: ffffffff9843ab14 RCX: 000000009843ab44
RDX: 000000000000841f RSI: 0000000000000000 RDI: 0000000000000001
RBP: ffff88012fc03dc8 R08: 0000000000000001 R09: 0000000000000001
R10: ffff88012fc03f88 R11: 0000000000000000 R12: 0000000000000001
R13: 0000000000000000 R14: ffffffff81a00010 R15: ffffffff9843ab44
FS: 0000000000000000(0000) GS:ffff88012fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000003d2a203020 CR3: 0000000001a03000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff81a00000, task ffffffff81a0b020)
Stack:
ffffffff8122c909 0000000000000002 ffff880124ee6b90 ffffffff81a0b020
000000007735ab70 ffffffff81a0b398 00000000306c9b30 ffff88012fc03dd8
ffffffff8122c805 ffff88012fc03e28 ffffffff81231e96 ffff880124ee6ba8
Call Trace:
<IRQ>
[<ffffffff8122c909>] ? delay_tsc+0xb7/0xde
[<ffffffff8122c805>] __delay+0xa/0xc
[<ffffffff81231e96>] do_raw_spin_lock+0xd2/0x13c
[<ffffffff8147e7ed>] _raw_spin_lock_irqsave+0x56/0x60
[<ffffffff81370d51>] ? rtc_handle_legacy_irq+0x5c/0xb3
[<ffffffff8147ed33>] ? _raw_spin_unlock_irqrestore+0x6b/0x79
[<ffffffff81370d51>] rtc_handle_legacy_irq+0x5c/0xb3
[<ffffffff8106a9a0>] hrtimer_interrupt+0xe5/0x1c0
[<ffffffff810232bc>] smp_apic_timer_interrupt+0x80/0x93
[<ffffffff81485a13>] apic_timer_interrupt+0x13/0x20
<EOI>
[<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81011665>] ? mwait_idle+0x8f/0xc8
[<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff81465cbc>] rest_init+0xd0/0xd7
[<ffffffff81465bec>] ? csum_partial_copy_generic+0x16c/0x16c
[<ffffffff81aa9c76>] start_kernel+0x3bd/0x3c8
[<ffffffff81aa92cd>] x86_64_start_reservations+0xb8/0xbc
[<ffffffff81aa93d2>] x86_64_start_kernel+0x101/0x110
Code: ff ff ff e9 23 ff ff ff 48 85 db 48 89 d9 0f 85 70 ff ff ff e9 4e ff ff ff 48 81 c4 d8 00 00 00 5b 41 5c 41 5d 41 5e 41 5f c9 c3
48 89 e5 53 89 fb 48 83 ec 08 83 3d 77 3b 7c 00 00 75 60 65
Call Trace:
<IRQ> [<ffffffff8122c909>] ? delay_tsc+0xb7/0xde
[<ffffffff8122c805>] __delay+0xa/0xc
[<ffffffff81231e96>] do_raw_spin_lock+0xd2/0x13c
[<ffffffff8147e7ed>] _raw_spin_lock_irqsave+0x56/0x60
[<ffffffff81370d51>] ? rtc_handle_legacy_irq+0x5c/0xb3
[<ffffffff8147ed33>] ? _raw_spin_unlock_irqrestore+0x6b/0x79
[<ffffffff81370d51>] rtc_handle_legacy_irq+0x5c/0xb3
[<ffffffff81370dfa>] rtc_pie_update_irq+0x52/0x5e
[<ffffffff8106a57c>] __run_hrtimer+0xbe/0x1be
[<ffffffff81370da8>] ? rtc_handle_legacy_irq+0xb3/0xb3
[<ffffffff8106a9a0>] hrtimer_interrupt+0xe5/0x1c0
[<ffffffff810232bc>] smp_apic_timer_interrupt+0x80/0x93
[<ffffffff81485a13>] apic_timer_interrupt+0x13/0x20
<EOI> [<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81011665>] ? mwait_idle+0x8f/0xc8
[<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff81465cbc>] rest_init+0xd0/0xd7
[<ffffffff81465bec>] ? csum_partial_copy_generic+0x16c/0x16c
[<ffffffff81aa9c76>] start_kernel+0x3bd/0x3c8
[<ffffffff81aa92cd>] x86_64_start_reservations+0xb8/0xbc
[<ffffffff81aa93d2>] x86_64_start_kernel+0x101/0x110
NMI backtrace for cpu 6
CPU 6
Modules linked in: 8021q garp xt_addrtype xt_TPROXY nf_tproxy_core xt_socket nf_defrag_ipv6 xt_set ip_set nfnetlink xt_connlimit macvlan ip6table_filter ip6_tables ebtable_nat ebtables pktgen fuse iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi stp llc nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipv6 kvm_intel kvm uinput i5k_amb i5000_edac ioatdma pcspkr iTCO_wdt e1000e dca iTCO_vendor_support edac_core microcode shpchp i2c_i801 floppy radeon ttm drm_kms_helper drm hwmon i2c_algo_bit i2c_core [last unloaded: xt_connmark]

Pid: 0, comm: kworker/0:1 Tainted: G W 3.0.0-rc7+ #23 Supermicro X7DBU/X7DBU
RIP: 0010:[<ffffffff81011665>] [<ffffffff81011665>] mwait_idle+0x8f/0xc8
RSP: 0018:ffff8801288f7f08 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff8801288f6000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffffffff8101165c
RBP: ffff8801288f7f08 R08: 0000000000000000 R09: 0000000000000001
R10: ffff88012fcd2940 R11: 0000000000000000 R12: ffffffff81a8e730
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff88012fd80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00000000020cd2a0 CR3: 0000000122956000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/0:1 (pid: 0, threadinfo ffff8801288f6000, task ffff8801288e5690)
Stack:
ffff8801288f7f28 ffffffff81009e87 ffffffff81a8e740 0000000000000003
ffff8801288f7f48 ffffffff814780e9 0000000000000000 0000000000000000
0000000000000000 0000000000000000 0000000000000000 0000000000000000
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
NMI backtrace for cpu 2
CPU 2
Modules linked in: 8021q garp xt_addrtype xt_TPROXY nf_tproxy_core xt_socket nf_defrag_ipv6 xt_set ip_set nfnetlink xt_connlimit macvlan ip6table_filter ip6_tables ebtable_nat ebtables pktgen fuse iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi stp llc nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipv6 kvm_intel kvm uinput i5k_amb i5000_edac ioatdma pcspkr iTCO_wdt e1000e dca iTCO_vendor_support edac_core microcode shpchp i2c_i801 floppy radeon ttm drm_kms_helper drm hwmon i2c_algo_bit i2c_core [last unloaded: xt_connmark]

Pid: 0, comm: kworker/0:1 Tainted: G W 3.0.0-rc7+ #23 Supermicro X7DBU/X7DBU
RIP: 0010:[<ffffffff8122c86b>] [<ffffffff8122c86b>] delay_tsc+0x19/0xde
RSP: 0018:ffff88012fc83d78 EFLAGS: 00000096
RAX: 000000003aa2de00 RBX: 0000000000000001 RCX: ffff88012fc83ce8
RDX: 00000000001e8497 RSI: 0000000000000002 RDI: 0000000000000001
RBP: ffff88012fc83da8 R08: ffffffff81c65b9c R09: 0000000000000000
R10: 0000000000000000 R11: ffffffffffffffff R12: 00000000001e8498
R13: ffffffff81a20780 R14: ffffffff81a20d80 R15: 000000000000fdea
FS: 0000000000000000(0000) GS:ffff88012fc80000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000003d298732a0 CR3: 0000000123221000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/0:1 (pid: 0, threadinfo ffff88012886e000, task ffff8801288622a0)
Stack:
ffff88012fc83da8 0000000000000001 ffff88012fc8eec0 ffffffff81a20780
ffffffff81a20d80 000000000000fdea ffff88012fc83db8 ffffffff8122c82f
ffff88012fc83dd8 ffffffff8102373b ffff88012fc83db8 ffffffff81a20600
Call Trace:
<IRQ>
[<ffffffff8122c82f>] __const_udelay+0x28/0x2a
[<ffffffff8102373b>] arch_trigger_all_cpu_backtrace+0x61/0x76
[<ffffffff810a8964>] __rcu_pending+0x2bf/0x402
[<ffffffff810a8bf8>] rcu_check_callbacks+0x151/0x163
[<ffffffff81057f5f>] update_process_times+0x3c/0x72
[<ffffffff81075ccc>] tick_sched_timer+0x6c/0x96
[<ffffffff8106a57c>] __run_hrtimer+0xbe/0x1be
[<ffffffff81075c60>] ? tick_nohz_handler+0xde/0xde
[<ffffffff8106a9a0>] hrtimer_interrupt+0xe5/0x1c0
[<ffffffff810232bc>] smp_apic_timer_interrupt+0x80/0x93
[<ffffffff81485a13>] apic_timer_interrupt+0x13/0x20
<EOI>
[<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81011665>] ? mwait_idle+0x8f/0xc8
[<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
Code: ff c9 c3 55 48 8d 3c bf 48 89 e5 e8 b7 ff ff ff c9 c3 55 48 89 e5 41 57 41 56 41 55 41 54 49 89 fc bf 01 00 00 00 53 48 83 ec 08 <e8> b1 56 25 00 e8 8f 67 00 00 41 89 c5 66 66 90 0f ae e8 e8 a2
Call Trace:
<IRQ> [<ffffffff8122c82f>] __const_udelay+0x28/0x2a
[<ffffffff8102373b>] arch_trigger_all_cpu_backtrace+0x61/0x76
[<ffffffff810a8964>] __rcu_pending+0x2bf/0x402
[<ffffffff810a8bf8>] rcu_check_callbacks+0x151/0x163
[<ffffffff81057f5f>] update_process_times+0x3c/0x72
[<ffffffff81075ccc>] tick_sched_timer+0x6c/0x96
[<ffffffff8106a57c>] __run_hrtimer+0xbe/0x1be
[<ffffffff81075c60>] ? tick_nohz_handler+0xde/0xde
[<ffffffff8106a9a0>] hrtimer_interrupt+0xe5/0x1c0
[<ffffffff810232bc>] smp_apic_timer_interrupt+0x80/0x93
[<ffffffff81485a13>] apic_timer_interrupt+0x13/0x20
<EOI> [<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81011665>] ? mwait_idle+0x8f/0xc8
[<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
NMI backtrace for cpu 7
CPU 7
Modules linked in: 8021q garp xt_addrtype xt_TPROXY nf_tproxy_core xt_socket nf_defrag_ipv6 xt_set ip_set nfnetlink xt_connlimit macvlan ip6table_filter ip6_tables ebtable_nat ebtables pktgen fuse iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi stp llc nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipv6 kvm_intel kvm uinput i5k_amb i5000_edac ioatdma pcspkr iTCO_wdt e1000e dca iTCO_vendor_support edac_core microcode shpchp i2c_i801 floppy radeon ttm drm_kms_helper drm hwmon i2c_algo_bit i2c_core [last unloaded: xt_connmark]

Pid: 0, comm: kworker/0:1 Tainted: G W 3.0.0-rc7+ #23 Supermicro X7DBU/X7DBU
RIP: 0010:[<ffffffff81011665>] [<ffffffff81011665>] mwait_idle+0x8f/0xc8
RSP: 0018:ffff880128917f08 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff880128916000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffffffff8101165c
RBP: ffff880128917f08 R08: 0000000000000000 R09: 0000000000000001
R10: ffff88012fd92940 R11: 0000000000000000 R12: ffffffff81a8e730
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff88012fdc0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f6907ad5000 CR3: 00000001258a0000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/0:1 (pid: 0, threadinfo ffff880128916000, task ffff880128904540)
Stack:
ffff880128917f28 ffffffff81009e87 ffffffff81a8e740 0000000000000007
ffff880128917f48 ffffffff814780e9 0000000000000000 0000000000000000
0000000000000000 0000000000000000 0000000000000000 0000000000000000
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
NMI backtrace for cpu 5
CPU 5
Modules linked in: 8021q garp xt_addrtype xt_TPROXY nf_tproxy_core xt_socket nf_defrag_ipv6 xt_set ip_set nfnetlink xt_connlimit macvlan ip6table_filter ip6_tables ebtable_nat ebtables pktgen fuse iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi stp llc nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipv6 kvm_intel kvm uinput i5k_amb i5000_edac ioatdma pcspkr iTCO_wdt e1000e dca iTCO_vendor_support edac_core microcode shpchp i2c_i801 floppy radeon ttm drm_kms_helper drm hwmon i2c_algo_bit i2c_core [last unloaded: xt_connmark]

Pid: 0, comm: kworker/0:1 Tainted: G W 3.0.0-rc7+ #23 Supermicro X7DBU/X7DBU
RIP: 0010:[<ffffffff81011665>] [<ffffffff81011665>] mwait_idle+0x8f/0xc8
RSP: 0018:ffff8801288dbf08 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff8801288da000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffffffff8101165c
RBP: ffff8801288dbf08 R08: 0000000000000000 R09: 0000000000000001
R10: ffff88012fd92940 R11: 0000000000000000 R12: ffffffff81a8e730
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff88012fd40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00000000011042a0 CR3: 000000012292e000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/0:1 (pid: 0, threadinfo ffff8801288da000, task ffff8801288ae7e0)
Stack:
ffff8801288dbf28 ffffffff81009e87 ffffffff81a8e740 0000000000000006
ffff8801288dbf48 ffffffff814780e9 0000000000000000 0000000000000000
0000000000000000 0000000000000000 0000000000000000 0000000000000000
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
NMI backtrace for cpu 3
CPU 3
Modules linked in: 8021q garp xt_addrtype xt_TPROXY nf_tproxy_core xt_socket nf_defrag_ipv6 xt_set ip_set nfnetlink xt_connlimit macvlan ip6table_filter ip6_tables ebtable_nat ebtables pktgen fuse iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi stp llc nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipv6 kvm_intel kvm uinput i5k_amb i5000_edac ioatdma pcspkr iTCO_wdt e1000e dca iTCO_vendor_support edac_core microcode shpchp i2c_i801 floppy radeon ttm drm_kms_helper drm hwmon i2c_algo_bit i2c_core [last unloaded: xt_connmark]

Pid: 0, comm: kworker/0:1 Tainted: G W 3.0.0-rc7+ #23 Supermicro X7DBU/X7DBU
RIP: 0010:[<ffffffff81011665>] [<ffffffff81011665>] mwait_idle+0x8f/0xc8
RSP: 0018:ffff880128887f08 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff880128886000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffffffff8101165c
RBP: ffff880128887f08 R08: 0000000000000000 R09: 0000000000000001
R10: ffff88012fc92940 R11: 0000000000000000 R12: ffffffff81a8e730
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff88012fcc0000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f1e4f355000 CR3: 0000000123162000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/0:1 (pid: 0, threadinfo ffff880128886000, task ffff880128889150)
Stack:
ffff880128887f28 ffffffff81009e87 ffffffff81a8e740 0000000000000005
ffff880128887f48 ffffffff814780e9 0000000000000000 0000000000000000
0000000000000000 0000000000000000 0000000000000000 0000000000000000
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
NMI backtrace for cpu 1
CPU 1
Modules linked in: 8021q garp xt_addrtype xt_TPROXY nf_tproxy_core xt_socket nf_defrag_ipv6 xt_set ip_set nfnetlink xt_connlimit macvlan ip6table_filter ip6_tables ebtable_nat ebtables pktgen fuse iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi stp llc nfs lockd fscache auth_rpcgss nfs_acl sunrpc ipv6 kvm_intel kvm uinput i5k_amb i5000_edac ioatdma pcspkr iTCO_wdt e1000e dca iTCO_vendor_support edac_core microcode shpchp i2c_i801 floppy radeon ttm drm_kms_helper drm hwmon i2c_algo_bit i2c_core [last unloaded: xt_connmark]

Pid: 0, comm: kworker/0:0 Tainted: G W 3.0.0-rc7+ #23 Supermicro X7DBU/X7DBU
RIP: 0010:[<ffffffff81011665>] [<ffffffff81011665>] mwait_idle+0x8f/0xc8
RSP: 0018:ffff88012884bf08 EFLAGS: 00000246
RAX: 0000000000000000 RBX: ffff88012884a000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000003 RDI: ffffffff8101165c
RBP: ffff88012884bf08 R08: 0000000000000000 R09: 0000000000000001
R10: ffff88012fc92940 R11: 0000000000000000 R12: ffffffff81a8e730
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff88012fc40000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00000000010fb708 CR3: 0000000122956000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kworker/0:0 (pid: 0, threadinfo ffff88012884a000, task ffff88012881b3f0)
Stack:
ffff88012884bf28 ffffffff81009e87 ffffffff81a8e740 0000000000000004
ffff88012884bf48 ffffffff814780e9 0000000000000000 0000000000000000
0000000000000000 0000000000000000 0000000000000000 0000000000000000
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8
Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7
Call Trace:
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff814780e9>] start_secondary+0x1a3/0x1a8

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel:Stack:
^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel:Call Trace:

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel:Code: 6c 24 08 49 c1 e9 09 4c 89 24 24 49 83 f1 01 41 83 e1 01 e8 27 ed ff ff 65 48 8b 04 25 00 cd 00 00 c7 80 dc 05 00 00 00 00 00 00

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel:Stack:

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel:Call Trace:

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel: <IRQ>

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel: <EOI>

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel:Code: ff ff ff e9 23 ff ff ff 48 85 db 48 89 d9 0f 85 70 ff ff ff e9 4e ff ff ff 48 81 c4 d8 00 00 00 5b 41 5c 41 5d 41 5e 41 5f c9 c3

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel:Stack:

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel:Call Trace:

^GMessage from syslogd@localhost at Jul 13 07:21:13 ...
kernel:Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7

^GMessage from syslogd@localhost at Jul 13 07:21:14 ...
kernel:Stack:

^GMessage from syslogd@localhost at Jul 13 07:21:14 ...
kernel:Call Trace:

^GMessage from syslogd@localhost at Jul 13 07:21:14 ...
kernel: <IRQ>
^GMessage from syslogd@localhost at Jul 13 07:21:14 ...
kernel: <EOI>

^GMessage from syslogd@localhost at Jul 13 07:21:14 ...
kernel:Code: ff c9 c3 55 48 8d 3c bf 48 89 e5 e8 b7 ff ff ff c9 c3 55 48 89 e5 41 57 41 56 41 55 41 54 49 89 fc bf 01 00 00 00 53 48 83 ec 08 <e8> b1 56 25 00 e8 8f 67 00 00 41 89 c5 66 66 90 0f ae e8 e8 a2

^GMessage from syslogd@localhost at Jul 13 07:21:14 ...
kernel:Stack:

^GMessage from syslogd@localhost at Jul 13 07:21:14 ...
kernel:Call Trace:

^GMessage from syslogd@localhost at Jul 13 07:21:14 ...
kernel:Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7

^GMessage from syslogd@localhost at Jul 13 07:21:15 ...
kernel:Stack:

^GMessage from syslogd@localhost at Jul 13 07:21:15 ...
kernel:Call Trace:

^GMessage from syslogd@localhost at Jul 13 07:21:15 ...
kernel:Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7

^GMessage from syslogd@localhost at Jul 13 07:21:15 ...
kernel:Stack:

^GMessage from syslogd@localhost at Jul 13 07:21:15 ...
kernel:Call Trace:

^GMessage from syslogd@localhost at Jul 13 07:21:15 ...
kernel:Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7

^GMessage from syslogd@localhost at Jul 13 07:21:16 ...
kernel:Stack:

^GMessage from syslogd@localhost at Jul 13 07:21:16 ...
kernel:Call Trace:
^GMessage from syslogd@localhost at Jul 13 07:21:16 ...
kernel:Code: 25 08 cd 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 a8 f4 ff ff 85 c0 75 10 e8 22 7e 06 00 31 c0 48 89 c1 fb 0f 01 c9 <eb> 0c e8 12 7e 06 00 fb 66 66 90 66 66 90 e8 8c 19 22 00 89 c7
BUG: spinlock lockup on CPU#0, swapper/0, ffff880124ee6b90
Pid: 0, comm: swapper Tainted: G W 3.0.0-rc7+ #23
Call Trace:
<IRQ> [<ffffffff81231ed0>] do_raw_spin_lock+0x10c/0x13c
[<ffffffff8147e7ed>] _raw_spin_lock_irqsave+0x56/0x60
[<ffffffff81370d51>] ? rtc_handle_legacy_irq+0x5c/0xb3
[<ffffffff8147ed33>] ? _raw_spin_unlock_irqrestore+0x6b/0x79
[<ffffffff81370d51>] rtc_handle_legacy_irq+0x5c/0xb3
[<ffffffff81370dfa>] rtc_pie_update_irq+0x52/0x5e
[<ffffffff8106a57c>] __run_hrtimer+0xbe/0x1be
[<ffffffff81370da8>] ? rtc_handle_legacy_irq+0xb3/0xb3
[<ffffffff8106a9a0>] hrtimer_interrupt+0xe5/0x1c0
[<ffffffff810232bc>] smp_apic_timer_interrupt+0x80/0x93
[<ffffffff81485a13>] apic_timer_interrupt+0x13/0x20
<EOI> [<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81011665>] ? mwait_idle+0x8f/0xc8
[<ffffffff8101165c>] ? mwait_idle+0x86/0xc8
[<ffffffff81009e87>] cpu_idle+0x5e/0xb5
[<ffffffff81465cbc>] rest_init+0xd0/0xd7
[<ffffffff81465bec>] ? csum_partial_copy_generic+0x16c/0x16c
[<ffffffff81aa9c76>] start_kernel+0x3bd/0x3c8
[<ffffffff81aa92cd>] x86_64_start_reservations+0xb8/0xbc
[<ffffffff81aa93d2>] x86_64_start_kernel+0x101/0x110


--
Ben Greear <greearb@xxxxxxxxxxxxxxx>
Candela Technologies Inc http://www.candelatech.com

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/