Second soft lockup regression in yesterday's sched.git merge

From: David Miller
Date: Wed Apr 23 2008 - 02:39:43 EST



Two changets after the buggy cpu_clock() changes, we have:

commit 15934a37324f32e0fda633dc7984a671ea81cd75
Author: Guillaume Chazarain <guichaz@xxxxxxxx>
Date: Sat Apr 19 19:44:57 2008 +0200

sched: fix rq->clock overflows detection with CONFIG_NO_HZ

When using CONFIG_NO_HZ, rq->tick_timestamp is not updated every TICK_NSEC.
We check that the number of skipped ticks matches the clock jump seen in
__update_rq_clock().

Signed-off-by: Guillaume Chazarain <guichaz@xxxxxxxx>
Signed-off-by: Ingo Molnar <mingo@xxxxxxx>

Which also causes softlockup warnings on my Niagara systems.

Note this is with the cpu_clock() change reverted, and the
usual test case kernel build after a delay:

sleep 10m; time make -j64 >build.log 2>&1; make -j64 image

Some logs:

[ 265.200935] BUG: soft lockup - CPU#20 stuck for 183s! [swapper:0]
[ 265.201183] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 265.201209] TPC: <cpu_idle+0xb0/0x134>
[ 265.201220] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff278000 g3: 0000000000000000
[ 265.201236] g4: fffff803ff261800 g5: fffff80007d04000 g6: fffff803ff278000 g7: 0000021100004000
[ 265.201252] o0: 0000000000000000 o1: fffff803ff278008 o2: 0000000000004000 o3: 0000000000000001
[ 265.201268] o4: 0000003deb425d00 o5: 0000000000000012 sp: fffff803ff27b681 ret_pc: 0000000000427818
[ 265.201285] RPC: <cpu_idle+0x9c/0x134>
[ 265.201296] l0: 0000000000000014 l1: 00000000007b95c8 l2: 0000000000000014 l3: 00000000000000c8
[ 265.201312] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 265.201328] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 265.201344] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff27b741 i7: 00000000006b0090
[ 265.201373] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 265.213321] BUG: soft lockup - CPU#36 stuck for 175s! [dd:2271]
[ 265.213321] TSTATE: 0000004411001605 TPC: 00000000006b47e4 TNPC: 00000000006b47e8 Y: 00000000 Not tainted
[ 265.213321] TPC: <_spin_unlock_irq+0x0/0x14>
[ 265.213321] g0: fffff803fb943180 g1: 0000000000000000 g2: fffff803fca30008 g3: fffff803fca2fff0
[ 265.213321] g4: fffff803fcadb600 g5: fffff80007d84000 g6: fffff803f82d4000 g7: 02100211010000c0
[ 265.213321] o0: fffff803fca30000 o1: 0000000000000000 o2: 0000000000000001 o3: 0000000000000001
[ 265.213321] o4: 0000000000000001 o5: 000000000002e000 sp: fffff803f82d7291 ret_pc: 00000000004b8300
[ 265.213321] RPC: <pipe_write+0x3e8/0x460>
[ 265.213321] l0: fffff803fbab8000 l1: 0000000000000001 l2: fffff803fca30000 l3: 0000000206f86c20
[ 265.213321] l4: fffff803fca30288 l5: 0000000000000000 l6: 0000000000000000 l7: 00000000f7fb7000
[ 265.213321] i0: 0000000000000001 i1: fffff803f82d7cf0 i2: 0000000000000001 i3: 0000000000000000
[ 265.213321] i4: fffff803fb940fc0 i5: fffff803f820e0c0 i6: fffff803f82d7351 i7: 00000000004b1b90
[ 265.213321] I7: <do_sync_write+0x88/0xd0>
[ 265.248050] BUG: soft lockup - CPU#39 stuck for 225s! [swapper:0]
[ 265.248050] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 265.248050] TPC: <cpu_idle+0xb0/0x134>
[ 265.248050] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff44c000 g3: 0000000000000000
[ 265.248050] g4: fffff803ff448000 g5: fffff80007d9c000 g6: fffff803ff44c000 g7: 0000021100004000
[ 265.248050] o0: 0000000000000000 o1: fffff803ff44c008 o2: 0000000000004000 o3: 0000000000000001
[ 265.248050] o4: 0000003def6e7a80 o5: 0000000000000012 sp: fffff803ff44f681 ret_pc: 0000000000427818
[ 265.248050] RPC: <cpu_idle+0x9c/0x134>
[ 265.248050] l0: 0000000000000027 l1: 00000000007b95c8 l2: 0000000000000027 l3: 00000000000000c8
[ 265.248050] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 265.248050] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 265.248050] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff44f741 i7: 00000000006b0090
[ 265.248050] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 265.275615] BUG: soft lockup - CPU#32 stuck for 225s! [syslogd:2249]
[ 265.275615] TSTATE: 0000009982000a01 TPC: 00000000f7e05024 TNPC: 00000000f7e05028 Y: 00000002 Not tainted
[ 265.275615] TPC: <0xf7e0502c>
[ 265.275615] g0: 0000000000000000 g1: 00000000f7e06ccc g2: 00000000f7e0579c g3: ffffffffffffffff
[ 265.275615] g4: 0000000000000020 g5: 5044540050535400 g6: 00000000feffffff g7: 00000000f7f6cf60
[ 265.275615] o0: 0000000000000001 o1: 00000000f7f1236f o2: 0000000000000001 o3: 00000000cccccccd
[ 265.275615] o4: 5044540000000000 o5: 00000000fffff5a4 sp: 00000000ff8505f0 ret_pc: 00000000f7e05458
[ 265.275615] RPC: <0xf7e05460>
[ 265.275615] l0: f7f1236e l1: ff850b24 l2: f7f12370 l3: ff850b22 l4: 00000000 l5: 00000000 l6: 0000000a l7: f7f33000
[ 265.275615] i0: ff850c88 i1: f7f12358 i2: ff850e48 i3: f7f35c10 i4: 00000000 i5: 00000013 i6: ff850c28 i7: f7e2cb18
[ 277.254784] BUG: soft lockup - CPU#29 stuck for 195s! [swapper:0]
[ 277.255015] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 277.255035] TPC: <cpu_idle+0xb0/0x134>
[ 277.255045] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff354000 g3: 0000000000000000
[ 277.255060] g4: fffff803ff350000 g5: fffff80007d4c000 g6: fffff803ff354000 g7: 0000021100004000
[ 277.255074] o0: 0000000000000000 o1: fffff803ff354008 o2: 0000000000004000 o3: 0000000000000001
[ 277.255089] o4: 00000040b683d500 o5: 0000000000000012 sp: fffff803ff357681 ret_pc: 0000000000427818
[ 277.255104] RPC: <cpu_idle+0x9c/0x134>
[ 277.255114] l0: 000000000000001d l1: 00000000007b95c8 l2: 000000000000001d l3: 00000000000000c8
[ 277.255128] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 277.255143] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 277.255157] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff357741 i7: 00000000006b0090
[ 277.255182] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 277.232734] BUG: soft lockup - CPU#2 stuck for 193s! [swapper:0]
[ 277.232952] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000400 Not tainted
[ 277.232974] TPC: <cpu_idle+0xb0/0x134>
[ 277.232986] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0a4000 g3: 0000000000000000
[ 277.233004] g4: fffff803ff098c00 g5: fffff80007c74000 g6: fffff803ff0a4000 g7: 0000021100004000
[ 277.233022] o0: 0000000000000000 o1: fffff803ff0a4008 o2: 0000000000004000 o3: 0000000000000001
[ 277.233039] o4: 00000040b71c6b80 o5: 0000000000000012 sp: fffff803ff0a7681 ret_pc: 0000000000427818
[ 277.233058] RPC: <cpu_idle+0x9c/0x134>
[ 277.233069] l0: 0000000000000002 l1: 00000000007b95c8 l2: 0000000000000002 l3: 00000000000000c8
[ 277.233087] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 277.233104] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 277.233121] i4: 00000000fee82518 i5: 00000000fee815f8 i6: fffff803ff0a7741 i7: 00000000006b0090
[ 277.233145] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 278.288737] BUG: soft lockup - CPU#5 stuck for 196s! [swapper:0]
[ 278.288971] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 278.288992] TPC: <cpu_idle+0xb0/0x134>
[ 278.289003] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0ec000 g3: 0000000000000000
[ 278.289018] g4: fffff803ff0d5800 g5: fffff80007c8c000 g6: fffff803ff0ec000 g7: 0000021100004000
[ 278.289033] o0: 0000000000000000 o1: fffff803ff0ec008 o2: 0000000000004000 o3: 0000000000000001
[ 278.289049] o4: 00000040f77be980 o5: 0000000000000012 sp: fffff803ff0ef681 ret_pc: 0000000000427818
[ 278.289064] RPC: <cpu_idle+0x9c/0x134>
[ 278.289075] l0: 0000000000000005 l1: 00000000007b95c8 l2: 0000000000000005 l3: 00000000000000c8
[ 278.289090] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 278.289105] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 278.289120] i4: 00000000fee81f18 i5: 00000000fee80ff8 i6: fffff803ff0ef741 i7: 00000000006b0090
[ 278.289147] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 278.350891] BUG: soft lockup - CPU#53 stuck for 196s! [bash:3663]
[ 278.351102] TSTATE: 0000004411001602 TPC: 00000000006b5b44 TNPC: 0000000000407a34 Y: 00000000 Not tainted
[ 278.351127] TPC: <flush_icache_range+0x4/0xbc>
[ 278.351138] g0: 00000000fc2c9fc5 g1: 0000000000000000 g2: 0000000000000016 g3: 0000000000000006
[ 278.351153] g4: fffff803fcd52400 g5: fffff80007e0c000 g6: fffff803f5710000 g7: 0000000000000180
[ 278.351167] o0: fffff803fcaaa000 o1: fffff803f5713f60 o2: 0000000000000000 o3: 0000000000000000
[ 278.351182] o4: 0000000000000003 o5: 0000000000000000 sp: fffff803f57136a1 ret_pc: 0000000000407a2c
[ 278.351200] RPC: <sparc64_realfault_common+0x18/0x20>
[ 278.351211] l0: 0000000000009000 l1: 00000000001a8000 l2: 0000000000407a24 l3: 0000000000000000
[ 278.351226] l4: 0000000000000003 l5: 00000000000c8000 l6: fffff803f5710000 l7: 0000000011009002
[ 278.351240] i0: 00000000f7f0aee8 i1: 0000000000000000 i2: 000000006fffffff i3: 0000000090000000
[ 278.351255] i4: 00000000f7f09dc8 i5: 000000006474e552 i6: 00000000ffe296d8 i7: 00000000f7edcf2c
[ 278.351270] I7: <0xf7edcf34>
[ 278.299181] BUG: soft lockup - CPU#61 stuck for 191s! [swapper:0]
[ 278.299311] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 278.299330] TPC: <cpu_idle+0xb0/0x134>
[ 278.299340] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff678000 g3: 0000000000000000
[ 278.299354] g4: fffff803ff647000 g5: fffff80007e4c000 g6: fffff803ff678000 g7: 0000021100004000
[ 278.299369] o0: 0000000000000000 o1: fffff803ff678008 o2: 0000000000004000 o3: 0000000000000001
[ 278.299384] o4: 00000040f77be980 o5: 0000000000000012 sp: fffff803ff67b681 ret_pc: 0000000000427818
[ 278.299398] RPC: <cpu_idle+0x9c/0x134>
[ 278.299408] l0: 000000000000003d l1: 00000000007b95c8 l2: 000000000000003d l3: 00000000000000c8
[ 278.299422] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 278.299437] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 278.299451] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff67b741 i7: 00000000006b0090
[ 278.299471] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 278.279102] BUG: soft lockup - CPU#3 stuck for 78s! [swapper:0]
[ 278.279331] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 278.279350] TPC: <cpu_idle+0xb0/0x134>
[ 278.279360] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0c0000 g3: 0000000000000000
[ 278.279375] g4: fffff803ff09a400 g5: fffff80007c7c000 g6: fffff803ff0c0000 g7: 0000021100004000
[ 278.279390] o0: 0000000000000000 o1: fffff803ff0c0008 o2: 0000000000004000 o3: 0000000000000001
[ 278.279405] o4: 00000040f8148000 o5: 0000000000000012 sp: fffff803ff0c3681 ret_pc: 0000000000427818
[ 278.279420] RPC: <cpu_idle+0x9c/0x134>
[ 278.279429] l0: 0000000000000003 l1: 00000000007b95c8 l2: 0000000000000003 l3: 00000000000000c8
[ 278.279444] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 278.279459] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 278.279473] i4: 00000000fee82318 i5: 00000000fee813f8 i6: fffff803ff0c3741 i7: 00000000006b0090
[ 278.279494] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 278.300043] BUG: soft lockup - CPU#6 stuck for 237s! [swapper:0]
[ 278.300043] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 278.300043] TPC: <cpu_idle+0xb0/0x134>
[ 278.300043] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff108000 g3: 0000000000000000
[ 278.300043] g4: fffff803ff0d7000 g5: fffff80007c94000 g6: fffff803ff108000 g7: 0000021100004000
[ 278.300043] o0: 0000000000000000 o1: fffff803ff108008 o2: 0000000000004000 o3: 0000000000000001
[ 278.300043] o4: 00000040f8ad1680 o5: 0000000000000012 sp: fffff803ff10b681 ret_pc: 0000000000427818
[ 278.300043] RPC: <cpu_idle+0x9c/0x134>
[ 278.300043] l0: 0000000000000006 l1: 00000000007b95c8 l2: 0000000000000006 l3: 00000000000000c8
[ 278.300043] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 278.300043] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 278.300043] i4: 00000000fee81d18 i5: 00000000fee80df8 i6: fffff803ff10b741 i7: 00000000006b0090
[ 278.300043] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 278.303686] BUG: soft lockup - CPU#4 stuck for 196s! [swapper:0]
[ 278.303739] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 278.303758] TPC: <cpu_idle+0xb0/0x134>
[ 278.303769] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0d8000 g3: 0000000000000000
[ 278.303786] g4: fffff803ff0d4000 g5: fffff80007c84000 g6: fffff803ff0d8000 g7: 0000021100004000
[ 278.303802] o0: 0000000000000000 o1: fffff803ff0d8008 o2: 0000000000004000 o3: 0000000000000001
[ 278.303818] o4: 00000040f8148000 o5: 0000000000000012 sp: fffff803ff0db681 ret_pc: 0000000000427818
[ 278.303834] RPC: <cpu_idle+0x9c/0x134>
[ 278.303845] l0: 0000000000000004 l1: 00000000007b95c8 l2: 0000000000000004 l3: 00000000000000c8
[ 278.303861] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 278.303877] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 278.303894] i4: 00000000fee82118 i5: 00000000fee811f8 i6: fffff803ff0db741 i7: 00000000006b0090
[ 278.303916] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 278.350921] BUG: soft lockup - CPU#37 stuck for 196s! [swapper:0]
[ 278.350921] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 278.350921] TPC: <cpu_idle+0xb0/0x134>
[ 278.350921] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff418000 g3: 0000000000000000
[ 278.350921] g4: fffff803ff40cc00 g5: fffff80007d8c000 g6: fffff803ff418000 g7: 0000021100004000
[ 278.350921] o0: 0000000000000000 o1: fffff803ff418008 o2: 0000000000004000 o3: 0000000000000001
[ 278.350921] o4: 00000040f9de4380 o5: 0000000000000012 sp: fffff803ff41b681 ret_pc: 0000000000427818
[ 278.350921] RPC: <cpu_idle+0x9c/0x134>
[ 278.350921] l0: 0000000000000025 l1: 00000000007b95c8 l2: 0000000000000025 l3: 00000000000000c8
[ 278.350921] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 278.350921] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 278.350921] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff41b741 i7: 00000000006b0090
[ 278.350921] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 278.892721] BUG: soft lockup - CPU#52 stuck for 196s! [swapper:0]
[ 278.892721] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 278.892721] TPC: <cpu_idle+0xb0/0x134>
[ 278.892721] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff5a0000 g3: 0000000000000000
[ 278.892721] g4: fffff803ff594c00 g5: fffff80007e04000 g6: fffff803ff5a0000 g7: 0000021100004000
[ 278.892721] o0: 0000000000000000 o1: fffff803ff5a0008 o2: 0000000000004000 o3: 0000000000000001
[ 278.892721] o4: 000000411aa69900 o5: 0000000000000012 sp: fffff803ff5a3681 ret_pc: 0000000000427818
[ 278.892721] RPC: <cpu_idle+0x9c/0x134>
[ 278.892721] l0: 0000000000000034 l1: 00000000007b95c8 l2: 0000000000000034 l3: 00000000000000c8
[ 278.892721] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 278.892721] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 278.892721] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff5a3741 i7: 00000000006b0090
[ 278.892721] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 357.612160] BUG: soft lockup - CPU#37 stuck for 64s! [swapper:0]
[ 357.612393] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 357.612416] TPC: <cpu_idle+0xb0/0x134>
[ 357.612427] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff418000 g3: 0000000000000000
[ 357.612443] g4: fffff803ff40cc00 g5: fffff80007d8c000 g6: fffff803ff418000 g7: 0000021100004000
[ 357.612460] o0: 0000000000000000 o1: fffff803ff418008 o2: 0000000000004000 o3: 0000000000000001
[ 357.612478] o4: 000000536feba600 o5: 0000000000000012 sp: fffff803ff41b681 ret_pc: 0000000000427818
[ 357.612496] RPC: <cpu_idle+0x9c/0x134>
[ 357.612508] l0: 0000000000000025 l1: 00000000007b95c8 l2: 0000000000000025 l3: 00000000000000c8
[ 357.612525] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 357.612542] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 357.612559] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff41b741 i7: 00000000006b0090
[ 357.612586] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 357.630062] BUG: soft lockup - CPU#39 stuck for 74s! [dd:2271]
[ 357.630273] TSTATE: 0000004482000a00 TPC: 00000000f7eec99c TNPC: 00000000f7eec9a0 Y: 00000000 Not tainted
[ 357.630290] TPC: <0xf7eec9a4>
[ 357.630299] g0: 0000000000000000 g1: 0000000000000004 g2: 0000000000000000 g3: 000000000000b6ca
[ 357.630314] g4: 000000000002a234 g5: 0000000000000030 g6: 00feffffffffffff g7: 00000000f7e066b0
[ 357.630328] o0: 0000000000000001 o1: 000000000002e000 o2: 0000000000000001 o3: 00000000fff4dbc0
[ 357.630343] o4: 0000000000000005 o5: 000000055ae82600 sp: 00000000fff4db68 ret_pc: 0000000000011e00
[ 357.630356] RPC: <0x11e08>
[ 357.630367] l0: 00000001 l1: 00001000 l2: f7f8b578 l3: 00000000 l4: 0000000d l5: 00018b30 l6: 0002a400 l7: f7f87000
[ 357.630386] i0: 00000000 i1: 0002e000 i2: 00000001 i3: 00000000 i4: 00000000 i5: 0000b6c9 i6: fff4dbd8 i7: 00013fdc
[ 357.667318] BUG: soft lockup - CPU#36 stuck for 74s! [dd:2271]
[ 357.667529] TSTATE: 0000004482000a00 TPC: 00000000f7eec914 TNPC: 00000000f7eec918 Y: 00000000 Not tainted
[ 357.667544] TPC: <0xf7eec91c>
[ 357.667555] g0: 0000000000000000 g1: 0000000000000003 g2: 0000000000000000 g3: 000000000000b80e
[ 357.667572] g4: 000000000002a234 g5: 0000000000000030 g6: 00feffffffffffff g7: 00000000f7e066b0
[ 357.667588] o0: 0000000000000001 o1: 000000000002e000 o2: 0000000000000001 o3: 00000000fff4dbc0
[ 357.667603] o4: 0000000000000005 o5: 000000055ae82600 sp: 00000000fff4db68 ret_pc: 0000000000011d8c
[ 357.667616] RPC: <0x11d94>
[ 357.667628] l0: 00000000 l1: 00001000 l2: f7f8b578 l3: 00000000 l4: 0000000d l5: 00018b30 l6: 0002a400 l7: f7f87000
[ 357.667646] i0: 00000000 i1: 0002e000 i2: 00000001 i3: 00000000 i4: 00000000 i5: 0000b80e i6: fff4dbd8 i7: 0001352c
[ 357.719609] BUG: soft lockup - CPU#32 stuck for 75s! [swapper:0]
[ 357.719826] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 357.719843] TPC: <cpu_idle+0xb0/0x134>
[ 357.719854] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff39c000 g3: 0000000000000000
[ 357.719868] g4: fffff803ff390c00 g5: fffff80007d64000 g6: fffff803ff39c000 g7: 0000021100004000
[ 357.719883] o0: 0000000000000000 o1: fffff803ff39c008 o2: 0000000000004000 o3: 0000000000000001
[ 357.719897] o4: 000000537548f080 o5: 0000000000000012 sp: fffff803ff39f681 ret_pc: 0000000000427818
[ 357.719912] RPC: <cpu_idle+0x9c/0x134>
[ 357.719922] l0: 0000000000000020 l1: 00000000007b95c8 l2: 0000000000000020 l3: 00000000000000c8
[ 357.719937] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 357.719952] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 357.719966] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff39f741 i7: 00000000006b0090
[ 357.719986] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 359.533565] BUG: soft lockup - CPU#53 stuck for 75s! [swapper:0]
[ 359.533785] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 359.533803] TPC: <cpu_idle+0xb0/0x134>
[ 359.533813] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff5b4000 g3: 0000000000000000
[ 359.533828] g4: fffff803ff596400 g5: fffff80007e0c000 g6: fffff803ff5b4000 g7: 0000021100004000
[ 359.533842] o0: 0000000000000000 o1: fffff803ff5b4008 o2: 0000000000004000 o3: 0000000000000001
[ 359.533857] o4: 00000053dd97d200 o5: 0000000000000012 sp: fffff803ff5b7681 ret_pc: 0000000000427818
[ 359.533872] RPC: <cpu_idle+0x9c/0x134>
[ 359.533882] l0: 0000000000000035 l1: 00000000007b95c8 l2: 0000000000000035 l3: 00000000000000c8
[ 359.533896] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 359.533911] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 359.533925] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff5b7741 i7: 00000000006b0090
[ 359.533946] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 363.306184] BUG: soft lockup - CPU#2 stuck for 79s! [swapper:0]
[ 363.306402] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000c31 Not tainted
[ 363.306420] TPC: <cpu_idle+0xb0/0x134>
[ 363.306430] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0a4000 g3: 0000000000000000
[ 363.306445] g4: fffff803ff098c00 g5: fffff80007c74000 g6: fffff803ff0a4000 g7: 0000021100004000
[ 363.306459] o0: 0000000000000000 o1: fffff803ff0a4008 o2: 0000000000004000 o3: 0000000000000001
[ 363.306474] o4: 00000054c0afce80 o5: 0000000000000012 sp: fffff803ff0a7681 ret_pc: 0000000000427818
[ 363.306489] RPC: <cpu_idle+0x9c/0x134>
[ 363.306499] l0: 0000000000000002 l1: 00000000007b95c8 l2: 0000000000000002 l3: 00000000000000c8
[ 363.306513] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 363.306528] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 363.306542] i4: 00000000fee82518 i5: 00000000fee815f8 i6: fffff803ff0a7741 i7: 00000000006b0090
[ 363.306562] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 365.537917] BUG: soft lockup - CPU#61 stuck for 81s! [bash:3663]
[ 365.538134] TSTATE: 0000009982000a01 TPC: 0000000000036514 TNPC: 0000000000036518 Y: 00000000 Not tainted
[ 365.538150] TPC: <0x3651c>
[ 365.538159] g0: 0000000000000000 g1: 000000000000003c g2: 0000000000000024 g3: 000000000000002d
[ 365.538173] g4: 00000000000ce3f8 g5: 00000000000d0f9c g6: 00000000000000fe g7: 00000000f7f046b0
[ 365.538187] o0: 000000000014c6e0 o1: 00000000001a6cc8 o2: 0000000000000000 o3: 0000000000000000
[ 365.538202] o4: 0000000000000000 o5: 00000000001a6cc0 sp: 00000000ffe27030 ret_pc: 0000000000036554
[ 365.538215] RPC: <0x3655c>
[ 365.538227] l0: ffffffdf l1: 000ce404 l2: 001a6a60 l3: 000ce400 l4: 00000000 l5: 00000000 l6: 00000000 l7: f7e53000
[ 365.538245] i0: 0014c6e0 i1: 001a6cb0 i2: 00000004 i3: 00000021 i4: 7f651c3f i5: 001a6ca8 i6: ffe270a0 i7: 00036798
[ 366.128863] BUG: soft lockup - CPU#5 stuck for 81s! [swapper:0]
[ 366.129082] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 366.129101] TPC: <cpu_idle+0xb0/0x134>
[ 366.129111] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0ec000 g3: 0000000000000000
[ 366.129125] g4: fffff803ff0d5800 g5: fffff80007c8c000 g6: fffff803ff0ec000 g7: 0000021100004000
[ 366.129140] o0: 0000000000000000 o1: fffff803ff0ec008 o2: 0000000000004000 o3: 0000000000000001
[ 366.129155] o4: 000000556a8f5b00 o5: 0000000000000012 sp: fffff803ff0ef681 ret_pc: 0000000000427818
[ 366.129170] RPC: <cpu_idle+0x9c/0x134>
[ 366.129180] l0: 0000000000000005 l1: 00000000007b95c8 l2: 0000000000000005 l3: 00000000000000c8
[ 366.129194] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 366.129208] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 366.129223] i4: 00000000fee81f18 i5: 00000000fee80ff8 i6: fffff803ff0ef741 i7: 00000000006b0090
[ 366.129243] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 368.068937] BUG: soft lockup - CPU#29 stuck for 78s! [swapper:0]
[ 368.069158] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 368.069175] TPC: <cpu_idle+0xb0/0x134>
[ 368.069185] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff354000 g3: 0000000000000000
[ 368.069200] g4: fffff803ff350000 g5: fffff80007d4c000 g6: fffff803ff354000 g7: 0000021100004000
[ 368.069214] o0: 0000000000000000 o1: fffff803ff354008 o2: 0000000000004000 o3: 0000000000000001
[ 368.069229] o4: 00000055db367780 o5: 0000000000000012 sp: fffff803ff357681 ret_pc: 0000000000427818
[ 368.069244] RPC: <cpu_idle+0x9c/0x134>
[ 368.069254] l0: 000000000000001d l1: 00000000007b95c8 l2: 000000000000001d l3: 00000000000000c8
[ 368.069268] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 368.069282] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 368.069297] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff357741 i7: 00000000006b0090
[ 368.069317] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 379.084763] BUG: soft lockup - CPU#3 stuck for 94s! [swapper:0]
[ 379.085001] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 379.085025] TPC: <cpu_idle+0xb0/0x134>
[ 379.085035] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0c0000 g3: 0000000000000000
[ 379.085050] g4: fffff803ff09a400 g5: fffff80007c7c000 g6: fffff803ff0c0000 g7: 0000021100004000
[ 379.085064] o0: 0000000000000000 o1: fffff803ff0c0008 o2: 0000000000004000 o3: 0000000000000001
[ 379.085079] o4: 000000586fa1d980 o5: 0000000000000012 sp: fffff803ff0c3681 ret_pc: 0000000000427818
[ 379.085094] RPC: <cpu_idle+0x9c/0x134>
[ 379.085104] l0: 0000000000000003 l1: 00000000007b95c8 l2: 0000000000000003 l3: 00000000000000c8
[ 379.085119] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 379.085133] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 379.085148] i4: 00000000fee82318 i5: 00000000fee813f8 i6: fffff803ff0c3741 i7: 00000000006b0090
[ 379.085175] I7: <after_lock_tlb+0x1a4/0x1b4>
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/