Re: [patch] softlockup: fix false positives on nohz if CPU is 100%idle for more than 60 seconds

From: David Miller
Date: Wed Apr 23 2008 - 06:55:54 EST

Next message: Hidehiro Kawai: "Re: [PATCH 0/4] jbd: possible filesystem corruption fixes"
Previous message: Gregory Haskins: "Re: [PATCH 1/2] sched: push rt tasks only if newly activatedtasks have been added"
In reply to: Ingo Molnar: "[patch] softlockup: fix false positives on nohz if CPU is 100%idle for more than 60 seconds"
Next in thread: David Miller: "Re: [patch] softlockup: fix false positives on nohz if CPU is 100%idle for more than 60 seconds"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

From: Ingo Molnar <mingo@xxxxxxx>
Date: Wed, 23 Apr 2008 10:50:30 +0200

> so the patch i gave you first should do the trick - the cleaner patch is
> attached below.

Even with this patch applied and the second buggy changeset:

commit 15934a37324f32e0fda633dc7984a671ea81cd75
Author: Guillaume Chazarain <guichaz@xxxxxxxx>
Date: Sat Apr 19 19:44:57 2008 +0200

sched: fix rq->clock overflows detection with CONFIG_NO_HZ

When using CONFIG_NO_HZ, rq->tick_timestamp is not updated every TICK_NSEC.
We check that the number of skipped ticks matches the clock jump seen in
__update_rq_clock().

Signed-off-by: Guillaume Chazarain <guichaz@xxxxxxxx>
Signed-off-by: Ingo Molnar <mingo@xxxxxxx>

reverted, I'm still getting softlockup warnings and wedged cpus, see
the log below.

Look, I'm just going to walk through the scheduler and cpumask
changesets one by one and report as each regression appears
and try to continue with the guilty changesets reported. There
are aparently several bugs being added by these changesets.

It may take some time, as each test run the verify the existence
of the problem takes several minutes.

[ 111.877610] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 111.877610] TPC: <cpu_idle+0xb0/0x134>
[ 111.877610] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff678000 g3: 0000000000000000
[ 111.877610] g4: fffff803ff647100 g5: fffff80007e4a000 g6: fffff803ff678000 g7: 0000021100004000
[ 111.877610] o0: 0000000000000000 o1: fffff803ff678008 o2: 0000000000004000 o3: 0000000000000001
[ 111.877610] o4: fffff8000863a2d0 o5: 0000000000000012 sp: fffff803ff67b681 ret_pc: 0000000000427818
[ 111.877610] RPC: <cpu_idle+0x9c/0x134>
[ 111.877610] l0: 000000000000003d l1: 00000000007bb6d0 l2: 000000000000003d l3: 00000000000000c8
[ 111.877610] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 111.877610] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 111.877610] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff67b741 i7: 00000000006b1d00
[ 111.877610] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 111.877610] BUG: soft lockup - CPU#20 stuck for 79s! [make:3645]
[ 111.877610] TSTATE: 0000009982000a07 TPC: 00000000f7e96aa0 TNPC: 00000000f7e96aa4 Y: 00000000 Not tainted
[ 111.877610] TPC: <0xf7e96aa8>
[ 111.877610] g0: 0000000000000000 g1: 0000000000022000 g2: 0000000000000021 g3: 0000000000000048
[ 111.877610] g4: 00000000000000d1 g5: 0000000000052628 g6: 000000000004fd78 g7: 00000000f7fe97d0
[ 111.877610] o0: 0000000000052628 o1: 0000000000032c00 o2: 0000000000000000 o3: 00000000000000f0
[ 111.877610] o4: fffffffffffffda8 o5: 0000000000000079 sp: 00000000ffa15d10 ret_pc: 00000000f7e96a1c
[ 111.877610] RPC: <0xf7e96a24>
[ 111.877610] l0: 00052530 l1: 000000d0 l2: 00052530 l3: 00052600 l4: 00000020 l5: 00000001 l6: 00002710 l7: f7f93000
[ 111.877610] i0: f7f95630 i1: 00052538 i2: 00046ce4 i3: 00000020 i4: 00000000 i5: 00052530 i6: ffa15da8 i7: f7e9760c
[ 111.884344] BUG: soft lockup - CPU#29 stuck for 68s! [swapper:0]
[ 111.884344] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 111.884344] TPC: <cpu_idle+0xb0/0x134>
[ 111.884344] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff354000 g3: 0000000000000000
[ 111.884344] g4: fffff803ff350000 g5: fffff80007d4a000 g6: fffff803ff354000 g7: 0000021100004000
[ 111.884344] o0: 0000000000000000 o1: fffff803ff354008 o2: 0000000000004000 o3: 0000000000000001
[ 111.884344] o4: fffff8000853a2d0 o5: 0000000000000012 sp: fffff803ff357681 ret_pc: 0000000000427818
[ 111.884344] RPC: <cpu_idle+0x9c/0x134>
[ 111.884344] l0: 000000000000001d l1: 00000000007bb6d0 l2: 000000000000001d l3: 00000000000000c8
[ 111.884344] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 111.884344] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 111.884344] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff357741 i7: 00000000006b1d00
[ 111.884344] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 111.884344] BUG: soft lockup - CPU#37 stuck for 73s! [swapper:0]
[ 111.884344] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 111.884344] TPC: <cpu_idle+0xb0/0x134>
[ 111.884344] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff418000 g3: 0000000000000000
[ 111.884344] g4: fffff803ff40cc40 g5: fffff80007d8a000 g6: fffff803ff418000 g7: 0000021100004000
[ 111.884344] o0: 0000000000000000 o1: fffff803ff418008 o2: 0000000000004000 o3: 0000000000000001
[ 111.884344] o4: fffff8000857a2d0 o5: 0000000000000012 sp: fffff803ff41b681 ret_pc: 0000000000427818
[ 111.884344] RPC: <cpu_idle+0x9c/0x134>
[ 111.884344] l0: 0000000000000025 l1: 00000000007bb6d0 l2: 0000000000000025 l3: 00000000000000c8
[ 111.884344] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 111.884344] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 111.884344] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff41b741 i7: 00000000006b1d00
[ 111.884344] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 111.884344] BUG: soft lockup - CPU#52 stuck for 74s! [swapper:0]
[ 111.884344] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 111.887610] TPC: <cpu_idle+0xb0/0x134>
[ 111.887610] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff5a0000 g3: 0000000000000000
[ 111.887610] g4: fffff803ff594c40 g5: fffff80007e02000 g6: fffff803ff5a0000 g7: 0000021100004000
[ 111.887610] o0: 0000000000000000 o1: fffff803ff5a0008 o2: 0000000000004000 o3: 0000000000000001
[ 111.887610] o4: fffff800085f22d0 o5: 0000000000000012 sp: fffff803ff5a3681 ret_pc: 0000000000427818
[ 111.887610] RPC: <cpu_idle+0x9c/0x134>
[ 111.887610] l0: 0000000000000034 l1: 00000000007bb6d0 l2: 0000000000000034 l3: 00000000000000c8
[ 111.887610] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 111.887610] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 111.887610] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff5a3741 i7: 00000000006b1d00
[ 111.887610] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 111.928036] BUG: soft lockup - CPU#2 stuck for 73s! [swapper:0]
[ 111.928036] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 000003ff Not tainted
[ 111.928036] TPC: <cpu_idle+0xb0/0x134>
[ 111.928036] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0a4000 g3: 0000000000000000
[ 111.928036] g4: fffff803ff098c40 g5: fffff80007c72000 g6: fffff803ff0a4000 g7: 0000021100004000
[ 111.928036] o0: 0000000000000000 o1: fffff803ff0a4008 o2: 0000000000004000 o3: 0000000000000001
[ 111.928036] o4: fffff800084622d0 o5: 0000000000000012 sp: fffff803ff0a7681 ret_pc: 0000000000427818
[ 111.928036] RPC: <cpu_idle+0x9c/0x134>
[ 111.928036] l0: 0000000000000002 l1: 00000000007bb6d0 l2: 0000000000000002 l3: 00000000000000c8
[ 111.928036] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 111.928036] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 111.928036] i4: 00000000fee82518 i5: 00000000fee815f8 i6: fffff803ff0a7741 i7: 00000000006b1d00
[ 111.928036] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 111.998042] BUG: soft lockup - CPU#5 stuck for 68s! [swapper:0]
[ 111.998042] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 111.998042] TPC: <cpu_idle+0xb0/0x134>
[ 111.998042] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0ec000 g3: 0000000000000000
[ 111.998042] g4: fffff803ff0d5880 g5: fffff80007c8a000 g6: fffff803ff0ec000 g7: 0000021100004000
[ 111.998042] o0: 0000000000000000 o1: fffff803ff0ec008 o2: 0000000000004000 o3: 0000000000000001
[ 111.998042] o4: fffff8000847a2d0 o5: 0000000000000012 sp: fffff803ff0ef681 ret_pc: 0000000000427818
[ 111.998042] RPC: <cpu_idle+0x9c/0x134>
[ 111.998042] l0: 0000000000000005 l1: 00000000007bb6d0 l2: 0000000000000005 l3: 00000000000000c8
[ 111.998042] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 111.998042] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 111.998042] i4: 00000000fee81f18 i5: 00000000fee80ff8 i6: fffff803ff0ef741 i7: 00000000006b1d00
[ 111.998042] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 176.103175] BUG: soft lockup - CPU#21 stuck for 61s! [swapper:0]
[ 176.103175] TSTATE: 0000000080001603 TPC: 000000000054e098 TNPC: 000000000054e09c Y: 00000000 Not tainted
[ 176.103175] TPC: <find_next_bit+0xfc/0x11c>
[ 176.103175] g0: 0000000000009000 g1: 0000000000000000 g2: ffffffffffffffff g3: 000000000000001c
[ 176.103175] g4: fffff803ff263100 g5: fffff80007d0a000 g6: fffff803ff294000 g7: 00000000007bb6d0
[ 176.103175] o0: 0000000ffffffff8 o1: 0000000000000040 o2: 000000000000001f o3: 0000000000000000
[ 176.103175] o4: 0000000000000002 o5: 0000000000000000 sp: fffff803ff296e21 ret_pc: 000000000054ddc8
[ 176.103175] RPC: <__next_cpu+0x18/0x2c>
[ 176.103175] l0: 00000000007f0000 l1: 0000004480001602 l2: 0000000000455d18 l3: 0000000000000400
[ 176.103175] l4: 0000000000000000 l5: 0000000000000002 l6: 0000000000000000 l7: 0000000000000008
[ 176.103175] i0: 000000000000001e i1: 00000000007bb6c8 i2: 0000000000000010 i3: 000000000046b148
[ 176.103175] i4: 0000000000845000 i5: 0000000000000401 i6: fffff803ff296ee1 i7: 0000000000455ca8
[ 176.103175] I7: <aggregate_group_shares+0xa0/0x16c>
[ 242.669112] INFO: task make:3645 blocked for more than 120 seconds.
[ 242.669331] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 242.669465] make D 00000000006b4a40 0 3645 2806
[ 242.669481] Call Trace:
[ 242.669489] [00000000006b4c00] schedule_timeout+0x20/0xa4
[ 242.669509] [00000000006b4a40] wait_for_common+0xf4/0x184
[ 242.669523] [000000000045f290] do_fork+0x1dc/0x234
[ 242.669543] [0000000000406214] linux_sparc_syscall32+0x3c/0x40
[ 242.669566] [000000000001d628] 0x1d630
[ 371.517530] INFO: task make:3645 blocked for more than 120 seconds.
[ 371.517754] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 371.517888] make D 00000000006b4a40 0 3645 2806
[ 371.517902] Call Trace:
[ 371.517910] [00000000006b4c00] schedule_timeout+0x20/0xa4
[ 371.517929] [00000000006b4a40] wait_for_common+0xf4/0x184
[ 371.517943] [000000000045f290] do_fork+0x1dc/0x234
[ 371.517961] [0000000000406214] linux_sparc_syscall32+0x3c/0x40
[ 371.517980] [000000000001d628] 0x1d630
[ 500.367473] INFO: task make:3645 blocked for more than 120 seconds.
[ 500.367696] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 500.367830] make D 00000000006b4a40 0 3645 2806
[ 500.367844] Call Trace:
[ 500.367851] [00000000006b4c00] schedule_timeout+0x20/0xa4
[ 500.367869] [00000000006b4a40] wait_for_common+0xf4/0x184
[ 500.367884] [000000000045f290] do_fork+0x1dc/0x234
[ 500.367900] [0000000000406214] linux_sparc_syscall32+0x3c/0x40
[ 500.367918] [000000000001d628] 0x1d630
[ 541.073973] BUG: soft lockup - CPU#2 stuck for 399s! [swapper:0]
[ 541.073973] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 541.073973] TPC: <cpu_idle+0xb0/0x134>
[ 541.073973] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0a4000 g3: 0000000000000000
[ 541.073973] g4: fffff803ff098c40 g5: fffff80007c72000 g6: fffff803ff0a4000 g7: 0000021100004000
[ 541.073973] o0: 0000000000000000 o1: fffff803ff0a4008 o2: 0000000000004000 o3: 0000000000000001
[ 541.073973] o4: fffff800084622d0 o5: 0000000000000012 sp: fffff803ff0a7681 ret_pc: 0000000000427818
[ 541.073973] RPC: <cpu_idle+0x9c/0x134>
[ 541.073973] l0: 0000000000000002 l1: 00000000007bb6d0 l2: 0000000000000002 l3: 00000000000000c8
[ 541.073973] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 541.073973] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 541.073973] i4: 00000000fee82518 i5: 00000000fee815f8 i6: fffff803ff0a7741 i7: 00000000006b1d00
[ 541.073973] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 542.063169] BUG: soft lockup - CPU#53 stuck for 156s! [swapper:0]
[ 542.063169] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 542.063169] TPC: <cpu_idle+0xb0/0x134>
[ 542.063169] g0: 0000000000000035 g1: 0000000000000016 g2: fffff803ff5b4000 g3: 0000000000000000
[ 542.063169] g4: fffff803ff5964c0 g5: fffff80007e0a000 g6: fffff803ff5b4000 g7: 0000021100004000
[ 542.063169] o0: 0000000000000000 o1: fffff803ff5b4008 o2: 0000000000004000 o3: 0000000000000001
[ 542.063169] o4: fffff800085fa2d0 o5: 0000000000000012 sp: fffff803ff5b7681 ret_pc: 0000000000427818
[ 542.063169] RPC: <cpu_idle+0x9c/0x134>
[ 542.063169] l0: 0000000000000035 l1: 00000000007bb6d0 l2: 0000000000000035 l3: 00000000000000c8
[ 542.063169] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 542.063169] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 542.063169] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff5b7741 i7: 00000000006b1d00
[ 542.063169] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 542.074256] BUG: soft lockup - CPU#28 stuck for 474s! [swapper:0]
[ 542.074256] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 542.074256] TPC: <cpu_idle+0xb0/0x134>
[ 542.074256] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff33c000 g3: 0000000000000000
[ 542.074256] g4: fffff803ff31e4c0 g5: fffff80007d42000 g6: fffff803ff33c000 g7: 0000021100004000
[ 542.074256] o0: 0000000000000000 o1: fffff803ff33c008 o2: 0000000000004000 o3: 0000000000000001
[ 542.074256] o4: fffff800085322d0 o5: 0000000000000012 sp: fffff803ff33f681 ret_pc: 0000000000427818
[ 542.074256] RPC: <cpu_idle+0x9c/0x134>
[ 542.074256] l0: 000000000000001c l1: 00000000007bb6d0 l2: 000000000000001c l3: 00000000000000c8
[ 542.074256] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 542.074256] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 542.074256] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff33f741 i7: 00000000006b1d00
[ 542.074256] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 542.074256] BUG: soft lockup - CPU#60 stuck for 473s! [make:3689]
[ 542.074256] TSTATE: 0000000082000a02 TPC: 00000000f7e71a38 TNPC: 00000000f7e71a3c Y: 00000000 Not tainted
[ 542.074256] TPC: <0xf7e71a40>
[ 542.074256] g0: 0000000000000000 g1: 632f636f64656373 g2: 0000000000000001 g3: 0000000000000000
[ 542.074256] g4: 8080808080808080 g5: 0000000000066760 g6: 0000000000000010 g7: 00000000f7de26b0
[ 542.074256] o0: 0000000000066760 o1: 0000000000066748 o2: 0000000000000001 o3: 0000000000000030
[ 542.074256] o4: 0000000000000000 o5: 2f4b636f6e666967 sp: 00000000ff957c98 ret_pc: 000000000002241c
[ 542.074256] RPC: <0x22424>
[ 542.074256] l0: ff957ba0 l1: 00000000 l2: 00000000 l3: 00066711 l4: 00000210 l5: 00000010 l6: 00066700 l7: f7f63000
[ 542.074256] i0: 00066730 i1: 00000000 i2: 00000000 i3: ff957d6c i4: 00000000 i5: 00000000 i6: ff957d08 i7: 000230c4
[ 542.109046] BUG: soft lockup - CPU#3 stuck for 475s! [swapper:0]
[ 542.112654] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 542.112654] TPC: <cpu_idle+0xb0/0x134>
[ 542.112654] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0c0000 g3: 0000000000000000
[ 542.112654] g4: fffff803ff09a4c0 g5: fffff80007c7a000 g6: fffff803ff0c0000 g7: 0000021100004000
[ 542.112654] o0: 0000000000000000 o1: fffff803ff0c0008 o2: 0000000000004000 o3: 0000000000000001
[ 542.112654] o4: fffff8000846a2d0 o5: 0000000000000012 sp: fffff803ff0c3681 ret_pc: 0000000000427818
[ 542.112654] RPC: <cpu_idle+0x9c/0x134>
[ 542.112654] l0: 0000000000000003 l1: 00000000007bb6d0 l2: 0000000000000003 l3: 00000000000000c8
[ 542.112654] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 542.112654] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 542.112654] i4: 00000000fee82318 i5: 00000000fee813f8 i6: fffff803ff0c3741 i7: 00000000006b1d00
[ 542.112654] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 542.844241] BUG: soft lockup - CPU#14 stuck for 489s! [swapper:0]
[ 542.844241] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000154 Not tainted
[ 542.844241] TPC: <cpu_idle+0xb0/0x134>
[ 542.844241] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff1c8000 g3: 0000000000000000
[ 542.844241] g4: fffff803ff1c4000 g5: fffff80007cd2000 g6: fffff803ff1c8000 g7: 0000021100004000
[ 542.844241] o0: 0000000000000000 o1: fffff803ff1c8008 o2: 0000000000004000 o3: 0000000000000001
[ 542.844241] o4: fffff800084c22d0 o5: 0000000000000012 sp: fffff803ff1cb681 ret_pc: 0000000000427818
[ 542.844241] RPC: <cpu_idle+0x9c/0x134>
[ 542.844241] l0: 000000000000000e l1: 00000000007bb6d0 l2: 000000000000000e l3: 00000000000000c8
[ 542.844241] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 542.844241] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 542.844241] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff1cb741 i7: 00000000006b1d00
[ 542.844241] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.079862] BUG: soft lockup - CPU#9 stuck for 490s! [swapper:0]
[ 545.079862] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.079862] TPC: <cpu_idle+0xb0/0x134>
[ 545.079862] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff154000 g3: 0000000000000000
[ 545.079862] g4: fffff803ff150000 g5: fffff80007caa000 g6: fffff803ff154000 g7: 0000021100004000
[ 545.079863] o0: 0000000000000000 o1: fffff803ff154008 o2: 0000000000004000 o3: 0000000000000001
[ 545.079863] o4: fffff8000849a2d0 o5: 0000000000000012 sp: fffff803ff157681 ret_pc: 0000000000427818
[ 545.079863] RPC: <cpu_idle+0x9c/0x134>
[ 545.079972] l0: 0000000000000009 l1: 00000000007bb6d0 l2: 0000000000000009 l3: 00000000000000c8
[ 545.079972] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.079972] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.079972] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff157741 i7: 00000000006b1d00
[ 545.079972] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.079972] BUG: soft lockup - CPU#25 stuck for 489s! [make:3882]
[ 545.079972] TSTATE: 0000004482000a03 TPC: 000000000001cc3c TNPC: 000000000001cc40 Y: 00000000 Not tainted
[ 545.079972] TPC: <0x1cc44>
[ 545.079972] g0: 0000000000000000 g1: 0000000000044c00 g2: 000000000005e238 g3: 0000000000000002
[ 545.079972] g4: 00000000000445cc g5: 0000000000000020 g6: 00feffffffffffff g7: 0000000070002580
[ 545.079972] o0: 0000000000000001 o1: 000000000005c8d8 o2: 0000000000000000 o3: 0000000000000000
[ 545.079972] o4: 0000000000000000 o5: 0000000000000000 sp: 00000000ffe82fa8 ret_pc: 000000000001cc28
[ 545.079972] RPC: <0x1cc30>
[ 545.079972] l0: 00000000 l1: 00000001 l2: 00000000 l3: 00000000 l4: 00000000 l5: 00000000 l6: 00000000 l7: 00000000
[ 545.079972] i0: 0005c8d8 i1: 0005d888 i2: 0005c8d8 i3: 0005d888 i4: fffff0e1 i5: 00000f1f i6: ffe83020 i7: 0001d74c
[ 545.087599] BUG: soft lockup - CPU#32 stuck for 489s! [cc1:3880]
[ 545.087599] TSTATE: 00000000e2001a04 TPC: 0000000070191964 TNPC: 0000000070191968 Y: 00000002 Not tainted
[ 545.087599] TPC: <0x7019196c>
[ 545.087599] g0: 0000000000000000 g1: 0000000000000d40 g2: 0000000600000000 g3: 0046fce80046fcf8
[ 545.087599] g4: 0000000000000381 g5: 0000000000472230 g6: 00feffffffffffff g7: 0000000070001d00
[ 545.087599] o0: 00000000004722c0 o1: 0000000000470e30 o2: 0000000000000034 o3: 0000000000472fb0
[ 545.087599] o4: 0046fcb80046fcd0 o5: 0000080000000000 sp: 00000000ffebe848 ret_pc: 000000007018935c
[ 545.087599] RPC: <0x70189364>
[ 545.087599] l0: 00471b90 l1: 00472228 l2: 00000e08 l3: 00005de8 l4: 00470d88 l5: 70285630 l6: 00002710 l7: 70283000
[ 545.087599] i0: 00470d90 i1: 00470d90 i2: 00001c08 i3: 00000020 i4: 00000020 i5: 00000002 i6: ffebe8c8 i7: 7018acd0
[ 545.087599] BUG: soft lockup - CPU#33 stuck for 491s! [swapper:0]
[ 545.087599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.087599] TPC: <cpu_idle+0xb0/0x134>
[ 545.087599] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff3b8000 g3: 0000000000000000
[ 545.087599] g4: fffff803ff3924c0 g5: fffff80007d6a000 g6: fffff803ff3b8000 g7: 0000021100004000
[ 545.087599] o0: 0000000000000000 o1: fffff803ff3b8008 o2: 0000000000004000 o3: 0000000000000001
[ 545.087599] o4: fffff8000855a2d0 o5: 0000000000000012 sp: fffff803ff3bb681 ret_pc: 0000000000427818
[ 545.087599] RPC: <cpu_idle+0x9c/0x134>
[ 545.087599] l0: 0000000000000021 l1: 00000000007bb6d0 l2: 0000000000000021 l3: 00000000000000c8
[ 545.087599] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.087599] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.087599] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff3bb741 i7: 00000000006b1d00
[ 545.087599] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.087599] BUG: soft lockup - CPU#38 stuck for 488s! [swapper:0]
[ 545.087599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.087599] TPC: <cpu_idle+0xb0/0x134>
[ 545.087599] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff42c000 g3: 0000000000000000
[ 545.087599] g4: fffff803ff40e4c0 g5: fffff80007d92000 g6: fffff803ff42c000 g7: 0000021100004000
[ 545.087599] o0: 0000000000000000 o1: fffff803ff42c008 o2: 0000000000004000 o3: 0000000000000001
[ 545.087599] o4: fffff800085822d0 o5: 0000000000000012 sp: fffff803ff42f681 ret_pc: 0000000000427818
[ 545.087599] RPC: <cpu_idle+0x9c/0x134>
[ 545.087599] l0: 0000000000000026 l1: 00000000007bb6d0 l2: 0000000000000026 l3: 00000000000000c8
[ 545.087599] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.087599] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.087599] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff42f741 i7: 00000000006b1d00
[ 545.087599] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.087599] BUG: soft lockup - CPU#35 stuck for 491s! [swapper:0]
[ 545.087599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.087599] TPC: <cpu_idle+0xb0/0x134>
[ 545.087599] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff3e4000 g3: 0000000000000000
[ 545.087599] g4: fffff803ff3cd880 g5: fffff80007d7a000 g6: fffff803ff3e4000 g7: 0000021100004000
[ 545.087599] o0: 0000000000000000 o1: fffff803ff3e4008 o2: 0000000000004000 o3: 0000000000000001
[ 545.087599] o4: fffff8000856a2d0 o5: 0000000000000012 sp: fffff803ff3e7681 ret_pc: 0000000000427818
[ 545.087599] RPC: <cpu_idle+0x9c/0x134>
[ 545.087599] l0: 0000000000000023 l1: 00000000007bb6d0 l2: 0000000000000023 l3: 00000000000000c8
[ 545.087599] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.087599] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.087599] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff3e7741 i7: 00000000006b1d00
[ 545.087599] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.087599] BUG: soft lockup - CPU#34 stuck for 491s! [swapper:0]
[ 545.087599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.087599] TPC: <cpu_idle+0xb0/0x134>
[ 545.087599] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff3d0000 g3: 0000000000000000
[ 545.087599] g4: fffff803ff3cc000 g5: fffff80007d72000 g6: fffff803ff3d0000 g7: 0000021100004000
[ 545.087599] o0: 0000000000000000 o1: fffff803ff3d0008 o2: 0000000000004000 o3: 0000000000000001
[ 545.087599] o4: fffff800085622d0 o5: 0000000000000012 sp: fffff803ff3d3681 ret_pc: 0000000000427818
[ 545.087599] RPC: <cpu_idle+0x9c/0x134>
[ 545.087599] l0: 0000000000000022 l1: 00000000007bb6d0 l2: 0000000000000022 l3: 00000000000000c8
[ 545.087599] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.087599] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.087599] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff3d3741 i7: 00000000006b1d00
[ 545.087599] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.087599] BUG: soft lockup - CPU#39 stuck for 491s! [swapper:0]
[ 545.087599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.087599] TPC: <cpu_idle+0xb0/0x134>
[ 545.087599] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff44c000 g3: 0000000000000000
[ 545.087599] g4: fffff803ff448000 g5: fffff80007d9a000 g6: fffff803ff44c000 g7: 0000021100004000
[ 545.087599] o0: 0000000000000000 o1: fffff803ff44c008 o2: 0000000000004000 o3: 0000000000000001
[ 545.087599] o4: fffff8000858a2d0 o5: 0000000000000012 sp: fffff803ff44f681 ret_pc: 0000000000427818
[ 545.087599] RPC: <cpu_idle+0x9c/0x134>
[ 545.087599] l0: 0000000000000027 l1: 00000000007bb6d0 l2: 0000000000000027 l3: 00000000000000c8
[ 545.087599] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.087599] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.087599] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff44f741 i7: 00000000006b1d00
[ 545.087599] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.087599] BUG: soft lockup - CPU#36 stuck for 460s! [swapper:0]
[ 545.087599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.087599] TPC: <cpu_idle+0xb0/0x134>
[ 545.087599] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff400000 g3: 0000000000000000
[ 545.087599] g4: fffff803ff3cf100 g5: fffff80007d82000 g6: fffff803ff400000 g7: 0000021100004000
[ 545.087599] o0: 0000000000000000 o1: fffff803ff400008 o2: 0000000000004000 o3: 0000000000000001
[ 545.087599] o4: fffff800085722d0 o5: 0000000000000012 sp: fffff803ff403681 ret_pc: 0000000000427818
[ 545.087599] RPC: <cpu_idle+0x9c/0x134>
[ 545.087599] l0: 0000000000000024 l1: 00000000007bb6d0 l2: 0000000000000024 l3: 00000000000000c8
[ 545.087599] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.087599] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.087599] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff403741 i7: 00000000006b1d00
[ 545.087599] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.104863] BUG: soft lockup - CPU#16 stuck for 491s! [gcc:3891]
[ 545.104863] TSTATE: 00000000f0000a07 TPC: 0000000070248e30 TNPC: 0000000070248e34 Y: 00000000 Not tainted
[ 545.104863] TPC: <0x70248e38>
[ 545.104863] g0: 0000000000000000 g1: 000000007010d93c g2: 000000007010f770 g3: 0000000070117738
[ 545.104863] g4: 000000007019bd80 g5: 0000000000000028 g6: 00feffffffffffff g7: 0000000070001cd0
[ 545.104863] o0: 0000000000000000 o1: 000000007010fe68 o2: 000000000000033e o3: 000000000008fd80
[ 545.104863] o4: 0000000070000f18 o5: 000000000000000a sp: 00000000ffaf8868 ret_pc: 00000000000003f3
[ 545.104863] RPC: <0x3fb>
[ 545.104863] l0: 7010c9a4 l1: 00005877 l2: 7010a890 l3: 70119318 l4: 00000000 l5: 00000000 l6: 00000000 l7: 7028b000
[ 545.104863] i0: 7018d680 i1: ffaf894c i2: ffaf895c i3: 00000000 i4: 00000000 i5: 00000000 i6: ffaf88d8 i7: 7018d9fc
[ 545.104863] BUG: soft lockup - CPU#22 stuck for 491s! [swapper:0]
[ 545.104863] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.104863] TPC: <cpu_idle+0xb0/0x134>
[ 545.104863] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff2ac000 g3: 0000000000000000
[ 545.104863] g4: fffff803ff2a0c40 g5: fffff80007d12000 g6: fffff803ff2ac000 g7: 0000021100004000
[ 545.105549] o0: 0000000000000000 o1: fffff803ff2ac008 o2: 0000000000004000 o3: 0000000000000001
[ 545.105549] o4: fffff800085022d0 o5: 0000000000000012 sp: fffff803ff2af681 ret_pc: 0000000000427818
[ 545.105549] RPC: <cpu_idle+0x9c/0x134>
[ 545.105549] l0: 0000000000000016 l1: 00000000007bb6d0 l2: 0000000000000016 l3: 00000000000000c8
[ 545.105549] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.105549] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.105549] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff2af741 i7: 00000000006b1d00
[ 545.105549] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.105549] BUG: soft lockup - CPU#20 stuck for 403s! [gcc-4.1:3889]
[ 545.105549] TSTATE: 0000009911001606 TPC: 00000000004a1db0 TNPC: 00000000004a1db4 Y: 00000000 Not tainted
[ 545.105549] TPC: <page_add_new_anon_rmap+0xc/0x44>
[ 545.105549] g0: fffff803ff0149a0 g1: 0000000000000004 g2: fffff800084f4f40 g3: 0000000000024000
[ 545.105549] g4: fffff803fcb49260 g5: fffff80007d02000 g6: fffff803f4248000 g7: 0000000000000001
[ 545.107599] o0: 0000000000000001 o1: 0000000206f62bc0 o2: 0000000000000001 o3: 0000000000000044
[ 545.107599] o4: 0000000000000000 o5: 0000000000000000 sp: fffff803f424b441 ret_pc: 00000000004947c8
[ 545.107599] RPC: <lru_cache_add_active+0x40/0x70>
[ 545.107599] l0: fffff800084f4f28 l1: 0000000206f62bb8 l2: fffff803fcb49260 l3: fffff803fccbec78
[ 545.107599] l4: 0000000206f62bb8 l5: 0000000000054800 l6: 0000000000000010 l7: 00000000001200d2
[ 545.107599] i0: 0000000206f62bb8 i1: fffff803fccbec78 i2: 000000000005a000 i3: 0000000000000000
[ 545.107599] i4: 0000000000000000 i5: 00ffffffffffffff i6: fffff803f424b501 i7: 000000000049b4e8
[ 545.107599] I7: <handle_mm_fault+0x2dc/0x7c0>
[ 545.107599] BUG: soft lockup - CPU#19 stuck for 491s! [swapper:0]
[ 545.107599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.107599] TPC: <cpu_idle+0xb0/0x134>
[ 545.107599] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff264000 g3: 0000000000000000
[ 545.107599] g4: fffff803ff260000 g5: fffff80007cfa000 g6: fffff803ff264000 g7: 0000021100004000
[ 545.107599] o0: 0000000000000000 o1: fffff803ff264008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107599] o4: fffff800084ea2d0 o5: 0000000000000012 sp: fffff803ff267681 ret_pc: 0000000000427818
[ 545.107599] RPC: <cpu_idle+0x9c/0x134>
[ 545.107599] l0: 0000000000000013 l1: 00000000007bb6d0 l2: 0000000000000013 l3: 00000000000000c8
[ 545.107599] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107599] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107599] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff267741 i7: 00000000006b1d00
[ 545.107599] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.107599] BUG: soft lockup - CPU#17 stuck for 491s! [swapper:0]
[ 545.107599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.107599] TPC: <cpu_idle+0xb0/0x134>
[ 545.107599] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff230000 g3: 0000000000000000
[ 545.107599] g4: fffff803ff224c40 g5: fffff80007cea000 g6: fffff803ff230000 g7: 0000021100004000
[ 545.107599] o0: 0000000000000000 o1: fffff803ff230008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107599] o4: fffff800084da2d0 o5: 0000000000000012 sp: fffff803ff233681 ret_pc: 0000000000427818
[ 545.107599] RPC: <cpu_idle+0x9c/0x134>
[ 545.107599] l0: 0000000000000011 l1: 00000000007bb6d0 l2: 0000000000000011 l3: 00000000000000c8
[ 545.107599] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107599] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107599] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff233741 i7: 00000000006b1d00
[ 545.107599] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.107599] BUG: soft lockup - CPU#18 stuck for 491s! [swapper:0]
[ 545.107599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.107599] TPC: <cpu_idle+0xb0/0x134>
[ 545.107599] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff24c000 g3: 0000000000000000
[ 545.107599] g4: fffff803ff2264c0 g5: fffff80007cf2000 g6: fffff803ff24c000 g7: 0000021100004000
[ 545.107599] o0: 0000000000000000 o1: fffff803ff24c008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107599] o4: fffff800084e22d0 o5: 0000000000000012 sp: fffff803ff24f681 ret_pc: 0000000000427818
[ 545.107599] RPC: <cpu_idle+0x9c/0x134>
[ 545.107599] l0: 0000000000000012 l1: 00000000007bb6d0 l2: 0000000000000012 l3: 00000000000000c8
[ 545.107599] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107599] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107599] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff24f741 i7: 00000000006b1d00
[ 545.107599] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.107599] BUG: soft lockup - CPU#23 stuck for 491s! [swapper:0]
[ 545.107599] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.107601] TPC: <cpu_idle+0xb0/0x134>
[ 545.107601] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff2c0000 g3: 0000000000000000
[ 545.107601] g4: fffff803ff2a24c0 g5: fffff80007d1a000 g6: fffff803ff2c0000 g7: 0000021100004000
[ 545.107601] o0: 0000000000000000 o1: fffff803ff2c0008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107601] o4: fffff8000850a2d0 o5: 0000000000000012 sp: fffff803ff2c3681 ret_pc: 0000000000427818
[ 545.107601] RPC: <cpu_idle+0x9c/0x134>
[ 545.107601] l0: 0000000000000017 l1: 00000000007bb6d0 l2: 0000000000000017 l3: 00000000000000c8
[ 545.107601] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107601] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107601] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff2c3741 i7: 00000000006b1d00
[ 545.107601] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.107601] BUG: soft lockup - CPU#41 stuck for 478s! [cc1:3892]
[ 545.107601] TSTATE: 0000009911001603 TPC: 00000000004edd0c TNPC: 00000000004edd10 Y: 00000000 Not tainted
[ 545.107601] TPC: <proc_reg_read+0x54/0x80>
[ 545.107601] g0: fffff8000859d228 g1: 00000000004f1dc0 g2: 00000000006c5f88 g3: fffff80007c62000
[ 545.107601] g4: fffff803fbb29260 g5: fffff80007daa000 g6: fffff803f4308000 g7: 0000000070001d00
[ 545.107601] o0: fffff803ff038200 o1: fffff803fe8c66e0 o2: fffff803fbadc3c0 o3: 0000000000000000
[ 545.107601] o4: 0000000000000022 o5: 0000000000038003 sp: fffff803f430b451 ret_pc: 00000000004edcd4
[ 545.107601] RPC: <proc_reg_read+0x1c/0x80>
[ 545.107601] l0: fffff803ff038200 l1: fffff803ff038180 l2: 0000000000000000 l3: 0000000000000000
[ 545.107601] l4: 0000000000000000 l5: 0000000000000005 l6: 0000000000000000 l7: 0000000000400000
[ 545.107601] i0: fffff803fbadc3c0 i1: 0000000070006000 i2: 0000000000000400 i3: fffff803f430be80
[ 545.107601] i4: 0000000000000000 i5: 0000000000000000 i6: fffff803f430b511 i7: 00000000004b2e6c
[ 545.107601] I7: <vfs_read+0x78/0x10c>
[ 545.107601] BUG: soft lockup - CPU#40 stuck for 491s! [swapper:0]
[ 545.107601] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.107601] TPC: <cpu_idle+0xb0/0x134>
[ 545.107601] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff460000 g3: 0000000000000000
[ 545.107601] g4: fffff803ff449880 g5: fffff80007da2000 g6: fffff803ff460000 g7: 0000021100004000
[ 545.107601] o0: 0000000000000000 o1: fffff803ff460008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107601] o4: fffff800085922d0 o5: 0000000000000012 sp: fffff803ff463681 ret_pc: 0000000000427818
[ 545.107601] RPC: <cpu_idle+0x9c/0x134>
[ 545.107602] l0: 0000000000000028 l1: 00000000007bb6d0 l2: 0000000000000028 l3: 00000000000000c8
[ 545.107602] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107602] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107602] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff463741 i7: 00000000006b1d00
[ 545.107602] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.107602] BUG: soft lockup - CPU#50 stuck for 491s! [swapper:0]
[ 545.107602] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000092 Not tainted
[ 545.107602] TPC: <cpu_idle+0xb0/0x134>
[ 545.107602] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff56c000 g3: 0000000000000000
[ 545.107602] g4: fffff803ff555880 g5: fffff80007df2000 g6: fffff803ff56c000 g7: 0000021100004000
[ 545.107602] o0: 0000000000000000 o1: fffff803ff56c008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107602] o4: fffff800085e22d0 o5: 0000000000000012 sp: fffff803ff56f681 ret_pc: 0000000000427818
[ 545.107602] RPC: <cpu_idle+0x9c/0x134>
[ 545.107602] l0: 0000000000000032 l1: 00000000007bb6d0 l2: 0000000000000032 l3: 00000000000000c8
[ 545.107602] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107602] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107602] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff56f741 i7: 00000000006b1d00
[ 545.107602] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.107602] BUG: soft lockup - CPU#49 stuck for 491s! [swapper:0]
[ 545.107602] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 000015d8 Not tainted
[ 545.107602] TPC: <cpu_idle+0xb0/0x134>
[ 545.107602] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff558000 g3: 0000000000000000
[ 545.107602] g4: fffff803ff554000 g5: fffff80007dea000 g6: fffff803ff558000 g7: 0000021100004000
[ 545.107602] o0: 0000000000000000 o1: fffff803ff558008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107602] o4: fffff800085da2d0 o5: 0000000000000012 sp: fffff803ff55b681 ret_pc: 0000000000427818
[ 545.107602] RPC: <cpu_idle+0x9c/0x134>
[ 545.107602] l0: 0000000000000031 l1: 00000000007bb6d0 l2: 0000000000000031 l3: 00000000000000c8
[ 545.107602] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107602] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107602] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff55b741 i7: 00000000006b1d00
[ 545.107602] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.107602] BUG: soft lockup - CPU#52 stuck for 403s! [swapper:0]
[ 545.107602] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.107602] TPC: <cpu_idle+0xb0/0x134>
[ 545.107602] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff5a0000 g3: 0000000000000000
[ 545.107602] g4: fffff803ff594c40 g5: fffff80007e02000 g6: fffff803ff5a0000 g7: 0000021100004000
[ 545.107602] o0: 0000000000000000 o1: fffff803ff5a0008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107602] o4: fffff800085f22d0 o5: 0000000000000012 sp: fffff803ff5a3681 ret_pc: 0000000000427818
[ 545.107602] RPC: <cpu_idle+0x9c/0x134>
[ 545.107602] l0: 0000000000000034 l1: 00000000007bb6d0 l2: 0000000000000034 l3: 00000000000000c8
[ 545.107602] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107602] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107602] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff5a3741 i7: 00000000006b1d00
[ 545.107602] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.107602] BUG: soft lockup - CPU#55 stuck for 491s! [swapper:0]
[ 545.107602] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.107602] TPC: <cpu_idle+0xb0/0x134>
[ 545.107602] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff5e8000 g3: 0000000000000000
[ 545.107602] g4: fffff803ff5d1880 g5: fffff80007e1a000 g6: fffff803ff5e8000 g7: 0000021100004000
[ 545.107602] o0: 0000000000000000 o1: fffff803ff5e8008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107602] o4: fffff8000860a2d0 o5: 0000000000000012 sp: fffff803ff5eb681 ret_pc: 0000000000427818
[ 545.107602] RPC: <cpu_idle+0x9c/0x134>
[ 545.107602] l0: 0000000000000037 l1: 00000000007bb6d0 l2: 0000000000000037 l3: 00000000000000c8
[ 545.107602] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107602] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107602] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff5eb741 i7: 00000000006b1d00
[ 545.107602] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.107602] BUG: soft lockup - CPU#54 stuck for 490s! [swapper:0]
[ 545.107602] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.107602] TPC: <cpu_idle+0xb0/0x134>
[ 545.107602] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff5d4000 g3: 0000000000000000
[ 545.107602] g4: fffff803ff5d0000 g5: fffff80007e12000 g6: fffff803ff5d4000 g7: 0000021100004000
[ 545.107602] o0: 0000000000000000 o1: fffff803ff5d4008 o2: 0000000000004000 o3: 0000000000000001
[ 545.107602] o4: fffff800086022d0 o5: 0000000000000012 sp: fffff803ff5d7681 ret_pc: 0000000000427818
[ 545.107602] RPC: <cpu_idle+0x9c/0x134>
[ 545.107602] l0: 0000000000000036 l1: 00000000007bb6d0 l2: 0000000000000036 l3: 00000000000000c8
[ 545.107602] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.107602] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.107602] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff5d7741 i7: 00000000006b1d00
[ 545.107602] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.313403] BUG: soft lockup - CPU#4 stuck for 476s! [swapper:0]
[ 545.313403] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.313403] TPC: <cpu_idle+0xb0/0x134>
[ 545.313403] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff0d8000 g3: 0000000000000000
[ 545.313403] g4: fffff803ff0d4000 g5: fffff80007c82000 g6: fffff803ff0d8000 g7: 0000021100004000
[ 545.313403] o0: 0000000000000000 o1: fffff803ff0d8008 o2: 0000000000004000 o3: 0000000000000001
[ 545.313403] o4: fffff800084722d0 o5: 0000000000000012 sp: fffff803ff0db681 ret_pc: 0000000000427818
[ 545.313403] RPC: <cpu_idle+0x9c/0x134>
[ 545.313403] l0: 0000000000000004 l1: 00000000007bb6d0 l2: 0000000000000004 l3: 00000000000000c8
[ 545.313403] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.313403] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.313403] i4: 00000000fee82118 i5: 00000000fee811f8 i6: fffff803ff0db741 i7: 00000000006b1d00
[ 545.313403] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.335438] BUG: soft lockup - CPU#6 stuck for 491s! [swapper:0]
[ 545.335438] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 545.335438] TPC: <cpu_idle+0xb0/0x134>
[ 545.335438] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff108000 g3: 0000000000000000
[ 545.335438] g4: fffff803ff0d7100 g5: fffff80007c92000 g6: fffff803ff108000 g7: 0000021100004000
[ 545.335438] o0: 0000000000000000 o1: fffff803ff108008 o2: 0000000000004000 o3: 0000000000000001
[ 545.335438] o4: fffff800084822d0 o5: 0000000000000012 sp: fffff803ff10b681 ret_pc: 0000000000427818
[ 545.335438] RPC: <cpu_idle+0x9c/0x134>
[ 545.335438] l0: 0000000000000006 l1: 00000000007bb6d0 l2: 0000000000000006 l3: 00000000000000c8
[ 545.335438] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 545.335438] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 545.335438] i4: 00000000fee81d18 i5: 00000000fee80df8 i6: fffff803ff10b741 i7: 00000000006b1d00
[ 545.335438] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 545.919995] BUG: soft lockup - CPU#30 stuck for 492s! [collect2:3922]
[ 545.920001] TSTATE: 0000000011001601 TPC: 000000000042220c TNPC: 0000000000422210 Y: 00000000 Not tainted
[ 545.920001] TPC: <tl0_linux32+0x14/0x20>
[ 545.920001] g0: 0000000000000000 g1: 0000000000000066 g2: 0000000000000002 g3: fffff80007c62000
[ 545.920001] g4: fffff803fb181880 g5: fffff80007d52000 g6: fffff803fabbc000 g7: 0000000070001d00
[ 545.920001] o0: 0000000000001000 o1: 0000000000000000 o2: 000000007012ca74 o3: 0000000000000000
[ 545.920001] o4: 00000000ffcc82dc o5: 0000000000000000 sp: fffff803fabbf6a1 ret_pc: 0000000000406214
[ 545.920001] RPC: <linux_sparc_syscall32+0x3c/0x40>
[ 545.920001] l0: 0000000000009000 l1: 00000000000f0000 l2: 000000000042220c l3: 0000000000000000
[ 545.920001] l4: 0000000000000004 l5: 0000000000014690 l6: fffff803fabbc000 l7: 0000000011009001
[ 545.920001] i0: 0000000000000003 i1: 00000000ffcc835c i2: 00000000ffcc82d0 i3: 000000007012c998
[ 545.920001] i4: 0000000000000008 i5: 0000000000000000 i6: 00000000ffcc8270 i7: 000000007012ca20
[ 545.920001] I7: <0x7012ca28>
[ 545.930002] BUG: soft lockup - CPU#46 stuck for 492s! [as:3923]
[ 545.930002] TSTATE: 0000000082000a01 TPC: 0000000000012ddc TNPC: 0000000000012de0 Y: 00000000 Not tainted
[ 545.930002] TPC: <0x12de4>
[ 545.930002] g0: 0000000000000000 g1: 0000000000075400 g2: 0000000000000000 g3: 0000000000012da4
[ 545.930002] g4: 000000000006d548 g5: 000000000007ddc5 g6: 00feffffffffffff g7: 0000000070002340
[ 545.930004] o0: 000000000007ddc5 o1: 000000000007136f o2: 000000000007136f o3: 000000000000ca5c
[ 545.930004] o4: 0000000000000000 o5: 616c5f6372633332 sp: 00000000ff878a48 ret_pc: 0000000000012e70
[ 545.930004] RPC: <0x12e78>
[ 545.930004] l0: 00000063 l1: 0007ddcd l2: 000743e5 l3: 000823e9 l4: 0006d400 l5: 000206b8 l6: 0006d400 l7: 0006d400
[ 545.930004] i0: 0007ddcc i1: 0007a3e9 i2: 00071372 i3: 000963f8 i4: 00071372 i5: 00000000 i6: ff878ab8 i7: 00020794
[ 545.939996] BUG: soft lockup - CPU#26 stuck for 492s! [ld:3924]
[ 545.939998] TSTATE: 0000000082001a01 TPC: 0000000000022be4 TNPC: 0000000000022be8 Y: 00000000 Not tainted
[ 545.939998] TPC: <0x22bec>
[ 545.939998] g0: 0000000000000000 g1: 0000000000000061 g2: 000000000000002a g3: 000000000000005b
[ 545.939998] g4: 00000000000003e8 g5: 00000000000984a8 g6: 00000000000000ff g7: 0000000070002040
[ 545.939998] o0: 00000000000984af o1: 0000000000000038 o2: 0000000000096f18 o3: 434f4d4d4f4e0000
[ 545.939998] o4: 2e64656275675f61 o5: 0000000000044308 sp: 00000000ff92b698 ret_pc: 0000000000022824
[ 545.939998] RPC: <0x2282c>
[ 545.939998] l0: 0000002a l1: 00098118 l2: 0004a288 l3: 00000001 l4: 000984c0 l5: 00000000 l6: 0004abc8 l7: 000984c0
[ 545.939998] i0: 000984c0 i1: 0000003f i2: 000984a8 i3: 0008d000 i4: 0004a000 i5: 3f000000 i6: ff92b708 i7: 00014c00
[ 545.961814] BUG: soft lockup - CPU#42 stuck for 492s! [sh:3925]
[ 545.961814] TSTATE: 0000004411001606 TPC: 00000000004af1c0 TNPC: 00000000004af1c4 Y: 00000000 Not tainted
[ 545.961814] TPC: <sysfs_slab_alias+0x0/0x7c>
[ 545.961814] g0: fffff803f428bb88 g1: 0000000000000001 g2: 0000000000000000 g3: fffff803f5a9e000
[ 545.963551] g4: fffff803fca61880 g5: fffff80007db2000 g6: fffff803f4288000 g7: 00e0000000000080
[ 545.963551] o0: fffff803f5a9e000 o1: 00000000000000d0 o2: ffffffffffffffff o3: 00000000004e8ffc
[ 545.963551] o4: fffff800085a5548 o5: 0000000206ea0ac8 sp: fffff803f428b2a1 ret_pc: 00000000004af164
[ 545.963551] RPC: <kmem_cache_alloc+0x40/0x9c>
[ 545.963551] l0: fffff800085a5548 l1: 0000000000000000 l2: 0000000206edca48 l3: 000007feffffefb6
[ 545.963551] l4: fffff803f59817fc l5: fffff80000000000 l6: 0000000000000001 l7: fffff803f4131ce0
[ 545.963551] i0: fffff803f5a9e000 i1: 00000000000000d0 i2: 0000000000000001 i3: 0000000000001ff8
[ 545.963551] i4: fffff803fca9b500 i5: fffff803f5a30000 i6: fffff803f428b361 i7: 00000000004e8ffc
[ 545.963551] I7: <load_elf_binary+0x18/0x1248>
[ 545.983551] BUG: soft lockup - CPU#47 stuck for 492s! [rm:3926]
[ 545.983551] TSTATE: 0000004411001600 TPC: 00000000004c6b94 TNPC: 00000000004c6b98 Y: 00000000 Not tainted
[ 545.983551] TPC: <touch_atime+0x28/0x16c>
[ 545.983551] g0: 0000000000000000 g1: 0000000000000000 g2: fffff803ff0149a0 g3: 0000000000000000
[ 545.983551] g4: fffff803fca624c0 g5: fffff80007dda000 g6: fffff803f4490000 g7: 0000000000000000
[ 545.983551] o0: 0000000000000000 o1: fffff803f44939e0 o2: 000000000050fb10 o3: 0000000000007a05
[ 545.983551] o4: 0000000000000000 o5: fffff803ff0149a0 sp: fffff803f4493041 ret_pc: 00000000004c6b7c
[ 545.983551] RPC: <touch_atime+0x10/0x16c>
[ 545.983551] l0: 0000000000000001 l1: 00000000007bb000 l2: 0000000070065dc8 l3: fffff803f4493d28
[ 545.983551] l4: fffff803ff0149a0 l5: 0000000000008b05 l6: 0000000070005600 l7: 0000000070066000
[ 545.983551] i0: fffff803ff0149a0 i1: fffff803fe8783b0 i2: fffff803f44939f0 i3: fffff803f44d8009
[ 545.983551] i4: 0000000000000000 i5: 0000000000000000 i6: fffff803f4493121 i7: 00000000004bbdf0
[ 545.983551] I7: <__link_path_walk+0xb18/0xfcc>
[ 548.946014] BUG: soft lockup - CPU#24 stuck for 495s! [swapper:0]
[ 548.946066] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 548.946066] TPC: <cpu_idle+0xb0/0x134>
[ 548.946066] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff2e0000 g3: 0000000000000000
[ 548.946066] g4: fffff803ff2dc000 g5: fffff80007d22000 g6: fffff803ff2e0000 g7: 0000021100004000
[ 548.946066] o0: 0000000000000000 o1: fffff803ff2e0008 o2: 0000000000004000 o3: 0000000000000001
[ 548.946066] o4: fffff800085122d0 o5: 0000000000000012 sp: fffff803ff2e3681 ret_pc: 0000000000427818
[ 548.946066] RPC: <cpu_idle+0x9c/0x134>
[ 548.946066] l0: 0000000000000018 l1: 00000000007bb6d0 l2: 0000000000000018 l3: 00000000000000c8
[ 548.946066] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 548.946066] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 548.946066] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff2e3741 i7: 00000000006b1d00
[ 548.946066] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 548.946066] BUG: soft lockup - CPU#27 stuck for 495s! [swapper:0]
[ 548.946066] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 548.946066] TPC: <cpu_idle+0xb0/0x134>
[ 548.946066] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff328000 g3: 0000000000000000
[ 548.946066] g4: fffff803ff31cc40 g5: fffff80007d3a000 g6: fffff803ff328000 g7: 0000021100004000
[ 548.946066] o0: 0000000000000000 o1: fffff803ff328008 o2: 0000000000004000 o3: 0000000000000001
[ 548.946713] o4: fffff8000852a2d0 o5: 0000000000000012 sp: fffff803ff32b681 ret_pc: 0000000000427818
[ 548.946713] RPC: <cpu_idle+0x9c/0x134>
[ 548.946713] l0: 000000000000001b l1: 00000000007bb6d0 l2: 000000000000001b l3: 00000000000000c8
[ 548.946713] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 548.946713] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 548.946713] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff32b741 i7: 00000000006b1d00
[ 548.946713] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 549.108565] BUG: soft lockup - CPU#44 stuck for 485s! [swapper:0]
[ 549.108566] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 549.108566] TPC: <cpu_idle+0xb0/0x134>
[ 549.108566] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff4c0000 g3: 0000000000000000
[ 549.108566] g4: fffff803ff4bc000 g5: fffff80007dc2000 g6: fffff803ff4c0000 g7: 0000021100004000
[ 549.108566] o0: 0000000000000000 o1: fffff803ff4c0008 o2: 0000000000004000 o3: 0000000000000001
[ 549.108566] o4: fffff800085b22d0 o5: 0000000000000012 sp: fffff803ff4c3681 ret_pc: 0000000000427818
[ 549.108566] RPC: <cpu_idle+0x9c/0x134>
[ 549.108566] l0: 000000000000002c l1: 00000000007bb6d0 l2: 000000000000002c l3: 00000000000000c8
[ 549.108566] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 549.108566] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 549.108566] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff4c3741 i7: 00000000006b1d00
[ 549.108566] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 549.108624] BUG: soft lockup - CPU#7 stuck for 495s! [swapper:0]
[ 549.109120] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 549.109120] TPC: <cpu_idle+0xb0/0x134>
[ 549.109120] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff120000 g3: 0000000000000000
[ 549.109120] g4: fffff803ff114c40 g5: fffff80007c9a000 g6: fffff803ff120000 g7: 0000021100004000
[ 549.109120] o0: 0000000000000000 o1: fffff803ff120008 o2: 0000000000004000 o3: 0000000000000001
[ 549.109120] o4: fffff8000848a2d0 o5: 0000000000000012 sp: fffff803ff123681 ret_pc: 0000000000427818
[ 549.109120] RPC: <cpu_idle+0x9c/0x134>
[ 549.109120] l0: 0000000000000007 l1: 00000000007bb6d0 l2: 0000000000000007 l3: 00000000000000c8
[ 549.115883] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 549.115883] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 549.115883] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff123741 i7: 00000000006b1d00
[ 549.115883] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 549.118643] BUG: soft lockup - CPU#51 stuck for 495s! [sh:4118]
[ 549.118745] TSTATE: 0000000011001602 TPC: 000000000042220c TNPC: 0000000000422210 Y: 00000000 Not tainted
[ 549.118745] TPC: <tl0_linux32+0x14/0x20>
[ 549.118745] g0: 0000000000000000 g1: 0000000000000047 g2: 00000000700d0000 g3: fffff80007c62000
[ 549.118745] g4: fffff803fcd53100 g5: fffff80007dfa000 g6: fffff803f09a8000 g7: 0000000000000000
[ 549.118745] o0: 0000000000001000 o1: 000000007024c000 o2: 00000000700b4d0c o3: 0000000000000000
[ 549.118745] o4: 00000000700d0000 o5: 0000000000000000 sp: fffff803f09ab6a1 ret_pc: 0000000000406214
[ 549.118745] RPC: <linux_sparc_syscall32+0x3c/0x40>
[ 549.118745] l0: 0000000000009000 l1: 0000000000198000 l2: 000000000042220c l3: 0000000000000000
[ 549.118745] l4: 0000000000000004 l5: 00000000700af0e0 l6: fffff803f09a8000 l7: 0000000011009002
[ 549.118745] i0: 000000007024c000 i1: 0000000000006000 i2: 0000000000000007 i3: 0000000000000812
[ 549.118745] i4: 0000000000000003 i5: 000000000016c000 i6: 00000000ffbfb518 i7: 00000000700a489c
[ 549.118745] I7: <0x700a48a4>
[ 549.119078] BUG: soft lockup - CPU#8 stuck for 495s! [swapper:0]
[ 549.119120] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00002c0b Not tainted
[ 549.119120] TPC: <cpu_idle+0xb0/0x134>
[ 549.119120] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff134000 g3: 0000000000000000
[ 549.119120] g4: fffff803ff1164c0 g5: fffff80007ca2000 g6: fffff803ff134000 g7: 0000021100004000
[ 549.125880] o0: 0000000000000000 o1: fffff803ff134008 o2: 0000000000004000 o3: 0000000000000001
[ 549.125880] o4: fffff800084922d0 o5: 0000000000000012 sp: fffff803ff137681 ret_pc: 0000000000427818
[ 549.125880] RPC: <cpu_idle+0x9c/0x134>
[ 549.125880] l0: 0000000000000008 l1: 00000000007bb6d0 l2: 0000000000000008 l3: 00000000000000c8
[ 549.125885] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 549.125885] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 549.125885] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff137741 i7: 00000000006b1d00
[ 549.125885] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 549.125885] BUG: soft lockup - CPU#10 stuck for 495s! [swapper:0]
[ 549.125885] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 000170f9 Not tainted
[ 549.125885] TPC: <cpu_idle+0xb0/0x134>
[ 549.125885] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff168000 g3: 0000000000000000
[ 549.125885] g4: fffff803ff151880 g5: fffff80007cb2000 g6: fffff803ff168000 g7: 0000021100004000
[ 549.125955] o0: 0000000000000000 o1: fffff803ff168008 o2: 0000000000004000 o3: 0000000000000001
[ 549.125955] o4: fffff800084a22d0 o5: 0000000000000012 sp: fffff803ff16b681 ret_pc: 0000000000427818
[ 549.125955] RPC: <cpu_idle+0x9c/0x134>
[ 549.125955] l0: 000000000000000a l1: 00000000007bb6d0 l2: 000000000000000a l3: 00000000000000c8
[ 549.125955] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 549.125955] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 549.125955] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff16b741 i7: 00000000006b1d00
[ 549.125955] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 549.126537] BUG: soft lockup - CPU#11 stuck for 495s! [swapper:0]
[ 549.126537] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 000170f9 Not tainted
[ 549.126537] TPC: <cpu_idle+0xb0/0x134>
[ 549.126537] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff17c000 g3: 0000000000000000
[ 549.126537] g4: fffff803ff153100 g5: fffff80007cba000 g6: fffff803ff17c000 g7: 0000021100004000
[ 549.126537] o0: 0000000000000000 o1: fffff803ff17c008 o2: 0000000000004000 o3: 0000000000000001
[ 549.126537] o4: fffff800084aa2d0 o5: 0000000000000012 sp: fffff803ff17f681 ret_pc: 0000000000427818
[ 549.126537] RPC: <cpu_idle+0x9c/0x134>
[ 549.126537] l0: 000000000000000b l1: 00000000007bb6d0 l2: 000000000000000b l3: 00000000000000c8
[ 549.126537] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 549.126537] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 549.126537] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff17f741 i7: 00000000006b1d00
[ 549.126537] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 549.126537] BUG: soft lockup - CPU#15 stuck for 495s! [swapper:0]
[ 549.126537] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000000 Not tainted
[ 549.126537] TPC: <cpu_idle+0xb0/0x134>
[ 549.126537] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff204000 g3: 0000000000000000
[ 549.126537] g4: fffff803ff1c5880 g5: fffff80007cda000 g6: fffff803ff204000 g7: 0000021100004000
[ 549.126537] o0: 0000000000000000 o1: fffff803ff204008 o2: 0000000000004000 o3: 0000000000000001
[ 549.126537] o4: fffff800084ca2d0 o5: 0000000000000012 sp: fffff803ff207681 ret_pc: 0000000000427818
[ 549.126537] RPC: <cpu_idle+0x9c/0x134>
[ 549.126537] l0: 000000000000000f l1: 00000000007bb6d0 l2: 000000000000000f l3: 00000000000000c8
[ 549.126537] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 549.126537] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 549.126537] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff207741 i7: 00000000006b1d00
[ 549.126537] I7: <after_lock_tlb+0x1a4/0x1b4>
[ 549.193032] BUG: soft lockup - CPU#31 stuck for 495s! [sh:4198]
[ 549.193032] TSTATE: 0000004482000a04 TPC: 000000000002178c TNPC: 0000000000021790 Y: 00000000 Not tainted
[ 549.193032] TPC: <0x21794>
[ 549.193032] g0: 0000000000000000 g1: 000000000000003d g2: 000000000000003d g3: 000000000000062d
[ 549.193032] g4: 0000000000000050 g5: 3d3d3d3d00000000 g6: 00feffffffffffff g7: 0000000070001d20
[ 549.193032] o0: 00000000ffb2935d o1: 00000000ffb2932d o2: 0000000000000000 o3: 0000000000000000
[ 549.193032] o4: 0000000000000000 o5: 0000000000000000 sp: 00000000ffb28130 ret_pc: 0000000000021b0c
[ 549.193032] RPC: <0x21b14>
[ 549.193032] l0: 0003a248 l1: 00036890 l2: 00000000 l3: 00000000 l4: 00000000 l5: 00000000 l6: 00000000 l7: 00000000
[ 549.193032] i0: ffb29359 i1: 00000009 i2: 31302e30 i3: 0000003d i4: 0c0d130d i5: 3b2f3f2f i6: ffb281a0 i7: 00022bf8
[ 549.193032] BUG: soft lockup - CPU#48 stuck for 495s! [ld:4197]
[ 549.193032] TSTATE: 0000000082001a00 TPC: 0000000000017340 TNPC: 0000000000017344 Y: 00000000 Not tainted
[ 549.196245] TPC: <0x17348>
[ 549.196245] g0: 0000000000000000 g1: 0000000000042800 g2: 0000000000044000 g3: 0000000000001c2c
[ 549.196245] g4: 0000000000091961 g5: 0000000000000038 g6: 0000000000091961 g7: 0000000070002040
[ 549.196245] o0: 0000000000000007 o1: 0000000000000000 o2: 0000000000000000 o3: 0000000000000000
[ 549.196245] o4: 0000000000000000 o5: 0000000000000000 sp: 00000000ffc62498 ret_pc: 00000000000172f0
[ 549.196246] RPC: <0x172f8>
[ 549.196246] l0: 00091961 l1: 00091961 l2: 000436d8 l3: 00044308 l4: 00041d60 l5: 00041960 l6: 00000000 l7: 00000000
[ 549.196246] i0: 00042960 i1: 0008d000 i2: 0008d000 i3: 0008d000 i4: 0008d400 i5: 0008d400 i6: ffc62508 i7: 0001403c
[ 549.216249] BUG: soft lockup - CPU#56 stuck for 487s! [swapper:0]
[ 549.216249] TSTATE: 0000000011001601 TPC: 000000000042782c TNPC: 0000000000427830 Y: 00000072 Not tainted
[ 549.216249] TPC: <cpu_idle+0xb0/0x134>
[ 549.216249] g0: 0000000000000000 g1: 0000000000000016 g2: fffff803ff5fc000 g3: 0000000000000000
[ 549.216249] g4: fffff803ff5d3100 g5: fffff80007e22000 g6: fffff803ff5fc000 g7: 0000021100004000
[ 549.216249] o0: 0000000000000000 o1: fffff803ff5fc008 o2: 0000000000004000 o3: 0000000000000001
[ 549.216249] o4: fffff800086122d0 o5: 0000000000000012 sp: fffff803ff5ff681 ret_pc: 0000000000427818
[ 549.216249] RPC: <cpu_idle+0x9c/0x134>
[ 549.216249] l0: 0000000000000038 l1: 00000000007bb6d0 l2: 0000000000000038 l3: 00000000000000c8
[ 549.216249] l4: 00000000feb51cc7 l5: 00000000feb51c7f l6: 0000000000000001 l7: 0000000000000000
[ 549.216249] i0: 0000000000000000 i1: 0000000000000016 i2: 0000000000001000 i3: 00000000f025bdfc
[ 549.216249] i4: 00000000fee81b18 i5: 00000000fee80bf8 i6: fffff803ff5ff741 i7: 00000000006b1d00
[ 549.216249] I7: <after_lock_tlb+0x1a4/0x1b4>
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

Next message: Hidehiro Kawai: "Re: [PATCH 0/4] jbd: possible filesystem corruption fixes"
Previous message: Gregory Haskins: "Re: [PATCH 1/2] sched: push rt tasks only if newly activatedtasks have been added"
In reply to: Ingo Molnar: "[patch] softlockup: fix false positives on nohz if CPU is 100%idle for more than 60 seconds"
Next in thread: David Miller: "Re: [patch] softlockup: fix false positives on nohz if CPU is 100%idle for more than 60 seconds"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]