Re: [syzbot] INFO: task hung in perf_event_free_task
From: Dmitry Vyukov
Date: Wed Apr 21 2021 - 08:35:29 EST
On Wed, Apr 21, 2021 at 2:26 PM Dmitry Vyukov <dvyukov@xxxxxxxxxx> wrote:
>
> On Wed, Apr 21, 2021 at 11:30 AM Peter Zijlstra <peterz@xxxxxxxxxxxxx> wrote:
> >
> > On Tue, Apr 20, 2021 at 02:10:22AM -0700, syzbot wrote:
> > > syzbot has found a reproducer for the following issue on:
> > >
> > > HEAD commit: 7af08140 Revert "gcov: clang: fix clang-11+ build"
> > > git tree: upstream
> > > console output: https://syzkaller.appspot.com/x/log.txt?x=15416871d00000
> > > kernel config: https://syzkaller.appspot.com/x/.config?x=c0a6882014fd3d45
> > > dashboard link: https://syzkaller.appspot.com/bug?extid=7692cea7450c97fa2a0a
> > > compiler: Debian clang version 11.0.1-2
> > > syz repro: https://syzkaller.appspot.com/x/repro.syz?x=145c9ffed00000
> > > C reproducer: https://syzkaller.appspot.com/x/repro.c?x=12de31ded00000
> >
> > When I build that C file and run it, it completes. AFAICT that's not the
> > expected outcome given we're looking for a hung-task scenario. Hmm?
>
>
> I just reproduced it on some similar kernel I had. Maybe you used a
> different config. Or maybe it requires a similar qemu machine.
> However, the reproducer looks like a fork bomb and it produced
> thousands of subprocesses and took some time.
> In the past 2 years it's been happening all reproducers look similar
> and involve clone and perf_event_open.
>
>
>
> INFO: task a.out:13194 blocked for more than 143 seconds.
> Not tainted 5.12.0-rc5-next-20210330 #113
> "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
> task:a.out state:D stack:28616 pid:13194 ppid: 23696 flags:0x00004004
> Call Trace:
> context_switch kernel/sched/core.c:4329 [inline]
> __schedule+0x911/0x2160 kernel/sched/core.c:5079
> schedule+0xcf/0x270 kernel/sched/core.c:5158
> perf_event_free_task+0x519/0x6c0 kernel/events/core.c:12627
> copy_process+0x4a1e/0x70b0 kernel/fork.c:2377
> kernel_clone+0xe7/0xab0 kernel/fork.c:2501
> __do_sys_clone+0xc8/0x110 kernel/fork.c:2618
> do_syscall_64+0x2d/0x70 arch/x86/entry/common.c:46
> entry_SYSCALL_64_after_hwframe+0x44/0xae
> RIP: 0033:0x451e49
> RSP: 002b:00007fa8e0d66118 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
> RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 0000000000451e49
> RDX: 9999999999999999 RSI: 0000000000000000 RDI: 0000000022086605
> RBP: 00007fa8e0d66200 R08: ffffffffffffffff R09: 0000000000000000
> R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffc688a6c7e
> R13: 00007ffc688a6c7f R14: 00007fa8e0d66300 R15: 0000000000022000
>
> Showing all locks held in the system:
> 3 locks held by kworker/u8:1/35:
> #0: ffff888010782938 ((wq_completion)netns){+.+.}-{0:0}, at:
> arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
> #0: ffff888010782938 ((wq_completion)netns){+.+.}-{0:0}, at:
> atomic64_set include/asm-generic/atomic-instrumented.h:856 [inline]
> #0: ffff888010782938 ((wq_completion)netns){+.+.}-{0:0}, at:
> atomic_long_set include/asm-generic/atomic-long.h:41 [inline]
> #0: ffff888010782938 ((wq_completion)netns){+.+.}-{0:0}, at:
> set_work_data kernel/workqueue.c:616 [inline]
> #0: ffff888010782938 ((wq_completion)netns){+.+.}-{0:0}, at:
> set_work_pool_and_clear_pending kernel/workqueue.c:643 [inline]
> #0: ffff888010782938 ((wq_completion)netns){+.+.}-{0:0}, at:
> process_one_work+0x871/0x1600 kernel/workqueue.c:2246
> #1: ffffc90000597da8 (net_cleanup_work){+.+.}-{0:0}, at:
> process_one_work+0x8a5/0x1600 kernel/workqueue.c:2250
> #2: ffffffff8ce94f50 (pernet_ops_rwsem){++++}-{3:3}, at:
> cleanup_net+0x9b/0xb10 net/core/net_namespace.c:557
> 3 locks held by kworker/u8:3/269:
> 1 lock held by khungtaskd/1654:
> #0: ffffffff8b7773a0 (rcu_read_lock){....}-{1:2}, at:
> debug_show_all_locks+0x53/0x260 kernel/locking/lockdep.c:6333
> 1 lock held by rsyslogd/8425:
> #0: ffff88801433edf0 (&f->f_pos_lock){+.+.}-{3:3}, at:
> __fdget_pos+0xe9/0x100 fs/file.c:967
> 2 locks held by getty/8519:
> #0: ffff888020a09098 (&tty->ldisc_sem){++++}-{0:0}, at:
> tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:266
> #1: ffffc9000115b2e8 (&ldata->atomic_read_lock){+.+.}-{3:3}, at:
> n_tty_read+0xd5b/0x12f0 drivers/tty/n_tty.c:2178
> 2 locks held by getty/8520:
> #0: ffff888025793098 (&tty->ldisc_sem){++++}-{0:0}, at:
> tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:266
> #1: ffffc9000113b2e8 (&ldata->atomic_read_lock){+.+.}-{3:3}, at:
> n_tty_read+0xd5b/0x12f0 drivers/tty/n_tty.c:2178
> 2 locks held by getty/8521:
> #0: ffff8880194b5098 (&tty->ldisc_sem){++++}-{0:0}, at:
> tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:266
> #1: ffffc900011ab2e8 (&ldata->atomic_read_lock){+.+.}-{3:3}, at:
> n_tty_read+0xd5b/0x12f0 drivers/tty/n_tty.c:2178
> 2 locks held by getty/8522:
> #0: ffff888020a0f098 (&tty->ldisc_sem){++++}-{0:0}, at:
> tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:266
> #1: ffffc900011db2e8 (&ldata->atomic_read_lock){+.+.}-{3:3}, at:
> n_tty_read+0xd5b/0x12f0 drivers/tty/n_tty.c:2178
> 2 locks held by getty/8523:
> #0: ffff888019293098 (&tty->ldisc_sem){++++}-{0:0}, at:
> tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:266
> #1: ffffc900011bb2e8 (&ldata->atomic_read_lock){+.+.}-{3:3}, at:
> n_tty_read+0xd5b/0x12f0 drivers/tty/n_tty.c:2178
> 2 locks held by getty/8524:
> #0: ffff888019296098 (&tty->ldisc_sem){++++}-{0:0}, at:
> tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:266
> #1: ffffc900011cb2e8 (&ldata->atomic_read_lock){+.+.}-{3:3}, at:
> n_tty_read+0xd5b/0x12f0 drivers/tty/n_tty.c:2178
> 2 locks held by kworker/0:5/8616:
> #0: ffff88800fc64d38 ((wq_completion)events){+.+.}-{0:0}, at:
> arch_atomic64_set arch/x86/include/asm/atomic64_64.h:34 [inline]
> #0: ffff88800fc64d38 ((wq_completion)events){+.+.}-{0:0}, at:
> atomic64_set include/asm-generic/atomic-instrumented.h:856 [inline]
> #0: ffff88800fc64d38 ((wq_completion)events){+.+.}-{0:0}, at:
> atomic_long_set include/asm-generic/atomic-long.h:41 [inline]
> #0: ffff88800fc64d38 ((wq_completion)events){+.+.}-{0:0}, at:
> set_work_data kernel/workqueue.c:616 [inline]
> #0: ffff88800fc64d38 ((wq_completion)events){+.+.}-{0:0}, at:
> set_work_pool_and_clear_pending kernel/workqueue.c:643 [inline]
> #0: ffff88800fc64d38 ((wq_completion)events){+.+.}-{0:0}, at:
> process_one_work+0x871/0x1600 kernel/workqueue.c:2246
> #1: ffffc90001d77da8 ((kfence_timer).work){+.+.}-{0:0}, at:
> process_one_work+0x8a5/0x1600 kernel/workqueue.c:2250
> 2 locks held by bash/13876:
> #0: ffff88804e222098 (&tty->ldisc_sem){++++}-{0:0}, at:
> tty_ldisc_ref_wait+0x22/0x80 drivers/tty/tty_ldisc.c:266
> #1: ffffc9000be332e8 (&ldata->atomic_read_lock){+.+.}-{3:3}, at:
> n_tty_read+0xd5b/0x12f0 drivers/tty/n_tty.c:2178
>
> =============================================
>
> NMI backtrace for cpu 3
> CPU: 3 PID: 1654 Comm: khungtaskd Not tainted 5.12.0-rc5-next-20210330 #113
> Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS
> rel-1.13.0-44-g88ab0c15525c-prebuilt.qemu.org 04/01/2014
> Call Trace:
> __dump_stack lib/dump_stack.c:79 [inline]
> dump_stack+0x141/0x1d7 lib/dump_stack.c:120
> nmi_cpu_backtrace.cold+0x44/0xd7 lib/nmi_backtrace.c:105
> nmi_trigger_cpumask_backtrace+0x1b3/0x230 lib/nmi_backtrace.c:62
> trigger_all_cpu_backtrace include/linux/nmi.h:146 [inline]
> check_hung_uninterruptible_tasks kernel/hung_task.c:253 [inline]
> watchdog+0xd8e/0xf40 kernel/hung_task.c:338
> kthread+0x3b1/0x4a0 kernel/kthread.c:292
> ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:294
> Sending NMI from CPU 3 to CPUs 0-2:
> NMI backtrace for cpu 2 skipped: idling at native_safe_halt
> arch/x86/include/asm/irqflags.h:51 [inline]
> NMI backtrace for cpu 2 skipped: idling at arch_safe_halt
> arch/x86/include/asm/irqflags.h:89 [inline]
> NMI backtrace for cpu 2 skipped: idling at default_idle+0xe/0x10
> arch/x86/kernel/process.c:683
> NMI backtrace for cpu 0 skipped: idling at native_safe_halt
> arch/x86/include/asm/irqflags.h:51 [inline]
> NMI backtrace for cpu 0 skipped: idling at arch_safe_halt
> arch/x86/include/asm/irqflags.h:89 [inline]
> NMI backtrace for cpu 0 skipped: idling at default_idle+0xe/0x10
> arch/x86/kernel/process.c:683
> NMI backtrace for cpu 1 skipped: idling at native_safe_halt
> arch/x86/include/asm/irqflags.h:51 [inline]
> NMI backtrace for cpu 1 skipped: idling at arch_safe_halt
> arch/x86/include/asm/irqflags.h:89 [inline]
> NMI backtrace for cpu 1 skipped: idling at default_idle+0xe/0x10
> arch/x86/kernel/process.c:683
Interestingly this reproduced with the simpler syzkaller reproducer in
~30 seconds and w/o creating fork bomb (at least I looked at the
number of processes initially and it did not jump to thousands). So
maybe the fork bomb is just a red herring.
cat /tmp/prog
perf_event_open(&(0x7f0000940000)={0x2, 0x70, 0xee6a, 0x0, 0x0, 0x0,
0x0, 0x0, 0x0, 0x0, 0x0, 0x5, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0,
0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0,
0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, @perf_config_ext}, 0x0, 0x0,
0xffffffffffffffff, 0x0)
clone(0x2102001ffe, 0x0, 0xfffffffffffffffe, 0x0, 0xffffffffffffffff)
ioctl$PERF_EVENT_IOC_RESET(0xffffffffffffffff, 0x2403, 0x0)
./syz-execprog -repeat=0 -procs=4 prog
2021/04/21 12:19:31 executed programs: 2986
2021/04/21 12:19:36 executed programs: 3667
2021/04/21 12:19:41 executed programs: 4323
[ 254.362146][ T3344] ieee802154 phy0 wpan0: encryption failed: -22
[ 254.363064][ T3344] ieee802154 phy1 wpan1: encryption failed: -22
2021/04/21 12:19:46 executed programs: 4984
2021/04/21 12:19:51 executed programs: 5649
[ 315.807468][ T3344] ieee802154 phy0 wpan0: encryption failed: -22
[ 315.809063][ T3344] ieee802154 phy1 wpan1: encryption failed: -22
[ 328.121848][ T25] Bluetooth: hci4: command 0x0406 tx timeout
[ 328.121849][ T8706] Bluetooth: hci1: command 0x0406 tx timeout
[ 328.121931][ T8706] Bluetooth: hci3: command 0x0406 tx timeout
[ 328.123555][ T25] Bluetooth: hci2: command 0x0406 tx timeout
[ 328.128087][ T25] Bluetooth: hci5: command 0x0406 tx timeout
[ 338.371924][ T2997] Bluetooth: hci0: command 0x0406 tx timeout
[ 339.471747][ T1294] unregister_netdevice: waiting for ip6gre0 to
become free. Usage count = 2
Message from syslogd@syzkaller at Apr 21 12:21:10 ...
kernel:[ 339.471747][ T1294] unregister_netdevice: waiting for
ip6gre0 to become free. Usage count = 2
[ 377.242537][ T3344] ieee802154 phy0 wpan0: encryption failed: -22
[ 377.243562][ T3344] ieee802154 phy1 wpan1: encryption failed: -22
[ 406.042164][ T1651] INFO: task syz-executor:10479 can't die for
more than 143 seconds.
[ 406.045360][ T1651] task:syz-executor state:D stack:28904
pid:10479 ppid: 11138 flags:0x00004006
[ 406.048146][ T1651] Call Trace:
[ 406.049143][ T1651] __schedule+0x911/0x2160
[ 406.050531][ T1651] ? io_schedule_timeout+0x140/0x140
[ 406.053016][ T1651] ? prepare_to_wait_event+0x129/0x7e0
[ 406.053825][ T1651] schedule+0xcf/0x270
[ 406.054373][ T1651] perf_event_free_task+0x519/0x6c0
[ 406.055117][ T1651] ? perf_event_exit_task+0xf10/0xf10
[ 406.055890][ T1651] ? init_wait_var_entry+0x200/0x200
[ 406.056657][ T1651] copy_process+0x4a1e/0x70b0
[ 406.057320][ T1651] ? mark_lock+0xef/0x17b0
[ 406.057952][ T1651] ? __cleanup_sighand+0xb0/0xb0
[ 406.058658][ T1651] ? do_futex+0x165/0x1780
[ 406.059283][ T1651] ? __lock_acquire+0x16a7/0x5230
[ 406.060002][ T1651] ? kernel_clone+0x314/0xab0
[ 406.060663][ T1651] kernel_clone+0xe7/0xab0
[ 406.061289][ T1651] ? create_io_thread+0xf0/0xf0
[ 406.062930][ T1651] ? lockdep_hardirqs_on_prepare+0x400/0x400
[ 406.063908][ T1651] ? __sanitizer_cov_trace_const_cmp4+0x1c/0x70
[ 406.064806][ T1651] ? find_held_lock+0x2d/0x110
[ 406.065491][ T1651] __do_sys_clone+0xc8/0x110
[ 406.066154][ T1651] ? kernel_clone+0xab0/0xab0
[ 406.066828][ T1651] ? __context_tracking_enter+0xef/0x100
[ 406.067649][ T1651] ? syscall_enter_from_user_mode+0x27/0x70
[ 406.068493][ T1651] do_syscall_64+0x2d/0x70
[ 406.069125][ T1651] entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 406.069980][ T1651] RIP: 0033:0x465f69
[ 406.070545][ T1651] RSP: 002b:00007f6178513188 EFLAGS: 00000246
ORIG_RAX: 0000000000000038
[ 406.073140][ T1651] RAX: ffffffffffffffda RBX: 000000000056bf60
RCX: 0000000000465f69
[ 406.074357][ T1651] RDX: 9999999999999999 RSI: 0000000000000000
RDI: 0000002102001ffe
[ 406.075488][ T1651] RBP: 00000000004bfa8f R08: ffffffffffffffff
R09: 0000000000000000
[ 406.076597][ T1651] R10: 0000000000000000 R11: 0000000000000246
R12: 000000000056bf60
[ 406.077706][ T1651] R13: 00007ffcf37755cf R14: 00007f6178513300
R15: 0000000000022000
[ 406.078886][ T1651] INFO: task syz-executor:10479 blocked for more
than 143 seconds.
[ 406.079983][ T1651] Not tainted 5.12.0-rc5-next-20210330 #113
[ 406.080880][ T1651] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 406.082994][ T1651] task:syz-executor state:D stack:28904
pid:10479 ppid: 11138 flags:0x00004006
[ 406.084212][ T1651] Call Trace:
[ 406.084638][ T1651] __schedule+0x911/0x2160
[ 406.085191][ T1651] ? io_schedule_timeout+0x140/0x140
[ 406.085887][ T1651] ? prepare_to_wait_event+0x129/0x7e0
[ 406.086566][ T1651] schedule+0xcf/0x270
[ 406.087080][ T1651] perf_event_free_task+0x519/0x6c0
[ 406.087727][ T1651] ? perf_event_exit_task+0xf10/0xf10
[ 406.088387][ T1651] ? init_wait_var_entry+0x200/0x200
[ 406.089081][ T1651] copy_process+0x4a1e/0x70b0
[ 406.089659][ T1651] ? mark_lock+0xef/0x17b0
[ 406.090214][ T1651] ? __cleanup_sighand+0xb0/0xb0
[ 406.090836][ T1651] ? do_futex+0x165/0x1780
[ 406.091448][ T1651] ? __lock_acquire+0x16a7/0x5230
[ 406.092296][ T1651] ? kernel_clone+0x314/0xab0
[ 406.093006][ T1651] kernel_clone+0xe7/0xab0
[ 406.093688][ T1651] ? create_io_thread+0xf0/0xf0
[ 406.094357][ T1651] ? lockdep_hardirqs_on_prepare+0x400/0x400
[ 406.095348][ T1651] ? __sanitizer_cov_trace_const_cmp4+0x1c/0x70
[ 406.096633][ T1651] ? find_held_lock+0x2d/0x110
[ 406.097618][ T1651] __do_sys_clone+0xc8/0x110
[ 406.098563][ T1651] ? kernel_clone+0xab0/0xab0
[ 406.099531][ T1651] ? __context_tracking_enter+0xef/0x100
[ 406.100832][ T1651] ? syscall_enter_from_user_mode+0x27/0x70
[ 406.102608][ T1651] do_syscall_64+0x2d/0x70
[ 406.103320][ T1651] entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 406.104220][ T1651] RIP: 0033:0x465f69
[ 406.104758][ T1651] RSP: 002b:00007f6178513188 EFLAGS: 00000246
ORIG_RAX: 0000000000000038
[ 406.105898][ T1651] RAX: ffffffffffffffda RBX: 000000000056bf60
RCX: 0000000000465f69
[ 406.106978][ T1651] RDX: 9999999999999999 RSI: 0000000000000000
RDI: 0000002102001ffe
[ 406.108023][ T1651] RBP: 00000000004bfa8f R08: ffffffffffffffff
R09: 0000000000000000
[ 406.108973][ T1651] R10: 0000000000000000 R11: 0000000000000246
R12: 000000000056bf60
[ 406.109924][ T1651] R13: 00007ffcf37755cf R14: 00007f6178513300
R15: 0000000000022000
[ 406.110908][ T1651]
[ 406.110908][ T1651] Showing all locks held in the system:
[ 406.111863][ T1651] 2 locks held by kworker/u8:3/278:
[ 406.112494][ T1651] 3 locks held by kworker/u8:5/1294:
[ 406.113133][ T1651] #0: ffff888010782938
((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0x871/0x1600
[ 406.114459][ T1651] #1: ffffc90004f17da8
(net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0x8a5/0x1600
[ 406.115681][ T1651] #2: ffffffff8ce94f50
(pernet_ops_rwsem){++++}-{3:3}, at: cleanup_net+0x9b/0xb10
[ 406.116838][ T1651] 1 lock held by khungtaskd/1651:
[ 406.117488][ T1651] #0: ffffffff8b7773a0
(rcu_read_lock){....}-{1:2}, at: debug_show_all_locks+0x53/0x260
[ 406.118866][ T1651] 4 locks held by rs:main Q:Reg/8514:
[ 406.119589][ T1651] 1 lock held by rsyslogd/8516:
[ 406.120237][ T1651] #0: ffff888019411770
(&f->f_pos_lock){+.+.}-{3:3}, at: __fdget_pos+0xe9/0x100
[ 406.121488][ T1651] 2 locks held by getty/8614:
[ 406.122287][ T1651] #0: ffff8880153e3098
(&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x22/0x80
[ 406.123642][ T1651] #1: ffffc90000f7f2e8
(&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xd5b/0x12f0
[ 406.125102][ T1651] 2 locks held by getty/8615:
[ 406.125734][ T1651] #0: ffff888029bfd098
(&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x22/0x80
[ 406.127074][ T1651] #1: ffffc90000f872e8
(&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xd5b/0x12f0
[ 406.128470][ T1651] 2 locks held by getty/8616:
[ 406.129104][ T1651] #0: ffff8880197b3098
(&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x22/0x80
[ 406.130444][ T1651] #1: ffffc90000fbb2e8
(&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xd5b/0x12f0
[ 406.132580][ T1651] 2 locks held by getty/8617:
[ 406.133214][ T1651] #0: ffff888029bff098
(&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x22/0x80
[ 406.134601][ T1651] #1: ffffc90000f7b2e8
(&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xd5b/0x12f0
[ 406.135977][ T1651] 2 locks held by getty/8618:
[ 406.136626][ T1651] #0: ffff88801438c098
(&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x22/0x80
[ 406.137949][ T1651] #1: ffffc90000feb2e8
(&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xd5b/0x12f0
[ 406.139321][ T1651] 2 locks held by getty/8619:
[ 406.139949][ T1651] #0: ffff8880197b2098
(&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x22/0x80
[ 406.141291][ T1651] #1: ffffc90000ffb2e8
(&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xd5b/0x12f0
[ 406.142713][ T1651] 2 locks held by bash/8632:
[ 406.143342][ T1651] #0: ffff888026ead098
(&tty->ldisc_sem){++++}-{0:0}, at: tty_ldisc_ref_wait+0x22/0x80
[ 406.144751][ T1651] #1: ffffc9000102b2e8
(&ldata->atomic_read_lock){+.+.}-{3:3}, at: n_tty_read+0xd5b/0x12f0
[ 406.146158][ T1651]
[ 406.146476][ T1651] =============================================
[ 406.146476][ T1651]
[ 406.147615][ T1651] NMI backtrace for cpu 0
[ 406.148204][ T1651] CPU: 0 PID: 1651 Comm: khungtaskd Not tainted
5.12.0-rc5-next-20210330 #113
[ 406.149397][ T1651] Hardware name: QEMU Standard PC (Q35 + ICH9,
2009), BIOS rel-1.13.0-44-g88ab0c15525c-prebuilt.qemu.org 04/01/2014
[ 406.151034][ T1651] Call Trace:
[ 406.151479][ T1651] dump_stack+0x141/0x1d7
[ 406.152081][ T1651] nmi_cpu_backtrace.cold+0x44/0xd7
[ 406.152792][ T1651] ? lapic_can_unplug_cpu+0x80/0x80
[ 406.153500][ T1651] nmi_trigger_cpumask_backtrace+0x1b3/0x230
[ 406.154378][ T1651] watchdog+0xd8e/0xf40
[ 406.154957][ T1651] ? trace_sched_process_hang+0x280/0x280
[ 406.155763][ T1651] kthread+0x3b1/0x4a0
[ 406.156321][ T1651] ? __kthread_bind_mask+0xc0/0xc0
[ 406.157029][ T1651] ret_from_fork+0x1f/0x30
[ 406.157689][ T1651] Sending NMI from CPU 0 to CPUs 1-3:
[ 406.158579][ C2] NMI backtrace for cpu 2 skipped: idling at
default_idle+0xe/0x10
[ 406.158601][ C1] NMI backtrace for cpu 1 skipped: idling at
default_idle+0xe/0x10
[ 406.159131][ C3] NMI backtrace for cpu 3
[ 406.159144][ C3] CPU: 3 PID: 8514 Comm: rs:main Q:Reg Not
tainted 5.12.0-rc5-next-20210330 #113
[ 406.159156][ C3] Hardware name: QEMU Standard PC (Q35 + ICH9,
2009), BIOS rel-1.13.0-44-g88ab0c15525c-prebuilt.qemu.org 04/01/2014
[ 406.159169][ C3] RIP: 0010:__sanitizer_cov_trace_pc+0x7/0x60
[.159182]
0 00 4d CMeossdagee :fr omf sfy ffsl ogbd@9sy zkfalfle r ff fatf A prf
2f1 1b2:a2 2:08 0170 . ..0
8b 03 48 k er0nefl: [ b 4d06 .1ca 459961 3]8[ bT1 6541]5 K 00 er4ne8l
pa6ni3c - cno9 e9t sy6nc4in g:f hfun g_ff ftafsk : 0blfoc ke1d fta
40 sk0s0 65 8b 0
8e 7e <89> c1 48 8b 34 24 81 e1 00 01 00 00 65 48 8b 14 25 00 f0 01 00 a9
[ 406.159200][ C3] RSP: 0018:ffffc90001467848 EFLAGS: 00000246
[ 406.159214][ C3] RAX: 0000000080000000 RBX: 000000000000000e
RCX: 0000000000000000
[ 406.159225][ C3] RDX: 0000000000000000 RSI: ffff888012a8c700
RDI: 0000000000000003
[ 406.159235][ C3] RBP: 0000000000000000 R08: 0000000000000000
R09: 0000000000000000
[ 406.159244][ C3] R10: ffffffff8197f862 R11: 0000000000000000
R12: ffffea00008fc840
[ 406.159255][ C3] R13: dffffc0000000000 R14: 0000000000000000
R15: ffffea00008fc840
[ 406.159265][ C3] FS: 00007f98afbad700(0000)
GS:ffff88802d180000(0000) knlGS:0000000000000000
[ 406.159275][ C3] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 406.159284][ C3] CR2: ffffffffff600400 CR3: 0000000014c6d000
CR4: 0000000000750ee0
[ 406.159294][ C3] DR0: 0000000000000000 DR1: 0000000000000000
DR2: 0000000000000000
[ 406.159304][ C3] DR3: 0000000000000000 DR6: 00000000fffe0ff0
DR7: 0000000000000400
[ 406.159312][ C3] PKRU: 55555554
[ 406.159317][ C3] Call Trace:
[ 406.159322][ C3] pagecache_get_page+0xa0c/0x18d0
[ 406.159329][ C3] ? add_to_page_cache_lru+0x5b0/0x5b0
[ 406.159337][ C3] grab_cache_page_write_begin+0x64/0x90
[ 406.159344][ C3] ext4_da_write_begin+0x35c/0x1160
[ 406.159351][ C3] ? ktime_get_coarse_real_ts64+0x1b7/0x200
[ 406.159359][ C3] ? __sanitizer_cov_trace_const_cmp8+0x1d/0x70
[ 406.159366][ C3] ? ext4_write_begin+0x14b0/0x14b0
[ 406.159373][ C3] ? copyout_mc+0x110/0x110
[ 406.159380][ C3] ? __sanitizer_cov_trace_const_cmp4+0x1c/0x70
[ 406.159387][ C3] ? current_time+0x220/0x2c0
[ 406.159393][ C3] generic_perform_write+0x20a/0x4f0
[ 406.159400][ C3] ? generic_file_readonly_mmap+0x1b0/0x1b0
[ 406.159408][ C3] ? down_write_killable+0x170/0x170
[ 406.159415][ C3] ext4_buffered_write_iter+0x244/0x4d0
[ 406.159422][ C3] ext4_file_write_iter+0x423/0x14e0
[ 406.159429][ C3] ? ext4_buffered_write_iter+0x4d0/0x4d0
[ 406.159437][ C3] ? lockdep_hardirqs_on_prepare+0x400/0x400
[ 406.159444][ C3] ? __sanitizer_cov_trace_const_cmp4+0x1c/0x70
[ 406.159452][ C3] new_sync_write+0x426/0x650
[ 406.159458][ C3] ? new_sync_read+0x6e0/0x6e0
[ 406.159464][ C3] ? lock_release+0x720/0x720
[ 406.159470][ C3] vfs_write+0x796/0xa30
[ 406.159476][ C3] ksys_write+0x12d/0x250
[ 406.159482][ C3] ? __ia32_sys_read+0xb0/0xb0
[ 406.159489][ C3] ? syscall_enter_from_user_mode+0x27/0x70
[ 406.159496][ C3] do_syscall_64+0x2d/0x70
[ 406.159502][ C3] entry_SYSCALL_64_after_hwframe+0x44/0xae
[ 406.159509][ C3] RIP: 0033:0x7f98b160b19d
[ 406.159521][ C3] Code: d1 20 00 00 75 10 b8 01 00 00 00 0f 05 48
3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 be fa ff ff 48 89 04 24 b8 01
00 00 00 0f 05 <48> 8b 3c 241
[ 406.159539][ C3] RSP: 002b:00007f98afbac000 EFLAGS: 00000293
ORIG_RAX: 0000000000000001
[ 406.159555][ C3] RAX: ffffffffffffffda RBX: 0000000000000335
RCX: 00007f98b160b19d
[ 406.159565][ C3] RDX: 0000000000000335 RSI: 0000000001385a90
RDI: 0000000000000005
[ 406.159575][ C3] RBP: 0000000001385a90 R08: 0000000001385db5
R09: 00007f98b0f88547
[ 406.159585][ C3] R10: 0000000000000000 R11: 0000000000000293
R12: 0000000000000000
[ 406.159595][ C3] R13: 00007f98afbac480 R14: 0000000000000013
R15: 0000000001385870
[ 406.159613][ T1651] Kernel panic - not syncing: hung_task: blocked tasks
[ 406.211961][ T1651] CPU: 0 PID: 1651 Comm: khungtaskd Not tainted
5.12.0-rc5-next-20210330 #113
[ 406.213144][ T1651] Hardware name: QEMU Standard PC (Q35 + ICH9,
2009), BIOS rel-1.13.0-44-g88ab0c15525c-prebuilt.qemu.org 04/01/2014
[ 406.214758][ T1651] Call Trace:
[ 406.215259][ T1651] dump_stack+0x141/0x1d7
[ 406.215844][ T1651] panic+0x306/0x73d
[ 406.216373][ T1651] ? __warn_printk+0xf3/0xf3
[ 406.216994][ T1651] ? cpumask_next+0x3c/0x40
[ 406.217603][ T1651] ? __sanitizer_cov_trace_cmp4+0x1c/0x70
[ 406.218370][ T1651] ? printk_safe_flush+0xea/0x160
[ 406.219056][ T1651] ? watchdog.cold+0x22d/0x248
[ 406.219704][ T1651] watchdog.cold+0x23e/0x248
[ 406.220345][ T1651] ? trace_sched_process_hang+0x280/0x280
[ 406.221121][ T1651] kthread+0x3b1/0x4a0
[ 406.221679][ T1651] ? __kthread_bind_mask+0xc0/0xc0
[ 406.222375][ T1651] ret_from_fork+0x1f/0x30
[ 406.224241][ T1651] Kernel Offset: disabled
[ 406.224783][ T1651] Rebooting in 86400 seconds..