Re: [Syzkaller & bisect] There is BUG: soft lockup in __cleanup_mnt in v6.3-rc1 kernel

From: Pengfei Xu
Date: Mon Mar 13 2023 - 22:14:40 EST

Next message: Baolu Lu: "Re: [PATCH v6 4/7] iommu/sva: Stop using ioasid_set for SVA"
Previous message: Wei Fang: "RE: [PATCH] net: Use of_property_read_bool() for boolean properties"
In reply to: Darrick J. Wong: "Re: [Syzkaller & bisect] There is BUG: soft lockup in __cleanup_mnt in v6.3-rc1 kernel"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

Hi Darrick,

On 2023-03-13 at 18:45:43 -0700, Darrick J. Wong wrote:
> On Sun, Mar 12, 2023 at 11:21:04AM +0800, Pengfei Xu wrote:
> > Hi Dave Chinner and kernel expert,
> >
> > Greeting!
>
> <cough> Please cc the xfs list with xfs bug reports.
>
Ah, will send the xfs issue to xfs list next time.

> Have you tried 6.3-rc2?
>
I tried v6.3-rc2 kernel, this issue could be reproduced in v6.3-rc2.
Dmesg is in attached.
"
[ 339.367548] XFS (loop0): Corruption of in-memory data (0x8) detected at _xfs_buf_ioapply+0x67d/0x690 (fs/xfs/xfs_buf.c:1553). Shutting down filesystem.
[ 339.368164] XFS (loop0): Please unmount the filesystem and rectify the problem(s)
[ 364.436316] watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [repro:405]
[ 364.436724] Modules linked in:
[ 364.436868] irq event stamp: 21510
[ 364.437026] hardirqs last enabled at (21509): [<ffffffff8300187e>] irqentry_exit+0x3e/0xa0
[ 364.437406] hardirqs last disabled at (21510): [<ffffffff82fff863>] sysvec_apic_timer_interrupt+0x13/0xe0
[ 364.437826] softirqs last enabled at (8970): [<ffffffff83024a4c>] __do_softirq+0x31c/0x49c
[ 364.438195] softirqs last disabled at (8897): [<ffffffff8112b5a4>] irq_exit_rcu+0xc4/0x100
[ 364.438564] CPU: 0 PID: 405 Comm: repro Not tainted 6.3.0-rc2-eeac8ede1755+ #1
[ 364.438885] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
[ 364.439382] RIP: 0010:rcu_lockdep_current_cpu_online+0x5b/0x90
[ 364.439657] Code: 5b 41 5c 5d c3 cc cc cc cc 65 ff 05 d7 bb e1 7e e8 fa 94 de 01 48 c7 c3 80 61 03 00 89 c0 48 03 1c c5 00 7b cb 83 48 8b 43 18 <48> 8b 40 70 48 84
[ 364.440449] RSP: 0018:ffffc90000eb3ba8 EFLAGS: 00000282
[ 364.440689] RAX: ffffffff83f64340 RBX: ffff88807dc36180 RCX: 0000000000000000
[ 364.441003] RDX: 0000000000000000 RSI: 0000000000000003 RDI: 0000000000000000
[ 364.441313] RBP: ffffc90000eb3bb8 R08: 0000000000000001 R09: 0000000000000000
[ 364.441626] R10: ffff88800f7e30d8 R11: 0000000000000000 R12: 0000000000000001
[ 364.441938] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 364.442248] FS: 00007f9db4acf740(0000) GS:ffff88807dc00000(0000) knlGS:0000000000000000
[ 364.442597] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 364.442852] CR2: 00007f5e8f6f5518 CR3: 000000000f6da004 CR4: 0000000000770ef0
[ 364.443169] PKRU: 55555554
[ 364.443297] Call Trace:
[ 364.443412] <TASK>
[ 364.443519] rcu_read_lock_held_common+0x33/0x50
[ 364.443741] rcu_read_lock_sched_held+0x29/0x80
[ 364.443956] lock_acquire+0x2ad/0x320
[ 364.444133] ? lock_release+0x141/0x2e0
[ 364.444313] ? write_comp_data+0x2f/0x90
[ 364.444507] _raw_spin_lock+0x36/0x50
[ 364.444681] ? xfs_ail_push_all_sync+0x73/0x110
[ 364.444893] xfs_ail_push_all_sync+0x73/0x110
[ 364.445097] ? __pfx_autoremove_wake_function+0x10/0x10
[ 364.445343] xfs_reclaim_inodes+0xb8/0x140
[ 364.445543] xfs_unmount_flush_inodes+0x63/0x80
[ 364.445757] xfs_unmountfs+0x69/0x1f0
[ 364.445939] xfs_fs_put_super+0x5a/0x120
[ 364.446130] ? __pfx_xfs_fs_put_super+0x10/0x10
[ 364.446356] generic_shutdown_super+0xac/0x240
[ 364.446573] kill_block_super+0x43/0x80
[ 364.446759] deactivate_locked_super+0x52/0xb0
[ 364.446966] deactivate_super+0xb3/0xd0
[ 364.447156] cleanup_mnt+0x15e/0x1e0
[ 364.447335] __cleanup_mnt+0x1f/0x30
[ 364.447513] task_work_run+0xb6/0x120
[ 364.447736] exit_to_user_mode_prepare+0x200/0x210
[ 364.448017] syscall_exit_to_user_mode+0x2d/0x60
[ 364.448293] do_syscall_64+0x4a/0x90
[ 364.448513] entry_SYSCALL_64_after_hwframe+0x72/0xdc
[ 364.448809] RIP: 0033:0x7f9db4bfb7db
[ 364.449033] Code: 96 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa 31 f6 e9 05 00 00 00 0f 1f 44 00 00 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff f8
[ 364.449954] RSP: 002b:00007fff5b16db78 EFLAGS: 00000206 ORIG_RAX: 00000000000000a6
[ 364.450376] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007f9db4bfb7db
[ 364.450745] RDX: 0000000000000000 RSI: 000000000000000a RDI: 00007fff5b16dc20
[ 364.451108] RBP: 00007fff5b16ec60 R08: 0000000001e88333 R09: 0000000000000009
[ 364.451484] R10: 0000000000404071 R11: 0000000000000206 R12: 00000000004012c0
[ 364.451847] R13: 00007fff5b16eda0 R14: 0000000000000000 R15: 0000000000000000
[ 364.452195] </TASK>
[ 364.452301] Kernel panic - not syncing: softlockup: hung tasks
[ 364.452562] CPU: 0 PID: 405 Comm: repro Tainted: G L 6.3.0-rc2-eeac8ede1755+ #1
[ 364.453010] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
[ 364.453551] Call Trace:
[ 364.453701] <IRQ>
[ 364.453826] dump_stack_lvl+0xa9/0x110
[ 364.454057] dump_stack+0x19/0x20
[ 364.454262] panic+0x4fd/0x520
[ 364.454455] ? watchdog_timer_fn+0x31e/0x390
[ 364.454689] watchdog_timer_fn+0x337/0x390
[ 364.454886] ? __pfx_watchdog_timer_fn+0x10/0x10
[ 364.455101] __hrtimer_run_queues+0x2ed/0x820
[ 364.455355] hrtimer_interrupt+0x134/0x2d0
[ 364.455604] __sysvec_apic_timer_interrupt+0x9c/0x290
[ 364.455902] sysvec_apic_timer_interrupt+0xab/0xe0
[ 364.456185] </IRQ>
[ 364.456314] <TASK>
[ 364.456441] asm_sysvec_apic_timer_interrupt+0x1f/0x30
[ 364.456742] RIP: 0010:rcu_lockdep_current_cpu_online+0x5b/0x90
[ 364.457067] Code: 5b 41 5c 5d c3 cc cc cc cc 65 ff 05 d7 bb e1 7e e8 fa 94 de 01 48 c7 c3 80 61 03 00 89 c0 48 03 1c c5 00 7b cb 83 48 8b 43 18 <48> 8b 40 70 48 84
[ 364.457937] RSP: 0018:ffffc90000eb3ba8 EFLAGS: 00000282
[ 364.458211] RAX: ffffffff83f64340 RBX: ffff88807dc36180 RCX: 0000000000000000
[ 364.458613] RDX: 0000000000000000 RSI: 0000000000000003 RDI: 0000000000000000
[ 364.459006] RBP: ffffc90000eb3bb8 R08: 0000000000000001 R09: 0000000000000000
[ 364.459418] R10: ffff88800f7e30d8 R11: 0000000000000000 R12: 0000000000000001
[ 364.459813] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 364.460213] ? rcu_lockdep_current_cpu_online+0x46/0x90
[ 364.460465] rcu_read_lock_held_common+0x33/0x50
[ 364.460743] rcu_read_lock_sched_held+0x29/0x80
[ 364.460980] lock_acquire+0x2ad/0x320
[ 364.461170] ? lock_release+0x141/0x2e0
[ 364.461391] ? write_comp_data+0x2f/0x90
[ 364.461590] _raw_spin_lock+0x36/0x50
[ 364.461804] ? xfs_ail_push_all_sync+0x73/0x110
[ 364.462018] xfs_ail_push_all_sync+0x73/0x110
[ 364.462228] ? __pfx_autoremove_wake_function+0x10/0x10
[ 364.462479] xfs_reclaim_inodes+0xb8/0x140
[ 364.462682] xfs_unmount_flush_inodes+0x63/0x80
[ 364.462933] xfs_unmountfs+0x69/0x1f0
[ 364.463112] xfs_fs_put_super+0x5a/0x120
[ 364.463304] ? __pfx_xfs_fs_put_super+0x10/0x10
[ 364.463522] generic_shutdown_super+0xac/0x240
[ 364.463741] kill_block_super+0x43/0x80
[ 364.463930] deactivate_locked_super+0x52/0xb0
[ 364.464154] deactivate_super+0xb3/0xd0
[ 364.464348] cleanup_mnt+0x15e/0x1e0
[ 364.464564] __cleanup_mnt+0x1f/0x30
[ 364.464787] task_work_run+0xb6/0x120
[ 364.465002] exit_to_user_mode_prepare+0x200/0x210
[ 364.465226] syscall_exit_to_user_mode+0x2d/0x60
[ 364.465449] do_syscall_64+0x4a/0x90
[ 364.465621] entry_SYSCALL_64_after_hwframe+0x72/0xdc
[ 364.465861] RIP: 0033:0x7f9db4bfb7db
[ 364.466065] Code: 96 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa 31 f6 e9 05 00 00 00 0f 1f 44 00 00 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff f8
[ 364.466917] RSP: 002b:00007fff5b16db78 EFLAGS: 00000206 ORIG_RAX: 00000000000000a6
[ 364.467262] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007f9db4bfb7db
[ 364.467582] RDX: 0000000000000000 RSI: 000000000000000a RDI: 00007fff5b16dc20
[ 364.467902] RBP: 00007fff5b16ec60 R08: 0000000001e88333 R09: 0000000000000009
[ 364.468228] R10: 0000000000404071 R11: 0000000000000206 R12: 00000000004012c0
[ 364.468605] R13: 00007fff5b16eda0 R14: 0000000000000000 R15: 0000000000000000
[ 364.468992] </TASK>
[ 364.469185] Kernel Offset: disabled
[ 364.469398] ---[ end Kernel panic - not syncing: softlockup: hung tasks ]---
"

Thanks!
BR.

> --D
>
> > Platform: x86 platforms
> >
> > There is BUG: soft lockup in __cleanup_mnt in v6.3-rc1 kernel.
> > All detailed info: https://github.com/xupengfe/syzkaller_logs/tree/main/230311_022102___cleanup_mnt
> > Reproduced code: https://github.com/xupengfe/syzkaller_logs/blob/main/230311_022102___cleanup_mnt/repro.c
> > v6.3-rc1 issue dmesg: https://github.com/xupengfe/syzkaller_logs/blob/main/230311_022102___cleanup_mnt/fe15c26ee26efa11741a7b632e9f23b01aca4cc6_dmesg.log
> > Kconfig: https://github.com/xupengfe/syzkaller_logs/blob/main/230311_022102___cleanup_mnt/kconfig_origin
> > Bisect info: https://github.com/xupengfe/syzkaller_logs/blob/main/230311_022102___cleanup_mnt/bisect_info.log
> >
> > "
> > [ 28.803497] XFS (loop0): Corruption of in-memory data (0x8) detected at _xfs_buf_ioapply+0x67d/0x690 (fs/xfs/xfs_buf.c:1553). Shutting down filesystem.
> > [ 28.804766] XFS (loop0): Please unmount the filesystem and rectify the problem(s)
> > [ 56.372468] watchdog: BUG: soft lockup - CPU#1 stuck for 26s! [repro:523]
> > [ 56.372847] Modules linked in:
> > [ 56.372985] irq event stamp: 22822
> > [ 56.373141] hardirqs last enabled at (22821): [<ffffffff8300086e>] irqentry_exit+0x3e/0xa0
> > [ 56.373512] hardirqs last disabled at (22822): [<ffffffff82ffe853>] sysvec_apic_timer_interrupt+0x13/0xe0
> > [ 56.373923] softirqs last enabled at (9032): [<ffffffff83023a3c>] __do_softirq+0x31c/0x49c
> > [ 56.374276] softirqs last disabled at (8975): [<ffffffff8112b5a4>] irq_exit_rcu+0xc4/0x100
> > [ 56.374623] CPU: 1 PID: 523 Comm: repro Not tainted 6.3.0-rc1-fe15c26ee26e+ #1
> > [ 56.374924] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
> > [ 56.375386] RIP: 0010:rcu_read_lock_sched_held+0x4b/0x80
> > [ 56.375621] Code: 8d 7d f7 e8 c7 fe ff ff 84 c0 74 19 0f b6 45 f7 48 8b 4d f8 65 48 33 0c 25 28 00 00 00 75 38 c9 c3 cc cc cc cc be ff ff ff ff <48> c7 c7 20 3e f6 83 e8 89 ec de 01 89 c2 b8 01 00 00 00 85 d2 75
> > [ 56.376376] RSP: 0018:ffffc9000102fbe0 EFLAGS: 00000246
> > [ 56.376597] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
> > [ 56.376891] RDX: 0000000000000000 RSI: 00000000ffffffff RDI: 0000000000000000
> > [ 56.377192] RBP: ffffc9000102fbf0 R08: 0000000000000001 R09: 0000000000000000
> > [ 56.377486] R10: ffff88800d01d418 R11: 0000000000000000 R12: ffff88800b0d1158
> > [ 56.377780] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
> > [ 56.378082] FS: 00007fc887d10740(0000) GS:ffff88807dd00000(0000) knlGS:0000000000000000
> > [ 56.378414] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [ 56.378655] CR2: 00007faaae519018 CR3: 000000000d3e2004 CR4: 0000000000770ee0
> > [ 56.378950] PKRU: 55555554
> > [ 56.379069] Call Trace:
> > [ 56.379178] <TASK>
> > [ 56.379276] lock_acquire+0x2ad/0x320
> > [ 56.379444] ? lock_release+0x141/0x2e0
> > [ 56.379615] ? write_comp_data+0x2f/0x90
> > [ 56.379799] _raw_spin_lock+0x36/0x50
> > [ 56.379962] ? xfs_ail_push_all_sync+0x73/0x110
> > [ 56.380169] xfs_ail_push_all_sync+0x73/0x110
> > [ 56.380360] ? __pfx_autoremove_wake_function+0x10/0x10
> > [ 56.380591] xfs_reclaim_inodes+0xb8/0x140
> > [ 56.380779] xfs_unmount_flush_inodes+0x63/0x80
> > [ 56.380987] xfs_unmountfs+0x69/0x1f0
> > [ 56.381152] xfs_fs_put_super+0x5a/0x120
> > [ 56.381331] ? __pfx_xfs_fs_put_super+0x10/0x10
> > [ 56.381534] generic_shutdown_super+0xac/0x240
> > [ 56.381740] kill_block_super+0x43/0x80
> > [ 56.381917] deactivate_locked_super+0x52/0xb0
> > [ 56.382112] deactivate_super+0xb3/0xd0
> > [ 56.382282] cleanup_mnt+0x15e/0x1e0
> > [ 56.382451] __cleanup_mnt+0x1f/0x30
> > [ 56.382613] task_work_run+0xb6/0x120
> > [ 56.382783] exit_to_user_mode_prepare+0x200/0x210
> > [ 56.383000] syscall_exit_to_user_mode+0x2d/0x60
> > [ 56.383205] do_syscall_64+0x4a/0x90
> > [ 56.383368] entry_SYSCALL_64_after_hwframe+0x72/0xdc
> > [ 56.383593] RIP: 0033:0x7fc887e3c7db
> > [ 56.383751] Code: 96 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa 31 f6 e9 05 00 00 00 0f 1f 44 00 00 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 95 96 0c 00 f7 d8 64 89 01 48
> > [ 56.384500] RSP: 002b:00007ffc1a5bd1e8 EFLAGS: 00000206 ORIG_RAX: 00000000000000a6
> > [ 56.384815] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007fc887e3c7db
> > [ 56.385114] RDX: 0000000000000000 RSI: 000000000000000a RDI: 00007ffc1a5bd290
> > [ 56.385407] RBP: 00007ffc1a5be2d0 R08: 0000000001d0a333 R09: 0000000000000009
> > [ 56.385700] R10: 0000000000404071 R11: 0000000000000206 R12: 00000000004012c0
> > [ 56.385994] R13: 00007ffc1a5be410 R14: 0000000000000000 R15: 0000000000000000
> > [ 56.386299] </TASK>
> > [ 56.386400] Kernel panic - not syncing: softlockup: hung tasks
> > [ 56.386643] CPU: 1 PID: 523 Comm: repro Tainted: G L 6.3.0-rc1-fe15c26ee26e+ #1
> > [ 56.387000] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
> > [ 56.387461] Call Trace:
> > [ 56.387569] <IRQ>
> > [ 56.387662] dump_stack_lvl+0xa9/0x110
> > [ 56.387834] dump_stack+0x19/0x20
> > [ 56.387980] panic+0x4fd/0x520
> > [ 56.388119] ? watchdog_timer_fn+0x31e/0x390
> > [ 56.388315] watchdog_timer_fn+0x337/0x390
> > [ 56.388497] ? __pfx_watchdog_timer_fn+0x10/0x10
> > [ 56.388710] __hrtimer_run_queues+0x2ed/0x820
> > [ 56.388924] hrtimer_interrupt+0x134/0x2d0
> > [ 56.389111] __sysvec_apic_timer_interrupt+0x9c/0x290
> > [ 56.389331] sysvec_apic_timer_interrupt+0xab/0xe0
> > [ 56.389535] </IRQ>
> > [ 56.389628] <TASK>
> > [ 56.389722] asm_sysvec_apic_timer_interrupt+0x1f/0x30
> > [ 56.389940] RIP: 0010:rcu_read_lock_sched_held+0x4b/0x80
> > [ 56.390166] Code: 8d 7d f7 e8 c7 fe ff ff 84 c0 74 19 0f b6 45 f7 48 8b 4d f8 65 48 33 0c 25 28 00 00 00 75 38 c9 c3 cc cc cc cc be ff ff ff ff <48> c7 c7 20 3e f6 83 e8 89 ec de 01 89 c2 b8 01 00 00 00 85 d2 75
> > [ 56.390909] RSP: 0018:ffffc9000102fbe0 EFLAGS: 00000246
> > [ 56.391129] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
> > [ 56.391422] RDX: 0000000000000000 RSI: 00000000ffffffff RDI: 0000000000000000
> > [ 56.391715] RBP: ffffc9000102fbf0 R08: 0000000000000001 R09: 0000000000000000
> > [ 56.392009] R10: ffff88800d01d418 R11: 0000000000000000 R12: ffff88800b0d1158
> > [ 56.392303] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
> > [ 56.392607] lock_acquire+0x2ad/0x320
> > [ 56.392773] ? lock_release+0x141/0x2e0
> > [ 56.392941] ? write_comp_data+0x2f/0x90
> > [ 56.393122] _raw_spin_lock+0x36/0x50
> > [ 56.393285] ? xfs_ail_push_all_sync+0x73/0x110
> > [ 56.393483] xfs_ail_push_all_sync+0x73/0x110
> > [ 56.393672] ? __pfx_autoremove_wake_function+0x10/0x10
> > [ 56.393900] xfs_reclaim_inodes+0xb8/0x140
> > [ 56.394087] xfs_unmount_flush_inodes+0x63/0x80
> > [ 56.394285] xfs_unmountfs+0x69/0x1f0
> > [ 56.394450] xfs_fs_put_super+0x5a/0x120
> > [ 56.394627] ? __pfx_xfs_fs_put_super+0x10/0x10
> > [ 56.394829] generic_shutdown_super+0xac/0x240
> > [ 56.395030] kill_block_super+0x43/0x80
> > [ 56.395207] deactivate_locked_super+0x52/0xb0
> > [ 56.395403] deactivate_super+0xb3/0xd0
> > [ 56.395574] cleanup_mnt+0x15e/0x1e0
> > [ 56.395739] __cleanup_mnt+0x1f/0x30
> > [ 56.395902] task_work_run+0xb6/0x120
> > [ 56.396071] exit_to_user_mode_prepare+0x200/0x210
> > [ 56.396282] syscall_exit_to_user_mode+0x2d/0x60
> > [ 56.396487] do_syscall_64+0x4a/0x90
> > [ 56.396648] entry_SYSCALL_64_after_hwframe+0x72/0xdc
> > [ 56.396865] RIP: 0033:0x7fc887e3c7db
> > [ 56.397020] Code: 96 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa 31 f6 e9 05 00 00 00 0f 1f 44 00 00 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 95 96 0c 00 f7 d8 64 89 01 48
> > [ 56.397761] RSP: 002b:00007ffc1a5bd1e8 EFLAGS: 00000206 ORIG_RAX: 00000000000000a6
> > [ 56.398072] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007fc887e3c7db
> > [ 56.398365] RDX: 0000000000000000 RSI: 000000000000000a RDI: 00007ffc1a5bd290
> > [ 56.398658] RBP: 00007ffc1a5be2d0 R08: 0000000001d0a333 R09: 0000000000000009
> > [ 56.398951] R10: 0000000000404071 R11: 0000000000000206 R12: 00000000004012c0
> > [ 56.399244] R13: 00007ffc1a5be410 R14: 0000000000000000 R15: 0000000000000000
> > [ 56.399546] </TASK>
> > [ 56.399792] Kernel Offset: disabled
> > [ 56.399972] ---[ end Kernel panic - not syncing: softlockup: hung tasks ]---
> > "
> >
> > I used the key word "__cleanup_mnt" to bisect, I knew there was other BUG
> > info in dmesg with "bisect good" commit log.
> >
> > Anyway, just provided the bad commit and hope it's helpful:
> > "
> > bd4f5d09cc93c8ca51e4efea86ac90a4bb553d6e
> > xfs: refactor the filestreams allocator pick functions
> > "
> > It's just a suspected commit, reverted above commit on top of v6.3-rc1 and
> > no "__cleanup_mnt" related BUG but generated the other BUG info in dmesg.
> >
> > There was no this issue report yet in syzbot:
> > https://syzkaller.appspot.com/upstream
> >
> > I tried that, installed the xfs fixed patch for below issue on top of v6.3-rc1:
> > https://lore.kernel.org/lkml/20230226223403.GU360264@xxxxxxxxxxxxxxxxxxx/
> > "__cleanup_mnt" BUG issue still existed.
> > Related dmesg: https://github.com/xupengfe/syzkaller_logs/blob/main/230311_022102___cleanup_mnt/v6.3-rc1_xfs_patch_another_cleanup_mnt_issue.log
> > So it should be different than previous xfs related issue.
> >
c[?7l[2J[0mSeaBIOS (version rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org)

iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+7FF91000+7FEF1000 CA00
Press Ctrl-B to configure iPXE (PCI 00:03.0)...

Booting from ROM..c[?7l[2J[ 0.000000] Linux version 6.3.0-rc2-eeac8ede1755+ (root@p-adls01) (gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-18), GNU ld version 2.36.1-2.el8) #1 SMP PREEMPT_DYNAMIC Mon Mar 13 19:17:17 CST 2023
[ 0.000000] Command line: console=ttyS0 root=/dev/sda earlyprintk=serial net.ifnames=0 thunderbolt.dyndbg
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Hygon HygonGenuine
[ 0.000000] Centaur CentaurHauls
[ 0.000000] zhaoxin Shanghai
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: xstate_offset[9]: 832, xstate_sizes[9]: 8
[ 0.000000] x86/fpu: Enabled xstate features 0x207, context size is 840 bytes, using 'compacted' format.
[ 0.000000] signal: max sigframe size: 3632
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffdffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007ffe0000-0x000000007fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[ 0.000000] printk: bootconsole [earlyser0] enabled
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.8 present.
[ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
[ 0.000000] Hypervisor detected: KVM
[ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[ 0.000003] kvm-clock: using sched offset of 482927573 cycles
[ 0.000452] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[ 0.001814] tsc: Detected 3609.600 MHz processor
[ 0.004000] last_pfn = 0x7ffe0 max_arch_pfn = 0x400000000
[ 0.004000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.004000] found SMP MP-table at [mem 0x000f5ba0-0x000f5baf]
[ 0.004000] Using GB pages for direct mapping
[ 0.004000] ACPI: Early table checksum verification disabled
[ 0.004000] ACPI: RSDP 0x00000000000F59C0 000014 (v00 BOCHS )
[ 0.004000] ACPI: RSDT 0x000000007FFE1951 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.004000] ACPI: FACP 0x000000007FFE17FD 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.004000] ACPI: DSDT 0x000000007FFE0040 0017BD (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.004000] ACPI: FACS 0x000000007FFE0000 000040
[ 0.004000] ACPI: APIC 0x000000007FFE1871 000080 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.004000] ACPI: HPET 0x000000007FFE18F1 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.004000] ACPI: WAET 0x000000007FFE1929 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.004000] ACPI: Reserving FACP table memory at [mem 0x7ffe17fd-0x7ffe1870]
[ 0.004000] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe17fc]
[ 0.004000] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f]
[ 0.004000] ACPI: Reserving APIC table memory at [mem 0x7ffe1871-0x7ffe18f0]
[ 0.004000] ACPI: Reserving HPET table memory at [mem 0x7ffe18f1-0x7ffe1928]
[ 0.004000] ACPI: Reserving WAET table memory at [mem 0x7ffe1929-0x7ffe1950]
[ 0.004000] No NUMA configuration found
[ 0.004000] Faking a node at [mem 0x0000000000000000-0x000000007ffdffff]
[ 0.004000] NODE_DATA(0) allocated [mem 0x7ffb5000-0x7ffdffff]
[ 0.004000] Zone ranges:
[ 0.004000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.004000] DMA32 [mem 0x0000000001000000-0x000000007ffdffff]
[ 0.004000] Normal empty
[ 0.004000] Device empty
[ 0.004000] Movable zone start for each node
[ 0.004000] Early memory node ranges
[ 0.004000] node 0: [mem 0x0000000000001000-0x000000000009efff]
[ 0.004000] node 0: [mem 0x0000000000100000-0x000000007ffdffff]
[ 0.004000] Initmem setup node 0 [mem 0x0000000000001000-0x000000007ffdffff]
[ 0.004000] On node 0, zone DMA: 1 pages in unavailable ranges
[ 0.004000] On node 0, zone DMA: 97 pages in unavailable ranges
[ 0.004000] On node 0, zone DMA32: 32 pages in unavailable ranges
[ 0.004000] ACPI: PM-Timer IO Port: 0x608
[ 0.004000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[ 0.004000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[ 0.004000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.004000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[ 0.004000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.004000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[ 0.004000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[ 0.004000] ACPI: Using ACPI (MADT) for SMP configuration information
[ 0.004000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[ 0.004000] TSC deadline timer available
[ 0.004000] smpboot: Allowing 2 CPUs, 0 hotplug CPUs
[ 0.004000] kvm-guest: KVM setup pv remote TLB flush
[ 0.004000] kvm-guest: setup PV sched yield
[ 0.004000] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.004000] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[ 0.004000] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff]
[ 0.004000] PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff]
[ 0.004000] [mem 0x80000000-0xfeffbfff] available for PCI devices
[ 0.004000] Booting paravirtualized kernel on KVM
[ 0.004000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.004000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:2 nr_cpu_ids:2 nr_node_ids:1
[ 0.004000] percpu: Embedded 65 pages/cpu s229376 r8192 d28672 u1048576
[ 0.004000] kvm-guest: PV spinlocks enabled
[ 0.004000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 0.004000] Fallback order for Node 0: 0
[ 0.004000] Built 1 zonelists, mobility grouping on. Total pages: 515808
[ 0.004000] Policy zone: DMA32
[ 0.004000] Kernel command line: net.ifnames=0 console=ttyS0 root=/dev/sda earlyprintk=serial net.ifnames=0 thunderbolt.dyndbg
[ 0.004000] random: crng init done
[ 0.004000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[ 0.004000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[ 0.004000] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 0.004000] Memory: 1964888K/2096632K available (36864K kernel code, 4578K rwdata, 9848K rodata, 10508K init, 31780K bss, 131488K reserved, 0K cma-reserved)
[ 0.004000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[ 0.004000] kmemleak: Kernel memory leak detector disabled
[ 0.004000] ftrace: allocating 68737 entries in 269 pages
[ 0.004000] ftrace: allocated 269 pages with 4 groups
[ 0.004000] Dynamic Preempt: voluntary
[ 0.004000] Running RCU self tests
[ 0.004000] Running RCU synchronous self tests
[ 0.004000] rcu: Preemptible hierarchical RCU implementation.
[ 0.004000] rcu: RCU lockdep checking is enabled.
[ 0.004000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=2.
[ 0.004000] Trampoline variant of Tasks RCU enabled.
[ 0.004000] Rude variant of Tasks RCU enabled.
[ 0.004000] Tracing variant of Tasks RCU enabled.
[ 0.004000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[ 0.004000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[ 0.004000] Running RCU synchronous self tests
[ 0.004000] NR_IRQS: 524544, nr_irqs: 440, preallocated irqs: 16
[ 0.004000] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[ 0.004000] Console: colour VGA+ 80x25
[ 0.004000] printk: console [ttyS0] enabled
[ 0.004000] printk: console [ttyS0] enabled
[ 0.004000] printk: bootconsole [earlyser0] disabled
[ 0.004000] printk: bootconsole [earlyser0] disabled
[ 0.004000] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
[ 0.004000] ... MAX_LOCKDEP_SUBCLASSES: 8
[ 0.004000] ... MAX_LOCK_DEPTH: 48
[ 0.004000] ... MAX_LOCKDEP_KEYS: 8192
[ 0.004000] ... CLASSHASH_SIZE: 4096
[ 0.004000] ... MAX_LOCKDEP_ENTRIES: 32768
[ 0.004000] ... MAX_LOCKDEP_CHAINS: 65536
[ 0.004000] ... CHAINHASH_SIZE: 32768
[ 0.004000] memory used by lock dependency info: 6365 kB
[ 0.004000] memory used for stack traces: 4224 kB
[ 0.004000] per task-struct memory footprint: 1920 bytes
[ 0.004000] ACPI: Core revision 20221020
[ 0.004000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[ 0.004000] APIC: Switch to symmetric I/O mode setup
[ 0.004000] x2apic enabled
[ 0.004000] Switched APIC routing to physical x2apic.
[ 0.004000] kvm-guest: setup PV IPIs
[ 0.004000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.004000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3407c077a8d, max_idle_ns: 440795342283 ns
[ 0.192321] Calibrating delay loop (skipped) preset value.. 7219.20 BogoMIPS (lpj=14438400)
[ 0.193054] pid_max: default: 32768 minimum: 301
[ 0.193518] LSM: initializing lsm=capability,yama,integrity
[ 0.194005] Yama: becoming mindful.
[ 0.194479] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[ 0.195118] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[ 0.198537] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[ 0.199561] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.200061] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[ 0.200379] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[ 0.201093] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!
[ 0.202025] Spectre V2 : Mitigation: Enhanced / Automatic IBRS
[ 0.202501] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[ 0.203168] Spectre V2 : Spectre v2 / PBRSB-eIBRS: Retire a single CALL on VMEXIT
[ 0.203774] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[ 0.204313] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[ 0.310709] Freeing SMP alternatives memory: 56K
[ 0.311300] Running RCU synchronous self tests
[ 0.311751] Running RCU synchronous self tests
[ 0.312688] smpboot: CPU0: 12th Gen Intel(R) Core(TM) i7-12700K (family: 0x6, model: 0x97, stepping: 0x2)
[ 0.314249] cblist_init_generic: Setting adjustable number of callback queues.
[ 0.314987] cblist_init_generic: Setting shift to 1 and lim to 1.
[ 0.315668] cblist_init_generic: Setting shift to 1 and lim to 1.
[ 0.316308] cblist_init_generic: Setting shift to 1 and lim to 1.
[ 0.316380] Running RCU-tasks wait API self tests
[ 0.420613] Performance Events: Alderlake Hybrid events, full-width counters, Intel PMU driver.
[ 0.422632] core: cpu_core PMU driver:
[ 0.423110] ... version: 2
[ 0.423576] ... bit width: 48
[ 0.424043] ... generic registers: 6
[ 0.424322] ... value mask: 0000ffffffffffff
[ 0.424921] ... max period: 00007fffffffffff
[ 0.425520] ... fixed-purpose events: 3
[ 0.425977] ... event mask: 0001000f0000003f
[ 0.426930] rcu: Hierarchical SRCU implementation.
[ 0.427484] rcu: Max phase no-delay instances is 1000.
[ 0.428364] Callback from call_rcu_tasks_trace() invoked.
[ 0.433102] unchecked MSR access error: WRMSR to 0x38f (tried to write 0x0001000f0000003f) at rIP: 0xffffffff810e0c2c (native_write_msr+0xc/0x30)
[ 0.434612] Call Trace:
[ 0.434904] <TASK>
[ 0.435161] __intel_pmu_enable_all.constprop.49+0xb5/0x140
[ 0.435824] intel_pmu_enable_all+0x1e/0x30
[ 0.436308] x86_pmu_enable+0x46d/0x5a0
[ 0.436308] ? write_comp_data+0x2f/0x90
[ 0.436308] perf_pmu_enable+0x53/0x70
[ 0.436308] ctx_resched+0x14d/0x1e0
[ 0.436308] __perf_install_in_context+0x2f7/0x470
[ 0.436308] ? lock_is_held_type+0xe6/0x140
[ 0.436308] ? __pfx_remote_function+0x10/0x10
[ 0.436308] remote_function+0x80/0xa0
[ 0.436308] ? __pfx_remote_function+0x10/0x10
[ 0.436308] generic_exec_single+0x124/0x190
[ 0.436308] smp_call_function_single+0x11c/0x240
[ 0.436308] ? __pfx_remote_function+0x10/0x10
[ 0.436308] ? __sanitizer_cov_trace_pc+0x25/0x60
[ 0.436308] ? write_comp_data+0x2f/0x90
[ 0.436308] perf_install_in_context+0x2d8/0x300
[ 0.436308] ? __pfx___perf_install_in_context+0x10/0x10
[ 0.436308] perf_event_create_kernel_counter+0x284/0x2b0
[ 0.436308] ? __pfx_watchdog_overflow_callback+0x10/0x10
[ 0.436308] hardlockup_detector_event_create+0x46/0xd0
[ 0.436308] hardlockup_detector_perf_init+0x18/0x80
[ 0.436308] watchdog_nmi_probe+0x17/0x20
[ 0.436308] lockup_detector_init+0x40/0xb0
[ 0.436308] kernel_init_freeable+0x37e/0x8c0
[ 0.436308] ? __pfx_kernel_init+0x10/0x10
[ 0.436308] kernel_init+0x24/0x1e0
[ 0.436308] ? __pfx_kernel_init+0x10/0x10
[ 0.436308] ret_from_fork+0x29/0x50
[ 0.436308] </TASK>
[ 0.436679] smp: Bringing up secondary CPUs ...
[ 0.438504] x86: Booting SMP configuration:
[ 0.439019] .... node #0, CPUs: #1
[ 0.439397] smp: Brought up 1 node, 2 CPUs
[ 0.440327] smpboot: Max logical packages: 1
[ 0.440824] smpboot: Total of 2 processors activated (14438.40 BogoMIPS)
[ 0.445947] devtmpfs: initialized
[ 0.445947] x86/mm: Memory block size: 128MB
[ 0.450648] Running RCU synchronous self tests
[ 0.450648] Running RCU synchronous self tests
[ 0.452373] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 0.453522] futex hash table entries: 512 (order: 4, 65536 bytes, linear)
[ 0.454706] pinctrl core: initialized pinctrl subsystem
[ 0.456155]
[ 0.456318] *************************************************************
[ 0.457103] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE **
[ 0.457888] ** **
[ 0.458668] ** IOMMU DebugFS SUPPORT HAS BEEN ENABLED IN THIS KERNEL **
[ 0.459447] ** **
[ 0.460230] ** This means that this kernel is built to expose internal **
[ 0.460317] ** IOMMU data structures, which may compromise security on **
[ 0.461100] ** your system. **
[ 0.461883] ** **
[ 0.462666] ** If you see this message and you are not debugging the **
[ 0.463455] ** kernel, report this immediately to your vendor! **
[ 0.464235] ** **
[ 0.464317] ** NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE NOTICE **
[ 0.465105] *************************************************************
[ 0.465993] PM: RTC time: 01:57:17, date: 2023-03-14
[ 0.471145] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[ 0.472712] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations
[ 0.473559] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[ 0.474480] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[ 0.475493] audit: initializing netlink subsys (disabled)
[ 0.476377] audit: type=2000 audit(1678759038.458:1): state=initialized audit_enabled=0 res=1
[ 0.477352] thermal_sys: Registered thermal governor 'fair_share'
[ 0.477365] thermal_sys: Registered thermal governor 'bang_bang'
[ 0.478086] thermal_sys: Registered thermal governor 'step_wise'
[ 0.478794] thermal_sys: Registered thermal governor 'user_space'
[ 0.479565] cpuidle: using governor ladder
[ 0.480344] cpuidle: using governor menu
[ 0.481235] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 0.482463] PCI: Using configuration type 1 for base access
[ 0.484376] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[ 0.777280] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[ 0.778069] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page
[ 0.778813] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[ 0.779571] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[ 0.784909] ACPI: Added _OSI(Module Device)
[ 0.785434] ACPI: Added _OSI(Processor Device)
[ 0.785959] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.786509] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.794119] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 2.971040] Callback from call_rcu_tasks_rude() invoked.
[ 3.018033] ACPI: Interpreter enabled
[ 3.018624] ACPI: PM: (supports S0 S3 S4 S5)
[ 3.019130] ACPI: Using IOAPIC for interrupt routing
[ 3.020374] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 3.020963] PCI: Using E820 reservations for host bridge windows
[ 3.022084] ACPI: Enabled 2 GPEs in block 00 to 0F
[ 3.037588] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 3.038140] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 3.038816] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 3.039725] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 3.042706] acpiphp: Slot [3] registered
[ 3.043108] acpiphp: Slot [4] registered
[ 3.043502] acpiphp: Slot [5] registered
[ 3.043908] acpiphp: Slot [6] registered
[ 3.044301] acpiphp: Slot [7] registered
[ 3.044376] acpiphp: Slot [8] registered
[ 3.044762] acpiphp: Slot [9] registered
[ 3.045155] acpiphp: Slot [10] registered
[ 3.045553] acpiphp: Slot [11] registered
[ 3.045953] acpiphp: Slot [12] registered
[ 3.046359] acpiphp: Slot [13] registered
[ 3.046759] acpiphp: Slot [14] registered
[ 3.047160] acpiphp: Slot [15] registered
[ 3.047555] acpiphp: Slot [16] registered
[ 3.047874] acpiphp: Slot [17] registered
[ 3.048193] acpiphp: Slot [18] registered
[ 3.048376] acpiphp: Slot [19] registered
[ 3.048697] acpiphp: Slot [20] registered
[ 3.049016] acpiphp: Slot [21] registered
[ 3.049334] acpiphp: Slot [22] registered
[ 3.049658] acpiphp: Slot [23] registered
[ 3.049984] acpiphp: Slot [24] registered
[ 3.050326] acpiphp: Slot [25] registered
[ 3.050653] acpiphp: Slot [26] registered
[ 3.050980] acpiphp: Slot [27] registered
[ 3.051311] acpiphp: Slot [28] registered
[ 3.051652] acpiphp: Slot [29] registered
[ 3.052013] acpiphp: Slot [30] registered
[ 3.052384] acpiphp: Slot [31] registered
[ 3.052748] PCI host bridge to bus 0000:00
[ 3.053094] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 3.053663] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 3.054236] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 3.054894] pci_bus 0000:00: root bus resource [mem 0x80000000-0xfebfffff window]
[ 3.055521] pci_bus 0000:00: root bus resource [mem 0x100000000-0x17fffffff window]
[ 3.056160] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 3.056447] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
[ 3.059658] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
[ 3.060897] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
[ 3.062714] pci 0000:00:01.1: reg 0x20: [io 0xc040-0xc04f]
[ 3.063760] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
[ 3.064317] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
[ 3.064873] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
[ 3.065469] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
[ 3.066410] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
[ 3.067242] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI
[ 3.067848] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB
[ 3.068612] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000
[ 3.071286] pci 0000:00:02.0: reg 0x10: [mem 0xfd000000-0xfdffffff pref]
[ 3.074098] pci 0000:00:02.0: reg 0x18: [mem 0xfebf0000-0xfebf0fff]
[ 3.078832] pci 0000:00:02.0: reg 0x30: [mem 0xfebe0000-0xfebeffff pref]
[ 3.079991] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 3.084588] pci 0000:00:03.0: [8086:100e] type 00 class 0x020000
[ 3.085925] pci 0000:00:03.0: reg 0x10: [mem 0xfebc0000-0xfebdffff]
[ 3.087238] pci 0000:00:03.0: reg 0x14: [io 0xc000-0xc03f]
[ 3.090796] pci 0000:00:03.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref]
[ 3.092390] Callback from call_rcu_tasks() invoked.
[ 3.103286] ACPI: PCI: Interrupt link LNKA configured for IRQ 10
[ 3.104186] ACPI: PCI: Interrupt link LNKB configured for IRQ 10
[ 3.104659] ACPI: PCI: Interrupt link LNKC configured for IRQ 11
[ 3.105645] ACPI: PCI: Interrupt link LNKD configured for IRQ 11
[ 3.106320] ACPI: PCI: Interrupt link LNKS configured for IRQ 9
[ 3.108626] iommu: Default domain type: Translated
[ 3.108938] iommu: DMA domain TLB invalidation policy: lazy mode
[ 3.114018] SCSI subsystem initialized
[ 3.114523] ACPI: bus type USB registered
[ 3.114523] usbcore: registered new interface driver usbfs
[ 3.114523] usbcore: registered new interface driver hub
[ 3.114523] usbcore: registered new device driver usb
[ 3.114523] pps_core: LinuxPPS API ver. 1 registered
[ 3.114523] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@xxxxxxxx>
[ 3.115157] PTP clock support registered
[ 3.116419] EDAC MC: Ver: 3.0.0
[ 3.121041] NetLabel: Initializing
[ 3.121348] NetLabel: domain hash size = 128
[ 3.121723] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 3.122263] NetLabel: unlabeled traffic allowed by default
[ 3.122870] PCI: Using ACPI for IRQ routing
[ 3.122870] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[ 3.122870] pci 0000:00:02.0: vgaarb: bridge control possible
[ 3.122870] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 3.124322] vgaarb: loaded
[ 3.125003] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[ 3.125041] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[ 3.128369] clocksource: Switched to clocksource kvm-clock
[ 3.285611] VFS: Disk quotas dquot_6.6.0
[ 3.286152] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 3.287454] pnp: PnP ACPI init
[ 3.289639] pnp: PnP ACPI: found 6 devices
[ 3.302470] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 3.303810] NET: Registered PF_INET protocol family
[ 3.304568] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)
[ 3.306210] tcp_listen_portaddr_hash hash table entries: 1024 (order: 4, 73728 bytes, linear)
[ 3.307109] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 3.307946] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)
[ 3.309030] TCP bind hash table entries: 16384 (order: 9, 2359296 bytes, linear)
[ 3.311519] TCP: Hash tables configured (established 16384 bind 16384)
[ 3.312379] UDP hash table entries: 1024 (order: 5, 163840 bytes, linear)
[ 3.313214] UDP-Lite hash table entries: 1024 (order: 5, 163840 bytes, linear)
[ 3.314175] NET: Registered PF_UNIX/PF_LOCAL protocol family
[ 3.315283] RPC: Registered named UNIX socket transport module.
[ 3.315802] RPC: Registered udp transport module.
[ 3.316204] RPC: Registered tcp transport module.
[ 3.316639] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 3.317345] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 3.317898] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]
[ 3.318481] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 3.319088] pci_bus 0000:00: resource 7 [mem 0x80000000-0xfebfffff window]
[ 3.319714] pci_bus 0000:00: resource 8 [mem 0x100000000-0x17fffffff window]
[ 3.320618] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[ 3.321116] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 3.321707] PCI: CLS 0 bytes, default 64
[ 3.322127] ACPI: bus type thunderbolt registered
[ 3.322944] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x3407c077a8d, max_idle_ns: 440795342283 ns
[ 3.327239] Initialise system trusted keyrings
[ 3.327730] Key type blacklist registered
[ 3.328398] workingset: timestamp_bits=36 max_order=19 bucket_order=0
[ 3.329284] zbud: loaded
[ 3.330576] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 3.332084] NFS: Registering the id_resolver key type
[ 3.332755] Key type id_resolver registered
[ 3.333256] Key type id_legacy registered
[ 3.333785] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[ 3.334604] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[ 3.335753] fuse: init (API version 7.38)
[ 3.336609] SGI XFS with ACLs, security attributes, realtime, quota, no debug enabled
[ 3.337974] 9p: Installing v9fs 9p2000 file system support
[ 3.344358] Key type asymmetric registered
[ 3.344805] Asymmetric key parser 'x509' registered
[ 3.345422] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[ 3.346399] io scheduler mq-deadline registered
[ 3.347035] io scheduler bfq registered
[ 3.348051] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 3.349544] IPMI message handler: version 39.2
[ 3.350162] ipmi device interface
[ 3.352225] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 3.353273] ACPI: button: Power Button [PWRF]
[ 3.354713] ERST DBG: ERST support is disabled.
[ 3.356058] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 3.357246] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 3.366709] Linux agpgart interface v0.103
[ 3.368057] ACPI: bus type drm_connector registered
[ 3.382853] brd: module loaded
[ 3.390151] loop: module loaded
[ 3.395504] scsi host0: ata_piix
[ 3.396649] scsi host1: ata_piix
[ 3.397035] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc040 irq 14
[ 3.397477] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc048 irq 15
[ 3.399183] tun: Universal TUN/TAP device driver, 1.6
[ 3.399778] e100: Intel(R) PRO/100 Network Driver
[ 3.400085] e100: Copyright(c) 1999-2006 Intel Corporation
[ 3.400494] e1000: Intel(R) PRO/1000 Network Driver
[ 3.400821] e1000: Copyright (c) 1999-2006 Intel Corporation.
[ 3.556448] ata1: found unknown device (class 0)
[ 3.557083] ata2: found unknown device (class 0)
[ 3.558281] ata1.00: ATA-7: QEMU HARDDISK, 2.5+, max UDMA/100
[ 3.558795] ata1.00: 16777216 sectors, multi 16: LBA48
[ 3.559438] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100
[ 3.561619] scsi 0:0:0:0: Direct-Access ATA QEMU HARDDISK 2.5+ PQ: 0 ANSI: 5
[ 3.564240] scsi 0:0:0:0: Attached scsi generic sg0 type 0
[ 3.566257] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5
[ 3.568699] sd 0:0:0:0: [sda] 16777216 512-byte logical blocks: (8.59 GB/8.00 GiB)
[ 3.569652] sd 0:0:0:0: [sda] Write Protect is off
[ 3.570300] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 3.571403] sd 0:0:0:0: [sda] Preferred minimum I/O size 512 bytes
[ 3.581200] ACPI: \_SB_.LNKC: Enabled at IRQ 11
[ 3.589488] sd 1:0:0:0: Attached scsi generic sg1 type 5
[ 3.590950] sd 0:0:0:0: [sda] Attached SCSI disk
[ 3.905049] e1000 0000:00:03.0 eth0: (PCI:33MHz:32-bit) 52:54:00:12:34:56
[ 3.905917] e1000 0000:00:03.0 eth0: Intel(R) PRO/1000 Network Connection
[ 3.906849] e1000e: Intel(R) PRO/1000 Network Driver
[ 3.907440] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[ 3.908232] igb: Intel(R) Gigabit Ethernet Network Driver
[ 3.908905] igb: Copyright (c) 2007-2014 Intel Corporation.
[ 3.909712] PPP generic driver version 2.4.2
[ 3.910951] VFIO - User Level meta-driver version: 0.3
[ 3.912157] usbcore: registered new interface driver uas
[ 3.912881] usbcore: registered new interface driver usb-storage
[ 3.913794] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 3.915709] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 3.916401] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 3.917901] mousedev: PS/2 mouse device common for all mice
[ 3.919740] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 3.920589] rtc_cmos 00:05: RTC can wake from S4
[ 3.922212] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4
[ 3.922655] rtc_cmos 00:05: registered as rtc0
[ 3.923839] rtc_cmos 00:05: setting system clock to 2023-03-14T01:57:21 UTC (1678759041)
[ 3.923980] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
[ 3.925988] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[ 3.926904] i2c_dev: i2c /dev entries driver
[ 3.927486] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ 3.928934] device-mapper: uevent: version 1.0.3
[ 3.929829] device-mapper: ioctl: 4.47.0-ioctl (2022-07-28) initialised: dm-devel@xxxxxxxxxx
[ 3.930835] intel_pstate: CPU model not supported
[ 3.931517] sdhci: Secure Digital Host Controller Interface driver
[ 3.932225] sdhci: Copyright(c) Pierre Ossman
[ 3.932882] sdhci-pltfm: SDHCI platform and OF driver helper
[ 3.933621] ledtrig-cpu: registered to indicate activity on CPUs
[ 3.934848] drop_monitor: Initializing network drop monitor service
[ 3.935868] NET: Registered PF_INET6 protocol family
[ 3.940193] Segment Routing with IPv6
[ 3.940709] In-situ OAM (IOAM) with IPv6
[ 3.941233] NET: Registered PF_PACKET protocol family
[ 3.942013] 9pnet: Installing 9P2000 support
[ 3.942581] Key type dns_resolver registered
[ 3.944183] IPI shorthand broadcast: enabled
[ 3.963413] sched_clock: Marking stable (3780005895, 180308989)->(3995821597, -35506713)
[ 3.965266] registered taskstats version 1
[ 3.966072] Loading compiled-in X.509 certificates
[ 3.966860] zswap: loaded using pool lzo/zbud
[ 3.986503] Key type .fscrypt registered
[ 3.986833] Key type fscrypt-provisioning registered
[ 3.988220] Key type encrypted registered
[ 3.988659] ima: No TPM chip found, activating TPM-bypass!
[ 3.989084] ima: Allocated hash algorithm: sha1
[ 3.989488] ima: No architecture policies found
[ 3.989915] evm: Initialising EVM extended attributes:
[ 3.990328] evm: security.selinux
[ 3.990590] evm: security.SMACK64
[ 3.990847] evm: security.SMACK64EXEC
[ 3.991111] evm: security.SMACK64TRANSMUTE
[ 3.991415] evm: security.SMACK64MMAP
[ 3.991675] evm: security.apparmor
[ 3.991925] evm: security.ima
[ 3.992152] evm: security.capability
[ 3.992442] evm: HMAC attrs: 0x1
[ 3.993971] PM: Magic number: 15:577:963
[ 3.994390] memory memory14: hash matches
[ 3.995061] RAS: Correctable Errors collector initialized.
[ 3.996097] md: Waiting for all devices to be available before autodetect
[ 3.996475] md: If you don't use raid, use raid=noautodetect
[ 3.996792] md: Autodetecting RAID arrays.
[ 3.997033] md: autorun ...
[ 3.997193] md: ... autorun DONE.
[ 4.009456] EXT4-fs (sda): INFO: recovery required on readonly filesystem
[ 4.010047] EXT4-fs (sda): write access will be enabled during recovery
[ 4.078758] EXT4-fs (sda): recovery complete
[ 4.085464] EXT4-fs (sda): mounted filesystem 23a53bb9-f815-47a5-b74c-5e08f7731193 with ordered data mode. Quota mode: none.
[ 4.086415] VFS: Mounted root (ext4 filesystem) readonly on device 8:0.
[ 4.087687] devtmpfs: mounted
[ 4.094013] Freeing unused decrypted memory: 2036K
[ 4.101273] Freeing unused kernel image (initmem) memory: 10508K
[ 4.101825] Write protecting the kernel read-only data: 47104k
[ 4.104018] Freeing unused kernel image (rodata/data gap) memory: 392K
[ 4.190099] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 4.190433] Run /sbin/init as init process
[ 4.333587] systemd[1]: RTC configured in localtime, applying delta of 0 minutes to system time.
[ 4.374155] systemd[1]: systemd 239 (239-49.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy)
[ 4.376168] systemd[1]: Detected virtualization kvm.
[ 4.376636] systemd[1]: Detected architecture x86-64.

Welcome to [0;31mCentOS Stream 8[0m!

[ 4.440968] systemd[1]: Set hostname to <test>.
[ 4.706953] systemd[1]: Created slice system-getty.slice.
[[0;32m OK [0m] Created slice system-getty.slice.
[ 4.708124] systemd[1]: Listening on multipathd control socket.
[[0;32m OK [0m] Listening on multipathd control socket.
[ 4.709358] systemd[1]: Listening on LVM2 poll daemon socket.
[[0;32m OK [0m] Listening on LVM2 poll daemon socket.
[ 4.710245] systemd[1]: Listening on udev Kernel Socket.
[[0;32m OK [0m] Listening on udev Kernel Socket.
[ 4.711106] systemd[1]: Listening on Journal Socket (/dev/log).
[[0;32m OK [0m] Listening on Journal Socket (/dev/log).
[ 4.718780] systemd[1]: Listening on Process Core Dump Socket.
[[0;32m OK [0m] Listening on Process Core Dump Socket.
[[0;32m OK [0m] Created slice User and Session Slice.
[[0;32m OK [0m] Reached target Swap.
[[0;32m OK [0m] Created slice system-sshd\x2dkeygen.slice.
[[0;32m OK [0m] Listening on Journal Socket.
Starting Setup Virtual Console...
Mounting Kernel Debug File System...
Starting Load Kernel Modules...
Mounting Huge Pages File System...
[[0;32m OK [0m] Reached target Slices.
[[0;32m OK [0m] Listening on udev Control Socket.
[[0;32m OK [0m] Set up automount Arbitrary Executab…rmats File System Automount Point.
Starting Journal Service...
[[0;32m OK [0m] Listening on initctl Compatibility Named Pipe.
[[0;32m OK [0m] Started Forward Password Requests to Wall Directory Watch.
Starting udev Coldplug all Devices...
[[0;32m OK [0m] Listening on Device-mapper event daemon FIFOs.
[[0;32m OK [0m] Created slice system-serial\x2dgetty.slice.
Mounting POSIX Message Queue File System...
Starting Remount Root and Kernel File Systems...
[[0;32m OK [0m] Listening on RPCbind Server Activation Socket.
[[0;32m OK [0m] Reached target RPC Port Mapper.
Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling...
[[0;32m OK [0m] Mounted Kernel Debug File System.
[[0;1;31mFAILED[0m] Failed to start Load Kernel Modules.
See 'systemctl status systemd-modules-load.service' for details.
[[0;32m OK [0m] Mounted Huge Pages File System.
[[0;32m OK [0m] Mounted POSIX Message Queue File System.
Mounting Kernel Configuration File System...
Mounting FUSE Control File System...
Starting Apply Kernel Variables...
[[0;32m OK [0m] Mounted Kernel Configuration File System.
[[0;32m OK [0m] Mounted FUSE Control File System.
[[0;32m OK [0m] Started Setup Virtual Console.
[[0;32m OK [0m] Started Apply Kernel Variables.
[[0;32m OK [0m] Started Journal Service.
[ 5.299531] EXT4-fs (sda): re-mounted 23a53bb9-f815-47a5-b74c-5e08f7731193. Quota mode: none.
[[0;32m OK [0m] Started Remount Root and Kernel File Systems.
Starting Flush Journal to Persistent Storage...
Starting Load/Save Random Seed...
Starting Create Static Device Nodes in /dev...
[[0;32m OK [0m] Started Load/Save Random Seed.
[[0;32m OK [0m] Started Flush Journal to Persistent Storage.
[[0;32m OK [0m] Started Create Static Device Nodes in /dev.
Starting udev Kernel Device Manager...
[[0;32m OK [0m] Started udev Coldplug all Devices.
Starting udev Wait for Complete Device Initialization...
[[0;32m OK [0m] Started udev Kernel Device Manager.
Starting Show Plymouth Boot Screen...
[[0;32m OK [0m] Started Show Plymouth Boot Screen.

[[0;32m OK [0m] Reached target Local Encrypted Volumes.

[[0;32m OK [0m] Reached target Paths.

[[0;32m OK [0m] Started Forward Password Requests to Plymouth Directory Watch.

[[0;32m OK [0m] Started udev Wait for Complete Device Initialization.

[[0;32m OK [0m] Found device /dev/ttyS0.

[[0;32m OK [0m] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling.

[[0;32m OK [0m] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.

[[0;32m OK [0m] Reached target Local File Systems (Pre).

[[0;32m OK [0m] Reached target Local File Systems.

Starting Tell Plymouth To Write Out Runtime Data...

Starting Create Volatile Files and Directories...

Starting Restore /run/initramfs on shutdown...

[[0;32m OK [0m] Started Tell Plymouth To Write Out Runtime Data.

[[0;32m OK [0m] Started Restore /run/initramfs on shutdown.

[[0;32m OK [0m] Started Create Volatile Files and Directories.

Mounting RPC Pipe File System...

Starting Security Auditing Service...

Starting RPC Bind...

[[0;32m OK [0m] Mounted RPC Pipe File System.

[[0;32m OK [0m] Reached target rpc_pipefs.target.

[[0;32m OK [0m] Started RPC Bind.

[[0;32m OK [0m] Started Security Auditing Service.

Starting Update UTMP about System Boot/Shutdown...

[[0;32m OK [0m] Started Update UTMP about System Boot/Shutdown.

[[0;32m OK [0m] Reached target System Initialization.

[[0;32m OK [0m] Listening on SSSD Kerberos Cache Manager responder socket.

[[0;32m OK [0m] Started Daily Cleanup of Temporary Directories.

[[0;32m OK [0m] Started daily update of the root trust anchor for DNSSEC.

[[0;32m OK [0m] Started dnf makecache --timer.

[[0;32m OK [0m] Reached target Timers.

[[0;32m OK [0m] Listening on D-Bus System Message Bus Socket.

[[0;32m OK [0m] Reached target Sockets.

[[0;32m OK [0m] Reached target Basic System.

[[0;32m OK [0m] Started Machine Check Exception Logging Daemon.

Starting Auto-connect to subsystems…-NVME devices found during boot...

Starting Self Monitoring and Reporting Technology (SMART) Daemon...

[[0;32m OK [0m] Started irqbalance daemon.

Starting Login Service...

Starting NTP client/server...

[[0;32m OK [0m] Started D-Bus System Message Bus.

Starting Network Manager...

Starting Authorization Manager...

[[0;32m OK [0m] Reached target sshd-keygen.target.

[[0;32m OK [0m] Started Self Monitoring and Reporting Technology (SMART) Daemon.

[[0;32m OK [0m] Started Auto-connect to subsystems …FC-NVME devices found during boot.

Starting update of the root trust a…or DNSSEC validation in unbound...

[[0;32m OK [0m] Started Login Service.

[[0;32m OK [0m] Started NTP client/server.

[[0;32m OK [0m] Started Network Manager.

Starting Network Manager Wait Online...

[[0;32m OK [0m] Reached target Network.

Starting OpenSSH server daemon...

Starting Dynamic System Tuning Daemon...

Starting GSSAPI Proxy Daemon...

[[0;32m OK [0m] Started update of the root trust an… for DNSSEC validation in unbound.

[[0;32m OK [0m] Started Authorization Manager.

Starting Hostname Service...

[[0;32m OK [0m] Started GSSAPI Proxy Daemon.

[[0;32m OK [0m] Reached target NFS client services.

[[0;32m OK [0m] Reached target Remote File Systems (Pre).

[[0;32m OK [0m] Reached target Remote File Systems.

Starting Permit User Sessions...

[[0;32m OK [0m] Started OpenSSH server daemon.

[[0;32m OK [0m] Started Permit User Sessions.

Starting Hold until boot process finishes up...

[[0;32m OK [0m] Started Command Scheduler.

Starting Terminate Plymouth Boot Screen...

[ 7.656613] e1000: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[ 7.657810] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[ 7.905297] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!
[ 7.905841] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

CentOS Stream 8
Kernel 6.3.0-rc2-eeac8ede1755+ on an x86_64

test login: root

[ 12.533569] memfd_create() without MFD_EXEC nor MFD_NOEXEC_SEAL, pid=328 'systemd'
Last login: Fri Mar 10 08:45:17 on ttyS0
*******************************************************
Welcome to the Embargoed Overlay on CentOS

This content is for INTEL INTERNAL USE ONLY.

For support issues, please submit a request:
https://jira.devtools.intel.com/browse/LNXO
*******************************************************
[root@test ~]#
[root@test ~]#
[root@test ~]# ls
anaconda-ks.cfg quick_test.c syzkaller.9FSdCu syzkaller.OjSrkA
cet_ibt repro.c syzkaller.fIIL2o syzkaller.Q5dMMG
cpuid repro.sh syzkaller.G7vfvS syzkaller.qCVHXV
cpuid.c shadow_test_fork syzkaller.IhmgVg syzkaller.TRJkoZ
file0 shstk_cp syzkaller.iVVz3P syzkaller.uq7iOt
id_rsa.pub shstk_cp.c syzkaller.ju9NUO syzkaller.uXhAhf
Install_kernel_record.log syzkaller.2e0D20 syzkaller.KfBl6t
quick_test syzkaller.6TPmw0 syzkaller.mc3H24
[root@test ~]# rm -rf repro
[root@test ~]# ./repro
[ 339.307328] loop0: detected capacity change from 0 to 65536
[ 339.307840] XFS: ikeep mount option is deprecated.
[ 339.310052] XFS (loop0): Mounting V5 Filesystem d408de26-55fb-48ab-a8ab-aacedb20f9dd
[ 339.315710] XFS (loop0): Ending clean mount
[ 339.316761] XFS (loop0): Quotacheck needed: Please wait.
[ 339.317833] XFS (loop0): Metadata CRC error detected at xfs_agf_read_verify+0x10e/0x140, xfs_agf block 0x1
[ 339.318319] XFS (loop0): Unmount and run xfs_repair
[ 339.318534] XFS (loop0): First 128 bytes of corrupted metadata buffer:
[ 339.318812] 00000000: 58 41 47 46 00 00 00 01 00 00 00 00 00 00 40 00 XAGF..........@.
[ 339.319151] 00000010: 00 00 00 02 00 00 00 03 00 00 00 00 00 00 00 01 ................
[ 339.319496] 00000020: 00 00 00 01 00 00 00 00 00 00 01 00 00 00 00 04 ................
[ 339.319854] 00000030: 00 00 00 04 00 00 3f ca 00 00 3f c7 00 00 00 00 ......?...?.....
[ 339.320193] 00000040: d4 08 de 26 55 fb 48 ab a8 ab aa ce db 20 f9 dd ...&U.H...... ..
[ 339.320656] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
[ 339.320998] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
[ 339.321334] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
[ 339.322361] XFS (loop0): metadata I/O error in "xfs_read_agf+0xd0/0x2c0" at daddr 0x1 len 1 error 74
[ 339.323346] XFS (loop0): Quotacheck: Unsuccessful (Error -117): Disabling quotas.
[ 339.341420] XFS (loop0): Metadata CRC error detected at xfs_agf_read_verify+0x10e/0x140, xfs_agf block 0x1
[ 339.341888] XFS (loop0): Unmount and run xfs_repair
[ 339.342106] XFS (loop0): First 128 bytes of corrupted metadata buffer:
[ 339.342414] 00000000: 58 41 47 46 00 00 00 01 00 00 00 00 00 00 40 00 XAGF..........@.
[ 339.342760] 00000010: 00 00 00 02 00 00 00 03 00 00 00 00 00 00 00 01 ................
[ 339.343105] 00000020: 00 00 00 01 00 00 00 00 00 00 01 00 00 00 00 04 ................
[ 339.343534] 00000030: 00 00 00 04 00 00 3f ca 00 00 3f c7 00 00 00 00 ......?...?.....
[ 339.343899] 00000040: d4 08 de 26 55 fb 48 ab a8 ab aa ce db 20 f9 dd ...&U.H...... ..
[ 339.344248] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
[ 339.344660] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
[ 339.345010] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
[ 339.347201] XFS (loop0): metadata I/O error in "xfs_read_agf+0xd0/0x2c0" at daddr 0x1 len 1 error 74
[ 339.347823] XFS (loop0): page discard on page 000000007e0ebc83, inode 0x2b, pos 0.
[ 339.352925] XFS (loop0): Unmounting Filesystem d408de26-55fb-48ab-a8ab-aacedb20f9dd
[ 339.363249] XFS (loop0): SB summary counter sanity check failed
[ 339.363557] XFS (loop0): Metadata corruption detected at xfs_sb_write_verify+0x7d/0x180, xfs_sb block 0x0
[ 339.363982] XFS (loop0): Unmount and run xfs_repair
[ 339.364203] XFS (loop0): First 128 bytes of corrupted metadata buffer:
[ 339.364652] 00000000: 58 46 53 42 00 00 04 00 00 00 00 00 00 00 80 00 XFSB............
[ 339.365004] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
[ 339.365343] 00000020: d4 08 de 26 55 fb 48 ab a8 ab aa ce db 20 f9 dd ...&U.H...... ..
[ 339.365683] 00000030: 00 00 00 00 00 00 40 08 00 00 00 00 00 00 00 20 ......@........
[ 339.366030] 00000040: 00 00 00 00 00 00 00 21 00 00 00 00 00 00 00 22 .......!......."
[ 339.366381] 00000050: 00 00 00 04 00 00 40 00 00 00 00 02 00 00 00 00 ......@.........
[ 339.366722] 00000060: 00 00 04 98 b4 f5 02 00 02 00 00 02 00 00 00 00 ................
[ 339.367062] 00000070: 00 00 00 00 00 00 00 00 0a 09 09 01 0e 00 00 14 ................
[ 339.367548] XFS (loop0): Corruption of in-memory data (0x8) detected at _xfs_buf_ioapply+0x67d/0x690 (fs/xfs/xfs_buf.c:1553). Shutting down filesystem.
[ 339.368164] XFS (loop0): Please unmount the filesystem and rectify the problem(s)
[ 364.436316] watchdog: BUG: soft lockup - CPU#0 stuck for 26s! [repro:405]
[ 364.436724] Modules linked in:
[ 364.436868] irq event stamp: 21510
[ 364.437026] hardirqs last enabled at (21509): [<ffffffff8300187e>] irqentry_exit+0x3e/0xa0
[ 364.437406] hardirqs last disabled at (21510): [<ffffffff82fff863>] sysvec_apic_timer_interrupt+0x13/0xe0
[ 364.437826] softirqs last enabled at (8970): [<ffffffff83024a4c>] __do_softirq+0x31c/0x49c
[ 364.438195] softirqs last disabled at (8897): [<ffffffff8112b5a4>] irq_exit_rcu+0xc4/0x100
[ 364.438564] CPU: 0 PID: 405 Comm: repro Not tainted 6.3.0-rc2-eeac8ede1755+ #1
[ 364.438885] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
[ 364.439382] RIP: 0010:rcu_lockdep_current_cpu_online+0x5b/0x90
[ 364.439657] Code: 5b 41 5c 5d c3 cc cc cc cc 65 ff 05 d7 bb e1 7e e8 fa 94 de 01 48 c7 c3 80 61 03 00 89 c0 48 03 1c c5 00 7b cb 83 48 8b 43 18 <48> 8b 40 70 48 85 43 20 74 10 65 ff 0d ac bb e1 7e 75 c0 0f 1f 44
[ 364.440449] RSP: 0018:ffffc90000eb3ba8 EFLAGS: 00000282
[ 364.440689] RAX: ffffffff83f64340 RBX: ffff88807dc36180 RCX: 0000000000000000
[ 364.441003] RDX: 0000000000000000 RSI: 0000000000000003 RDI: 0000000000000000
[ 364.441313] RBP: ffffc90000eb3bb8 R08: 0000000000000001 R09: 0000000000000000
[ 364.441626] R10: ffff88800f7e30d8 R11: 0000000000000000 R12: 0000000000000001
[ 364.441938] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 364.442248] FS: 00007f9db4acf740(0000) GS:ffff88807dc00000(0000) knlGS:0000000000000000
[ 364.442597] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 364.442852] CR2: 00007f5e8f6f5518 CR3: 000000000f6da004 CR4: 0000000000770ef0
[ 364.443169] PKRU: 55555554
[ 364.443297] Call Trace:
[ 364.443412] <TASK>
[ 364.443519] rcu_read_lock_held_common+0x33/0x50
[ 364.443741] rcu_read_lock_sched_held+0x29/0x80
[ 364.443956] lock_acquire+0x2ad/0x320
[ 364.444133] ? lock_release+0x141/0x2e0
[ 364.444313] ? write_comp_data+0x2f/0x90
[ 364.444507] _raw_spin_lock+0x36/0x50
[ 364.444681] ? xfs_ail_push_all_sync+0x73/0x110
[ 364.444893] xfs_ail_push_all_sync+0x73/0x110
[ 364.445097] ? __pfx_autoremove_wake_function+0x10/0x10
[ 364.445343] xfs_reclaim_inodes+0xb8/0x140
[ 364.445543] xfs_unmount_flush_inodes+0x63/0x80
[ 364.445757] xfs_unmountfs+0x69/0x1f0
[ 364.445939] xfs_fs_put_super+0x5a/0x120
[ 364.446130] ? __pfx_xfs_fs_put_super+0x10/0x10
[ 364.446356] generic_shutdown_super+0xac/0x240
[ 364.446573] kill_block_super+0x43/0x80
[ 364.446759] deactivate_locked_super+0x52/0xb0
[ 364.446966] deactivate_super+0xb3/0xd0
[ 364.447156] cleanup_mnt+0x15e/0x1e0
[ 364.447335] __cleanup_mnt+0x1f/0x30
[ 364.447513] task_work_run+0xb6/0x120
[ 364.447736] exit_to_user_mode_prepare+0x200/0x210
[ 364.448017] syscall_exit_to_user_mode+0x2d/0x60
[ 364.448293] do_syscall_64+0x4a/0x90
[ 364.448513] entry_SYSCALL_64_after_hwframe+0x72/0xdc
[ 364.448809] RIP: 0033:0x7f9db4bfb7db
[ 364.449033] Code: 96 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa 31 f6 e9 05 00 00 00 0f 1f 44 00 00 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 95 96 0c 00 f7 d8 64 89 01 48
[ 364.449954] RSP: 002b:00007fff5b16db78 EFLAGS: 00000206 ORIG_RAX: 00000000000000a6
[ 364.450376] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007f9db4bfb7db
[ 364.450745] RDX: 0000000000000000 RSI: 000000000000000a RDI: 00007fff5b16dc20
[ 364.451108] RBP: 00007fff5b16ec60 R08: 0000000001e88333 R09: 0000000000000009
[ 364.451484] R10: 0000000000404071 R11: 0000000000000206 R12: 00000000004012c0
[ 364.451847] R13: 00007fff5b16eda0 R14: 0000000000000000 R15: 0000000000000000
[ 364.452195] </TASK>
[ 364.452301] Kernel panic - not syncing: softlockup: hung tasks
[ 364.452562] CPU: 0 PID: 405 Comm: repro Tainted: G L 6.3.0-rc2-eeac8ede1755+ #1
[ 364.453010] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239552ce722-prebuilt.qemu.org 04/01/2014
[ 364.453551] Call Trace:
[ 364.453701] <IRQ>
[ 364.453826] dump_stack_lvl+0xa9/0x110
[ 364.454057] dump_stack+0x19/0x20
[ 364.454262] panic+0x4fd/0x520
[ 364.454455] ? watchdog_timer_fn+0x31e/0x390
[ 364.454689] watchdog_timer_fn+0x337/0x390
[ 364.454886] ? __pfx_watchdog_timer_fn+0x10/0x10
[ 364.455101] __hrtimer_run_queues+0x2ed/0x820
[ 364.455355] hrtimer_interrupt+0x134/0x2d0
[ 364.455604] __sysvec_apic_timer_interrupt+0x9c/0x290
[ 364.455902] sysvec_apic_timer_interrupt+0xab/0xe0
[ 364.456185] </IRQ>
[ 364.456314] <TASK>
[ 364.456441] asm_sysvec_apic_timer_interrupt+0x1f/0x30
[ 364.456742] RIP: 0010:rcu_lockdep_current_cpu_online+0x5b/0x90
[ 364.457067] Code: 5b 41 5c 5d c3 cc cc cc cc 65 ff 05 d7 bb e1 7e e8 fa 94 de 01 48 c7 c3 80 61 03 00 89 c0 48 03 1c c5 00 7b cb 83 48 8b 43 18 <48> 8b 40 70 48 85 43 20 74 10 65 ff 0d ac bb e1 7e 75 c0 0f 1f 44
[ 364.457937] RSP: 0018:ffffc90000eb3ba8 EFLAGS: 00000282
[ 364.458211] RAX: ffffffff83f64340 RBX: ffff88807dc36180 RCX: 0000000000000000
[ 364.458613] RDX: 0000000000000000 RSI: 0000000000000003 RDI: 0000000000000000
[ 364.459006] RBP: ffffc90000eb3bb8 R08: 0000000000000001 R09: 0000000000000000
[ 364.459418] R10: ffff88800f7e30d8 R11: 0000000000000000 R12: 0000000000000001
[ 364.459813] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 364.460213] ? rcu_lockdep_current_cpu_online+0x46/0x90
[ 364.460465] rcu_read_lock_held_common+0x33/0x50
[ 364.460743] rcu_read_lock_sched_held+0x29/0x80
[ 364.460980] lock_acquire+0x2ad/0x320
[ 364.461170] ? lock_release+0x141/0x2e0
[ 364.461391] ? write_comp_data+0x2f/0x90
[ 364.461590] _raw_spin_lock+0x36/0x50
[ 364.461804] ? xfs_ail_push_all_sync+0x73/0x110
[ 364.462018] xfs_ail_push_all_sync+0x73/0x110
[ 364.462228] ? __pfx_autoremove_wake_function+0x10/0x10
[ 364.462479] xfs_reclaim_inodes+0xb8/0x140
[ 364.462682] xfs_unmount_flush_inodes+0x63/0x80
[ 364.462933] xfs_unmountfs+0x69/0x1f0
[ 364.463112] xfs_fs_put_super+0x5a/0x120
[ 364.463304] ? __pfx_xfs_fs_put_super+0x10/0x10
[ 364.463522] generic_shutdown_super+0xac/0x240
[ 364.463741] kill_block_super+0x43/0x80
[ 364.463930] deactivate_locked_super+0x52/0xb0
[ 364.464154] deactivate_super+0xb3/0xd0
[ 364.464348] cleanup_mnt+0x15e/0x1e0
[ 364.464564] __cleanup_mnt+0x1f/0x30
[ 364.464787] task_work_run+0xb6/0x120
[ 364.465002] exit_to_user_mode_prepare+0x200/0x210
[ 364.465226] syscall_exit_to_user_mode+0x2d/0x60
[ 364.465449] do_syscall_64+0x4a/0x90
[ 364.465621] entry_SYSCALL_64_after_hwframe+0x72/0xdc
[ 364.465861] RIP: 0033:0x7f9db4bfb7db
[ 364.466065] Code: 96 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa 31 f6 e9 05 00 00 00 0f 1f 44 00 00 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 95 96 0c 00 f7 d8 64 89 01 48
[ 364.466917] RSP: 002b:00007fff5b16db78 EFLAGS: 00000206 ORIG_RAX: 00000000000000a6
[ 364.467262] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007f9db4bfb7db
[ 364.467582] RDX: 0000000000000000 RSI: 000000000000000a RDI: 00007fff5b16dc20
[ 364.467902] RBP: 00007fff5b16ec60 R08: 0000000001e88333 R09: 0000000000000009
[ 364.468228] R10: 0000000000404071 R11: 0000000000000206 R12: 00000000004012c0
[ 364.468605] R13: 00007fff5b16eda0 R14: 0000000000000000 R15: 0000000000000000
[ 364.468992] </TASK>
[ 364.469185] Kernel Offset: disabled
[ 364.469398] ---[ end Kernel panic - not syncing: softlockup: hung tasks ]---

Next message: Baolu Lu: "Re: [PATCH v6 4/7] iommu/sva: Stop using ioasid_set for SVA"
Previous message: Wei Fang: "RE: [PATCH] net: Use of_property_read_bool() for boolean properties"
In reply to: Darrick J. Wong: "Re: [Syzkaller & bisect] There is BUG: soft lockup in __cleanup_mnt in v6.3-rc1 kernel"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]