[6.0.0-rc7] [net-next] [HNV] WARNING: CPU: 3 PID: 0 at drivers/net/ethernet/mellanox/mlx5/core/en_rx.c:897 mlx5e_poll_ico_cq+0x4a0/0x570 [mlx5_core]
From: Tasmiya Nalatwad
Date: Tue Oct 04 2022 - 07:52:40 EST
Greetings,
[6.0.0-rc7] [net-next] [HNV] WARNING: CPU: 3 PID: 0 at
drivers/net/ethernet/mellanox/mlx5/core/en_rx.c:897
mlx5e_poll_ico_cq+0x4a0/0x570 [mlx5_core]
--- Call Traces ---
[ 18.152936] ------------[ cut here ]------------
[ 18.152947] netdevice: enP32775p1s0: Bad OP in ICOSQ CQE: 0xd
[ 18.152968] WARNING: CPU: 3 PID: 0 at
drivers/net/ethernet/mellanox/mlx5/core/en_rx.c:897
mlx5e_poll_ico_cq+0x4a0/0x570 [mlx5_core]
[ 18.153025] Modules linked in: rfkill rpcrdma sunrpc rdma_ucm ib_srpt
ib_isert iscsi_target_mod target_core_mod ib_iser ib_umad ib_ipoib
rdma_cm iw_cm libiscsi ib_cm scsi_transport_iscsi mlx5_ib ib_uverbs
ib_core mlx5_core mlxfw psample ptp xts pps_core pseries_rng vmx_crypto
sch_fq_codel binfmt_misc ip_tables ext4 mbcache jbd2 dm_service_time
sd_mod t10_pi crc64_rocksoft crc64 sg ibmvfc ibmveth scsi_transport_fc
dm_multipath dm_mirror dm_region_hash dm_log dm_mod fuse
[ 18.153064] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x679, ci 0x0, qn 0x10d, opcode 0xd, syndrome 0x2, vendor syndrome 0x68
[ 18.153067] CPU: 3 PID: 0 Comm: swapper/3 Not tainted
6.0.0-rc7-autotest-g46a275a56167 #1
[ 18.153073] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153075] NIP: c008000001bf9118 LR: c008000001bf9114 CTR:
00000000005b4448
[ 18.153076] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153079] REGS: c00000077fdc3940 TRAP: 0700 Not tainted
(6.0.0-rc7-autotest-g46a275a56167)
[ 18.153080] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x692, ci 0x0, qn 0x12b, opcode 0xd, syndrome 0x2, vendor syndrome 0x68
[ 18.153081] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153083] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153084] MSR: 8000000000029033 <SF,EE,ME
[ 18.153088] 00000030: 00 00 00 00 86 00 68 02 25 00 01 0d 00 00 e8 d2
[ 18.153089] ,IR,DR,RI
[ 18.153089] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x688, ci 0x0, qn 0x11f, opcode 0xd, syndrome 0x2, vendor syndrome 0x68
[ 18.153091] ,LE>
[ 18.153092] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153092] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153093] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153093] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153094] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x0, len: 192
[ 18.153095] 00000030: 00 00 00 00 86 00 68 02 25 00 01 2b 00 00 ce d2
[ 18.153096] CR: 48220824 XER: 00000002
[ 18.153097] 00000000: 00 00 00 25 00 01 0d 0c 00 00 00 00 00 03 04 00
[ 18.153098] CFAR: c00000000014f444
[ 18.153098] 00000010: 90 00 00 00 00 02 00 00 00 00 00 00 20 00 00 00
[ 18.153099] IRQMASK: 0
[ 18.153099] GPR00:
[ 18.153099] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153100] c008000001bf9114
[ 18.153100] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153102] 00000030: 00 00 00 00 86 00 68 02 25 00 01 1f 00 00 fa d2
[ 18.153102] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x0, len: 192
[ 18.153102] c00000077fdc3be0 c008000001cfa200
[ 18.153103] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x68d, ci 0x0, qn 0x125, opcode 0xd, syndrome 0x2, vendor syndrome 0x68
[ 18.153105] 0000000000000031
[ 18.153105] 00000000: 00 00 00 25 00 01 2b 0c 00 00 00 00 00 03 09 00
[ 18.153106]
[ 18.153106] GPR04:
[ 18.153106] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153107] 00000010: 90 00 00 00 00 02 00 00 00 00 00 00 20 00 00 00
[ 18.153108] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153108] 00000000ffff7fff
[ 18.153108] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153109] c00000077fdc39a0
[ 18.153110] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153110] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x0, len: 192
[ 18.153110] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153111] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153112] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153112] 00000000: 00 00 00 25 00 01 1f 0c 00 00 00 00 00 03 07 00
[ 18.153113] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153114] 00000030: 00 00 00 00 86 00 68 02 25 00 01 25 00 00 c0 d2
[ 18.153115] 00000010: 90 00 00 00 00 02 00 00 00 00 00 00 20 00 00 00
[ 18.153115] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153115] c00000077fdc3998
[ 18.153116] 0000000000000027
[ 18.153116] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153117] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153117] 00000080: 08 00 00 00 c0 50 00 02 08 00 00 00 c0 70 00 02
[ 18.153118] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153119] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153119] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153119] 00000090: 08 00 00 00 c0 b0 00 02 08 00 00 00 c0 d0 00 02
[ 18.153120] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153120] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x0, len: 192
[ 18.153121] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153122]
[ 18.153122] GPR08:
[ 18.153122] 00000000: 00 00 00 25 00 01 25 0c 00 00 00 00 00 03 08 00
[ 18.153123] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153122] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153124] c00000077f357e18
[ 18.153125] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153125] 00000010: 90 00 00 00 00 02 00 00 00 00 00 00 20 00 00 00
[ 18.153126] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153126] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153127] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153128] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153128] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153129] 0000000000000001
[ 18.153129] mlx5_core 8007:01:00.0 enP32775p1s0: ERR CQE on ICOSQ: 0x10d
[ 18.153130] 0000000000000027
[ 18.153130] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153131] c0000000028e6d50
[ 18.153131] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153132] 00000080: 08 00 00 01 80 40 00 02 08 00 00 01 80 50 00 02
[ 18.153133] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153133] 00000090: 08 00 00 01 80 60 00 02 08 00 00 01 80 70 00 02
[ 18.153134] 00000080: 08 00 00 00 c0 60 00 02 08 00 00 00 c0 80 00 02
[ 18.153134] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153134] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153135] 00000080: 08 00 00 02 41 a0 00 02 08 00 00 02 41 f0 00 02
[ 18.153136]
[ 18.153136] GPR12:
[ 18.153136] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153138] 0000000000000000
[ 18.153138] 00000090: 08 00 00 00 c0 90 00 02 08 00 00 00 c0 a0 00 02
[ 18.153139] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153140] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153141] 00000090: 08 00 00 02 42 20 00 02 08 00 00 02 42 80 00 02
[ 18.153143] c00000077fff8e00
[ 18.153145] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153147] 0000000000000000
[ 18.153151] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153152] 0000000000000100
[ 18.153152] GPR16: 0000000000000100 000000000000012c ffffffffffffffff
c008000001d028ff
[ 18.153152] GPR20: c00000000c800000 c00000006db40040 c0000000686cb488
c0000000686cb518
[ 18.153152] GPR24: c0000000686cb4c0 0000000000000001 0000000000000000
c000000064aa8000
[ 18.153152] GPR28: c0000000686cb300 0000000000000003 0000000000000000
c00000000c800000
[ 18.153284] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x67e, ci 0x0, qn 0x113, opcode 0xd, syndrome 0x2, vendor syndrome 0x68
[ 18.153293] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x674, ci 0x0, qn 0x107, opcode 0xd, syndrome 0x2, vendor syndrome 0x68
[ 18.153297] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153301] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153303] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153305] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153306] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x692, ci 0x1, qn 0x12b, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153308] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153309] 00000030: 00 00 00 00 86 00 68 02 25 00 01 13 00 00 f6 d2
[ 18.153310] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153311] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x0, len: 192
[ 18.153313] 00000000: 00 00 00 25 00 01 13 0c 00 00 00 00 00 03 05 00
[ 18.153314] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153314] 00000010: 90 00 00 00 00 02 00 00 00 00 00 00 20 00 00 00
[ 18.153316] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153316] 00000030: 00 00 00 00 86 00 68 02 25 00 01 07 00 00 e2 d2
[ 18.153291] NIP [c008000001bf9118] mlx5e_poll_ico_cq+0x4a0/0x570
[mlx5_core]
[ 18.153324] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x0, len: 192
[ 18.153326] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153328] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153329] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153329] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 2b 00 03 5a d2
[ 18.153331] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x3, len: 192
[ 18.153331] 00000000: 00 00 00 25 00 01 07 0c 00 00 00 00 00 03 03 00
[ 18.153333] 00000010: 90 00 00 00 00 02 00 00 00 00 00 00 20 00 00 00
[ 18.153334] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153334] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153336] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153336] 00000000: 00 00 03 25 00 01 2b 0c 00 00 00 00 00 03 09 00
[ 18.153338] 00000010: 90 00 00 00 00 02 00 04 00 00 00 00 20 00 00 00
[ 18.153339] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153340] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153341] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153342] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153343] 00000080: 08 00 00 02 40 90 00 02 08 00 00 02 40 a0 00 02
[ 18.153344] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153344] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153345] 00000090: 08 00 00 02 40 b0 00 02 08 00 00 02 40 c0 00 02
[ 18.153346] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153346] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153347] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153347] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153347] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153349] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153349] 00000080: 08 00 00 00 0b 90 00 02 08 00 00 00 0b b0 00 02
[ 18.153349] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153351] 00000090: 08 00 00 00 0b d0 00 02 08 00 00 00 0b f0 00 02
[ 18.153351] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153352] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153353] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153354] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153357] 00000080: 08 00 00 00 c0 c0 00 02 08 00 00 00 c0 e0 00 02
[ 18.153359] 00000090: 08 00 00 00 c1 00 00 02 08 00 00 00 c1 10 00 02
[ 18.153362] LR [c008000001bf9114] mlx5e_poll_ico_cq+0x49c/0x570
[mlx5_core]
[ 18.153438] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153439] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153440] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x692, ci 0x2, qn 0x12b, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153442] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153443] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153444] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153445] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 2b 00 06 5c d2
[ 18.153446] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x6, len: 192
[ 18.153447] 00000000: 00 00 06 25 00 01 2b 0c 00 00 00 00 00 03 09 00
[ 18.153448] 00000010: 90 00 00 00 00 02 00 08 00 00 00 00 20 00 00 00
[ 18.153449] Call Trace:
[ 18.153451] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153451] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153472] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153474] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153477] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153478] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x688, ci 0x1, qn 0x11f, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153479] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153480] 00000080: 08 00 00 00 c1 30 00 02 08 00 00 00 c1 40 00 02
[ 18.153485] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153484] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x68d, ci 0x1, qn 0x125, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153487] 00000090: 08 00 00 00 c1 70 00 02 08 00 00 00 c1 80 00 02
[ 18.153488] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153489] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153489] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153454] [c00000077fdc3be0] [c008000001bf9114]
mlx5e_poll_ico_cq+0x49c/0x570 [mlx5_core]
[ 18.153492] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x692, ci 0x3, qn 0x12b, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153492] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153494] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153494] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x679, ci 0x1, qn 0x10d, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153496] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153497] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153497] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153498] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 1f 00 03 6e d2
[ 18.153499] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153499] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x3, len: 192
[ 18.153500] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153501] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153502] 00000000: 00 00 03 25 00 01 1f 0c 00 00 00 00 00 03 07 00
[ 18.153502] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 25 00 03 54 d2
[ 18.153504] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 0d 00 03 7c d2
[ 18.153505] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153505] WQE DUMP: WQ size 1024 WQ cur size 0, WQE index 0x3, len: 192
[ 18.153506] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x679, ci 0x2, qn 0x10d, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153507] 00000010: 90 00 00 00 00 02 00 04 00 00 00 00 20 00 00 00
[ 18.153507] 00000000: 00 00 03 25 00 01 25 0c 00 00 00 00 00 03 08 00
[ 18.153508] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153509] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 2b 00 09 52 d2
[ 18.153509] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153509] 00000010: 90 00 00 00 00 02 00 04 00 00 00 00 20 00 00 00
[ 18.153510] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153511] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153511] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x692, ci 0x4, qn 0x12b, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153511] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153512] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153513] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153513] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153514] 00000030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153514] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153514] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153515] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153516] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153516] 00000040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153516] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153516] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 0d 00 06 7a d2
[ 18.153518] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153519] 00000080: 08 00 00 01 80 80 00 02 08 00 00 01 80 90 00 02
[ 18.153519] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 2b 00 0c 50 d2
[ 18.153519] 00000050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153520] 00000090: 08 00 00 01 80 a0 00 02 08 00 00 01 80 b0 00 02
[ 18.153519] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x679, ci 0x3, qn 0x10d, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153521] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x692, ci 0x5, qn 0x12b, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153521] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153522] 00000060: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153522] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153523] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153523] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153524] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153524] 00000070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153526] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153526] 00000080: 08 00 00 02 42 90 00 02 08 00 00 02 42 a0 00 02
[ 18.153526] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153524] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x688, ci 0x2, qn 0x11f, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153528] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 0d 00 09 74 d2
[ 18.153528] 00000090: 08 00 00 02 42 b0 00 02 08 00 00 02 42 c0 00 02
[ 18.153528] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153529] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x67e, ci 0x1, qn 0x113, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153530] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153530] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 2b 00 0f 52 d2
[ 18.153531] (unreliable)
[ 18.153530] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x679, ci 0x4, qn 0x10d, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153530] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x674, ci 0x1, qn 0x107, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153532]
[ 18.153532] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153533] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x692, ci 0x6, qn 0x12b, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153534] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153534] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153534] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153535] 000000a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153536] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153537] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153537] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153537] 000000b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153538] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 13 00 03 62 d2
[ 18.153538] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153539] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153539] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153540] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153540] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x68d, ci 0x2, qn 0x125, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153540] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 0d 00 0c 76 d2
[ 18.153541] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153542] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153542] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 2b 00 12 4c d2
[ 18.153543] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153543] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x679, ci 0x5, qn 0x10d, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153543] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153544] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x67e, ci 0x2, qn 0x113, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153546] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 07 00 03 76 d2
[ 18.153548] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153548] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153549] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 1f 00 06 68 d2
[ 18.153549] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x674, ci 0x2, qn 0x107, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153550] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153551] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153552] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153551] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x688, ci 0x3, qn 0x11f, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153552] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153553] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 13 00 06 64 d2
[ 18.153554] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153555] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153555] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153555] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x67e, ci 0x3, qn 0x113, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153556] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 25 00 06 52 d2
[ 18.153557] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153558] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153558] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153558] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 0d 00 0f 74 d2
[ 18.153560] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153561] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x679, ci 0x6, qn 0x10d, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153564] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153565] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153565] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153566] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153567] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 1f 00 09 66 d2
[ 18.153567] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153568] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153568] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x688, ci 0x4, qn 0x11f, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153569] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153571] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 13 00 09 6a d2
[ 18.153572] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153571] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 07 00 06 70 d2
[ 18.153533] [c00000077fdc3cc0] [c008000001bfa534]
mlx5e_napi_poll+0x14c/0x730 [mlx5_core]
[ 18.153573] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153575] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153574] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x674, ci 0x3, qn 0x107, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153575] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 0d 00 12 6a d2
[ 18.153576] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 1f 00 0c 64 d2
[ 18.153578] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153578] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x688, ci 0x5, qn 0x11f, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153578] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x67e, ci 0x4, qn 0x113, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153581] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153581] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153582] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153583] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153584] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153585] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 1f 00 0f 66 d2
[ 18.153586] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153587] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153588] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153589] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 13 00 0c 68 d2
[ 18.153589] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x688, ci 0x6, qn 0x11f, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153592] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153593] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 07 00 09 7e d2
[ 18.153593] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153594] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153596] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 1f 00 12 78 d2
[ 18.153595] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x67e, ci 0x5, qn 0x113, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153598] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x674, ci 0x4, qn 0x107, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153602] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153605] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153607] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153616]
[ 18.153617] [c00000077fdc3d50] [c000000000add758] __napi_poll+0x68/0x2b0
[ 18.153621] [c00000077fdc3dd0] [c000000000addf9c]
net_rx_action+0x3bc/0x470
[ 18.153623] [c00000077fdc3ea0] [c000000000d3fb8c]
__do_softirq+0x15c/0x3d0
[ 18.153628] [c00000077fdc3f90] [c000000000016670]
do_softirq_own_stack+0x40/0x60
[ 18.153631] [c0000000035c39d0] [c00000000015ac28] irq_exit+0x178/0x1c0
[ 18.153635] [c0000000035c3a00] [c0000000000165cc] do_IRQ+0x1fc/0x260
[ 18.153637] [c0000000035c3a30] [c0000000000090e8]
hardware_interrupt_common_virt+0x218/0x220
[ 18.153640] --- interrupt: 500 at plpar_hcall_norets_notrace+0x18/0x2c
[ 18.153644] NIP: c0000000000f8740 LR: c000000000a3a528 CTR:
0000000000000000
[ 18.153645] REGS: c0000000035c3aa0 TRAP: 0500 Not tainted
(6.0.0-rc7-autotest-g46a275a56167)
[ 18.153647] MSR: 800000000280b033 <SF,VEC,VSX,EE,FP,ME,IR,DR,RI,LE>
CR: 24000284 XER: 00000000
[ 18.153658] CFAR: 0000000000000000 IRQMASK: 0
[ 18.153658] GPR00: 0000000000000000 c0000000035c3d40 c000000002a11500
0000000000000000
[ 18.153658] GPR04: 800400001060fc10 0000000000000000 0000000000000005
000000000000001b
[ 18.153658] GPR08: 0000000000000000 0000000000000090 0000000000000001
800400001060fc00
[ 18.153658] GPR12: 0000000000000000 c00000077fff8e00 0000000000000000
000000001ef02860
[ 18.153658] GPR16: 0000000000000000 0000000000000000 0000000000000000
0000000000000000
[ 18.153658] GPR20: 0000000000000000 0000000000000000 0000000000000000
c00000000296b658
[ 18.153658] GPR24: 0000000000000001 0000000439d30198 0000000000000000
0000000000000000
[ 18.153658] GPR28: 0000000000000001 0000000000000000 c000000002142098
c0000000021420a0
[ 18.153681] NIP [c0000000000f8740] plpar_hcall_norets_notrace+0x18/0x2c
[ 18.153683] LR [c000000000a3a528] check_and_cede_processor+0x48/0x60
[ 18.153687] --- interrupt: 500
[ 18.153688] [c0000000035c3d40] [c00000000001dc48]
__switch_to+0x2e8/0x490 (unreliable)
[ 18.153691] [c0000000035c3da0] [c000000000a3a97c]
dedicated_cede_loop+0x9c/0x1b0
[ 18.153694] [c0000000035c3df0] [c000000000a37044]
cpuidle_enter_state+0x364/0x570
[ 18.153697] [c0000000035c3e50] [c000000000a372f0] cpuidle_enter+0x50/0x70
[ 18.153700] [c0000000035c3e90] [c0000000001ca658] do_idle+0x3a8/0x420
[ 18.153702] [c0000000035c3f10] [c0000000001ca908]
cpu_startup_entry+0x38/0x40
[ 18.153705] [c0000000035c3f40] [c000000000066b00]
start_secondary+0x290/0x2a0
[ 18.153708] [c0000000035c3f90] [c00000000000d154]
start_secondary_prolog+0x10/0x14
[ 18.153713] Instruction dump:
[ 18.153714] 88bf0520
[ 18.153714] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x68d, ci 0x3, qn 0x125, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153715] 2b850005 419d0030
[ 18.153717] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153717] 3d220000 e929a980
[ 18.153718] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153719] 78a51f24
[ 18.153720] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153720] 7ca9282a
[ 18.153721] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 25 00 09 5c d2
[ 18.153721] 3c620000
[ 18.153723] e863a990 7e84a378
[ 18.153723] mlx5_core 8007:01:00.0 enP32775p1s0: Error cqe on cqn
0x68d, ci 0x4, qn 0x125, opcode 0xd, syndrome 0x5, vendor syndrome 0xf9
[ 18.153724] 48096c69 e8410018
[ 18.153726] 00000000: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153726] <0fe00000> fa410070
[ 18.153727] 00000010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153728] 89330002
[ 18.153729] 00000020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 18.153729] 2f890000
[ 18.153730] 00000030: 00 00 00 00 86 00 f9 05 25 00 01 25 00 0c 5e d2
[ 18.153730] ---[ end trace 0000000000000000 ]---
--
Regards,
Tasmiya Nalatwad
IBM Linux Technology Center