[linux][5.19.0][SRIOV/HNV] WARNING: CPU: 3 PID: 3873 at arch/powerpc/kernel/iommu.c:830 iommu_tce_table_put+0x20/0x170

From: Tasmiya Nalatwad
Date: Wed Aug 17 2022 - 04:30:45 EST

Greetings,

[linux][5.19.0][SRIOV/HNV] WARNING: CPU: 3 PID: 3873 at arch/powerpc/kernel/iommu.c:830 iommu_tce_table_put+0x20/0x170

Continuous WARN_ONs are seen when SRIOV device remove operation is performed after adding the SRIOV device

--- Call Traces ---
[ 645.034242] ------------[ cut here ]------------
[ 645.034247] WARNING: CPU: 3 PID: 3873 at arch/powerpc/kernel/iommu.c:830 iommu_tce_table_put+0x20/0x170
[ 645.034258] Modules linked in: rpcrdma sunrpc rdma_ucm ib_srpt ib_isert iscsi_target_mod target_core_mod ib_iser ib_umad rdma_cm ib_ipoib iw_cm libiscsi ib_cm scsi_transport_iscsi mlx5_ib ib_uverbs ib_core mlx5_core mlxfw psample ptp pps_core rpadlpar_io rpaphp tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag bonding rfkill xts vmx_crypto pseries_rng sch_fq_codel binfmt_misc ip_tables ext4 mbcache jbd2 dm_service_time sd_mod t10_pi crc64_rocksoft crc64 sg ibmvfc scsi_transport_fc ibmveth dm_multipath dm_mirror dm_region_hash dm_log dm_mod fuse
[ 645.034301] CPU: 3 PID: 3873 Comm: drmgr Not tainted 5.19.0-autotest-geb555cb5b794 #1
[ 645.034305] NIP: c000000000062380 LR: c0000000000fd9e8 CTR: c000000000060720
[ 645.034307] REGS: c000000053d87790 TRAP: 0700 Not tainted (5.19.0-autotest-geb555cb5b794)
[ 645.034311] MSR: 8000000000029033 <SF,EE,ME,IR,DR,RI,LE> CR: 24002244 XER: 20040000
[ 645.034320] CFAR: c0000000000fd9e4 IRQMASK: 0
[ 645.034320] GPR00: c0000000000fd9e8 c000000053d87a30 c000000002a10700 0000000000000000
[ 645.034320] GPR04: c00c000000036ac0 c00000000dab0830 c00000000dab0830 0000000000000001
[ 645.034320] GPR08: 027ffff000000201 0000000000000001 0000000000000001 fffffffffffffffd
[ 645.034320] GPR12: 0000000000002000 c00000077fff8e80 0000000000000000 0000000000000000
[ 645.034320] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 645.034320] GPR20: 0000000000000000 0000000136dc20f8 0000000136dbee08 0000000000000006
[ 645.034320] GPR24: 0000000000000000 00000001749423fd c000000002970418 c000000053d87b50
[ 645.034320] GPR28: 0000000000000002 0000000000000000 c000000009781500 c000000054f1a2c0
[ 645.034363] NIP [c000000000062380] iommu_tce_table_put+0x20/0x170
[ 645.034366] LR [c0000000000fd9e8] iommu_reconfig_notifier+0x98/0x220
[ 645.034370] Call Trace:
[ 645.034372] [c000000053d87a30] [c0000000659eec00] 0xc0000000659eec00 (unreliable)
[ 645.034376] [c000000053d87aa0] [c0000000000fd9d4] iommu_reconfig_notifier+0x84/0x220
[ 645.034381] [c000000053d87ae0] [c00000000018e174] blocking_notifier_call_chain+0xa4/0x110
[ 645.034385] [c000000053d87b30] [c000000000a76f6c] of_detach_node+0xbc/0x100
[ 645.034389] [c000000053d87b90] [c0000000000f9fc8] ofdt_write+0x898/0x1050
[ 645.034393] [c000000053d87c60] [c0000000005656dc] proc_reg_write+0x10c/0x1b0
[ 645.034398] [c000000053d87c90] [c000000000493cc4] vfs_write+0x104/0x460
[ 645.034402] [c000000053d87d50] [c0000000004941fc] ksys_write+0x7c/0x140
[ 645.034406] [c000000053d87da0] [c000000000033b88] system_call_exception+0x198/0x430
[ 645.034410] [c000000053d87e10] [c00000000000c63c] system_call_common+0xec/0x250
[ 645.034414] --- interrupt: c00 at 0x20002a31bd74
[ 645.034417] NIP: 000020002a31bd74 LR: 0000000136da3804 CTR: 0000000000000000
[ 645.034419] REGS: c000000053d87e80 TRAP: 0c00 Not tainted (5.19.0-autotest-geb555cb5b794)
[ 645.034423] MSR: 800000000200d033 <SF,VEC,EE,PR,ME,IR,DR,RI,LE> CR: 24002402 XER: 00000000
[ 645.034430] IRQMASK: 0
[ 645.034430] GPR00: 0000000000000004 00007ffff4a44ec0 000020002a417100 0000000000000006
[ 645.034430] GPR04: 00007ffff4a44f68 0000000000000020 0000000000000000 00000001749423fd
[ 645.034430] GPR08: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 645.034430] GPR12: 0000000000000000 0000200029f5b520 0000000000000000 0000000000000000
[ 645.034430] GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 645.034430] GPR20: 0000000000000000 0000000136dc20f8 0000000136dbee08 0000000136dbcfd0
[ 645.034430] GPR24: 0000000136dc1dc8 0000000136dc20c8 0000000136dbcfd0 0000000136dbd038
[ 645.034430] GPR28: 0000000000000020 0000000000000006 00000001749423d8 00007ffff4a44f68
[ 645.034463] NIP [000020002a31bd74] 0x20002a31bd74
[ 645.034465] LR [0000000136da3804] 0x136da3804
[ 645.034467] --- interrupt: c00
[ 645.034469] Instruction dump:
[ 645.034471] 4e800020 60000000 60000000 60000000 3c4c029b 3842e3a0 7c0802a6 60000000
[ 645.034477] 7c690074 fbc1fff0 f821ff91 7929d182 <0b090000> fbe10068 7c7f1b78 38630330
[ 645.034483] ---[ end trace 0000000000000000 ]---

--
Regards,
Tasmiya Nalatwad
IBM Linux Technology Center