RHEL 7.4 crash in free_msi_irqs() during shutdown/reboot following fresh install
Issue
System crashes with kernel messages
[ 85.261662] kernel BUG at drivers/pci/msi.c:350!
[ 85.261832] Oops: Exception in kernel mode, sig: 5 [#1]
[ 85.262033] SMP NR_CPUS=2048 NUMA PowerNV
[ 85.262166] Modules linked in: ip_set nfnetlink bridge stp llc i2c_dev ofpart ipmi_powernv powernv_flash ipmi_devintf mtd ipmi_msghandler ibmpowernv opal_prd powernv_rng at24 i2c_opal bnx2x mdio shpchp xfs libcrc32c ast i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm tg3 ptp i2c_core pps_core nvme nvme_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
[ 85.263575] CPU: 52 PID: 41118 Comm: reboot Not tainted 3.10.0-693.el7.ppc64le #1
[ 85.263817] task: c00005fd30545580 ti: c00005fd2f72c000 task.ti: c00005fd2f72c000
[ 85.264103] NIP: c00000000057fe70 LR: c00000000057fe60 CTR: 0000000000000000
[ 85.264385] REGS: c00005fd2f72f7b0 TRAP: 0700 Not tainted (3.10.0-693.el7.ppc64le)
[ 85.264669] MSR: 9000000100029033 <SF,HV,EE,ME,IR,DR,RI,LE> CR: 42084828 XER: 20000000
[ 85.265014] CFAR: c0000000001dac14 SOFTE: 1
GPR00: c00000000057fe60 c00005fd2f72fa30 c00000000120ee00 c00001fd27651000
GPR04: 0000000000000207 c00000000008cd60 9000000100009033 c000000001269ce0
GPR08: 0000000000000002 0000000000000001 c00005fd357370ff 9000000100001003
GPR12: c00000000008256c c000000007b3d400 0000000000000000 c00001fd17d40000
GPR16: 0000000000000004 0000000000000008 0000000000000000 0000000000000000
GPR20: 0000000000000004 c00001fd28ee5c38 fffffffffffff000 d000000311eaf430
GPR24: c00001fd28ee59d0 c00001fd28ee5a20 0000000000001770 c00001fffe299000
GPR28: c00001fffe299880 c00001fffe299880 0000000000000000 c00001fd27660840
[ 85.267247] NIP [c00000000057fe70] free_msi_irqs+0x90/0x210
[ 85.267465] LR [c00000000057fe60] free_msi_irqs+0x80/0x210
[ 85.267670] Call Trace:
[ 85.267773] [c00005fd2f72fa30] [c00000000057fe60] free_msi_irqs+0x80/0x210 (unreliable)
[ 85.268064] [c00005fd2f72fa80] [c00000000058156c] pci_disable_msix+0x11c/0x140
[ 85.268318] [c00005fd2f72fad0] [d000000312162b78] nvme_dev_disable+0x658/0x750 [nvme]
[ 85.268612] [c00005fd2f72fbc0] [c00000000055f1f0] pci_device_shutdown+0x60/0xd0
[ 85.268878] [c00005fd2f72fc00] [c00000000063638c] device_shutdown+0x15c/0x2b0
[ 85.269111] [c00005fd2f72fca0] [c00000000010781c] SyS_reboot+0x21c/0x4a0
[ 85.269384] [c00005fd2f72fe30] [c00000000000a184] system_call+0x38/0xb4
[ 85.269620] Instruction dump:
[ 85.269738] 48000014 60000000 60000000 60420000 815f000c 7c695214 78630020 4bc5ad8d
[ 85.270046] 60000000 e9230150 3149ffff 7d2a4910 <0b090000> 815f0010 393e0001 7d3e07b4
Environment
- Red Hat Enterprise Linux 7
- PowerPC64-LE architecture
- kernel version 3.10.0-693.el7.ppc64le
- NVMe disk drives (nvme driver exposes the bug in MSI)
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.