System crashes during shutdown due to kernel BUG at drivers/pci/msi.c:355

Solution Verified - Updated -

Issue

  • Upon every shutdown, the system simply crashes with the following traces:
[  138.751900] kernel BUG at drivers/pci/msi.c:355!
[  138.751940] invalid opcode: 0000 [#1] SMP 
[  138.751982] Modules linked in: fuse macsec tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag binfmt_misc tun ip_set nfnetlink bridge stp llc vfat fat ib_isert iscsi_target_mod ib_srpt target_core_mod ib_srp scsi_transport_srp scsi_tgt ib_ipoib ib_ucm ib_umad skx_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass ipmi_ssif crc32_pclmul ghash_clmulni_intel aesni_intel rpcrdma lrw gf128mul sunrpc glue_helper ablk_helper cryptd rdma_ucm ib_uverbs ib_iser rdma_cm iw_cm ib_cm libiscsi scsi_transport_iscsi ipmi_si wmi ipmi_devintf ipmi_msghandler bnxt_re ib_core hpwdt pcspkr ses enclosure sg acpi_power_meter mei_me mei hpilo lpc_ich shpchp xfs libcrc32c sd_mod crc_t10dif crct10dif_generic sr_mod cdrom uas usb_storage mgag200 i2c_algo_bit drm_kms_helper syscopyarea
[  138.752855]  sysfillrect sysimgblt fb_sys_fops ttm drm crct10dif_pclmul crct10dif_common crc32c_intel ahci bnxt_en smartpqi libahci scsi_transport_sas tg3 libata devlink i2c_core ptp pps_core dm_mirror dm_region_hash dm_log dm_mod [last unloaded: ip_tables]
[  138.753120] CPU: 13 PID: 5849 Comm: poweroff Kdump: loaded Not tainted 3.10.0-862.11.6.el7.x86_64 #1
[  138.753189] Hardware name: HPE ProLiant DL380 Gen10/ProLiant DL380 Gen10, BIOS U30 06/15/2018
[  138.753254] task: ffffa0e3c0bd1fa0 ti: ffffa0e3d7af8000 task.ti: ffffa0e3d7af8000
[  138.753311] RIP: 0010:[<ffffffffbdfb6738>]  [<ffffffffbdfb6738>] free_msi_irqs+0x188/0x190
[  138.753386] RSP: 0018:ffffa0e3d7afbd10  EFLAGS: 00010282
[  138.753428] RAX: ffffa0ddc8d74600 RBX: 0000000000000000 RCX: ffffa0ddc8d74600
[  138.753483] RDX: ffffa0ddc8d74600 RSI: 0000000000000000 RDI: 0000000000000000
[  138.753538] RBP: ffffa0e3d7afbd38 R08: 0000000000000002 R09: 0000000000000146
[  138.753592] R10: 0000000000000001 R11: 0000000000000400 R12: ffffa0e3d9a963c0
[  138.753647] R13: ffffa0e4742e8870 R14: ffffa0e4742e8000 R15: 00000000fee1dead
[  138.753703] FS:  00007fd5f6763880(0000) GS:ffffa0ebdf040000(0000) knlGS:0000000000000000
[  138.753765] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  138.753810] CR2: 00007f6c2a89e270 CR3: 0000000800b56000 CR4: 00000000007607e0
[  138.753865] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[  138.753920] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[  138.753973] PKRU: 55555554
[  138.753997] Call Trace:
[  138.754029]  [<ffffffffbdfb7bbd>] pci_disable_msix+0x3d/0x50
[  138.754090]  [<ffffffffc051abec>] bnxt_clear_int_mode+0x1c/0x40 [bnxt_en]
[  138.754153]  [<ffffffffc051ac88>] bnxt_shutdown+0x78/0xa0 [bnxt_en]
[  138.754211]  [<ffffffffbdf9c68a>] pci_device_shutdown+0x3a/0x60
[  138.754263]  [<ffffffffbe07588b>] device_shutdown+0xfb/0x1f0
[  138.754313]  [<ffffffffbdcadaf5>] kernel_power_off+0x35/0x80
[  138.754361]  [<ffffffffbdcafb9b>] SYSC_reboot+0x18b/0x260
[  138.754409]  [<ffffffffbddcae3d>] ? handle_mm_fault+0x39d/0x9b0
[  138.754461]  [<ffffffffbdcafcde>] SyS_reboot+0xe/0x10
[  138.754508]  [<ffffffffbe32579b>] system_call_fastpath+0x22/0x27
[  138.754556] Code: 00 00 e8 8c 3e e4 ff 49 c7 86 88 08 00 00 00 00 00 00 5b 41 5c 41 5d 41 5e 41 5f 5d c3 48 8b 7b 28 e8 3d b7 cb ff e9 35 ff ff ff <0f> 0b 66 0f 1f 44 00 00 0f 1f 44 00 00 31 c0 f6 07 10 8b 4f 08 
[  138.754961] RIP  [<ffffffffbdfb6738>] free_msi_irqs+0x188/0x190
[  138.755016]  RSP <ffffa0e3d7afbd10>

Environment

  • Red Hat Enterprise Linux 7.5
  • Broadcom network driver bnxt_en

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content