RHEL 7 crash using i40e driver with error: kernel BUG at drivers/pci/msi.c:355!

Solution Verified - Updated -

Issue

  • A RHEL 7 system crashes with a backtrace much like the following:

    [ 2369.908075] ------------[ cut here ]------------
    [ 2369.908077] kernel BUG at drivers/pci/msi.c:355!
    [ 2369.908081] invalid opcode: 0000 [#1] SMP 
    [ 2369.908148] Modules linked in: fuse xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT nf_reject_ipv4 tun bridge stp llc ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter devlink rpcrdma ib_isert iscsi_target_mod ib_iser libiscsi scsi_transport_iscsi ib_srpt target_core_mod vfat fat skx_edac intel_powerclamp coretemp intel_rapl ib_srp iosf_mbi scsi_transport_srp kvm_intel scsi_tgt iTCO_wdt iTCO_vendor_support kvm ib_ipoib irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul rdma_ucm glue_helper ablk_helper cryptd ib_ucm ipmi_ssif ib_uverbs ib_umad rdma_cm ib_cm joydev pcspkr cdc_ether usbnet mii sg iw_cm mei_me lpc_ich i2c_i801 mei shpchp wmi
    [ 2369.908185]  i40iw ib_core ipmi_si ipmi_devintf ipmi_msghandler nfit libnvdimm acpi_power_meter acpi_pad nfsd auth_rpcgss nfs_acl lockd grace sunrpc binfmt_misc ip_tables xfs libcrc32c sd_mod crc_t10dif crct10dif_generic mgag200 i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops crct10dif_pclmul crct10dif_common ttm crc32c_intel drm megaraid_sas i40e ahci libahci libata be2net ptp pps_core i2c_core dm_mirror dm_region_hash dm_log dm_mod
    [ 2369.908190] CPU: 3 PID: 7683 Comm: kworker               ------------ T 3.10.0-862.el7.x86_64 #1
    [ 2369.908192] Hardware name:
    [ 2369.908202] Workqueue: events_unbound async_run_entry_fn
    [ 2369.908204] task: ffff9f27ab370000 ti: ffff9f27fee1c000 task.ti: ffff9f27fee1c000
    [ 2369.908212] RIP: 0010:[<ffffffff8e9b1b18>]  [<ffffffff8e9b1b18>] free_msi_irqs+0x188/0x190
    [ 2369.908214] RSP: 0018:ffff9f27fee1fc88  EFLAGS: 00010286
    [ 2369.908216] RAX: ffff9f37f974f300 RBX: 0000000000000000 RCX: ffff9f37f974f300
    [ 2369.908218] RDX: ffff9f37f974f300 RSI: 0000000000000000 RDI: 0000000000000000
    [ 2369.908219] RBP: ffff9f27fee1fcb0 R08: 0000000000000002 R09: 0000000000000146
    [ 2369.908221] R10: 0000000000000000 R11: 0000000000000001 R12: ffff9f37f9353140
    [ 2369.908222] R13: ffff9f57fca6b870 R14: ffff9f57fca6b000 R15: ffffffff8f0a82b7
    [ 2369.908225] FS:  0000000000000000(0000) GS:ffff9f37fcac0000(0000) knlGS:0000000000000000
    [ 2369.908227] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
    [ 2369.908229] CR2: 0000000002d7e4f0 CR3: 00000034dcc0e000 CR4: 00000000007607e0
    [ 2369.908231] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
    [ 2369.908232] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
    [ 2369.908233] PKRU: 00000000
    [ 2369.908234] Call Trace:
    [ 2369.908240]  [<ffffffff8e9b2f9d>] pci_disable_msix+0x3d/0x50
    [ 2369.908256]  [<ffffffffc042ad68>] i40e_reset_interrupt_capability+0x58/0xa0 [i40e]
    [ 2369.908269]  [<ffffffffc042cc11>] i40e_clear_interrupt_scheme+0xd1/0xe0 [i40e]
    [ 2369.908286]  [<ffffffffc043370b>] i40e_suspend+0xab/0xb0 [i40e]
    [ 2369.908291]  [<ffffffff8e99871f>] pci_pm_suspend+0x6f/0x150
    [ 2369.908295]  [<ffffffff8e9986b0>] ? pci_pm_freeze+0xf0/0xf0
    [ 2369.908300]  [<ffffffff8ea7f6c6>] dpm_run_callback+0x46/0x90
    [ 2369.908303]  [<ffffffff8ea7fadb>] __device_suspend+0xfb/0x2a0
    [ 2369.908306]  [<ffffffff8ea7fc9f>] async_suspend+0x1f/0xa0
    [ 2369.908311]  [<ffffffff8e6c21df>] async_run_entry_fn+0x3f/0x130
    [ 2369.908316]  [<ffffffff8e6b2dff>] process_one_work+0x17f/0x440
    [ 2369.908320]  [<ffffffff8e6b3ac6>] worker_thread+0x126/0x3c0
    [ 2369.908324]  [<ffffffff8e6b39a0>] ? manage_workers.isra.24+0x2a0/0x2a0
    [ 2369.908330]  [<ffffffff8e6bae31>] kthread+0xd1/0xe0
    [ 2369.908335]  [<ffffffff8e6bad60>] ? insert_kthread_work+0x40/0x40
    [ 2369.908343]  [<ffffffff8ed1f61d>] ret_from_fork_nospec_begin+0x7/0x21
    [ 2369.908347]  [<ffffffff8e6bad60>] ? insert_kthread_work+0x40/0x40
    [ 2369.908389] Code: 00 00 e8 ec 4f e4 ff 49 c7 86 88 08 00 00 00 00 00 00 5b 41 5c 41 5d 41 5e 41 5f 5d c3 48 8b 7b 28 e8 3d da cb ff e9 35 ff ff ff <0f> 0b 66 0f 1f 44 00 00 0f 1f 44 00 00 31 c0 f6 07 10 8b 4f 08 
    [ 2369.908393] RIP  [<ffffffff8e9b1b18>] free_msi_irqs+0x188/0x190
    [ 2369.908394]  RSP <ffff9f27fee1fc88>
    

Environment

  • Red Hat Enterprise Linux 7.5
  • i40e module

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content