Soft lockup on kworker in using i40e network driver in Red Hat Enterprise Linux 7.4

Solution Verified - Updated -

Issue

  • The thread soft lockup messages are printed in var/log/messages.
kernel: NMI watchdog: BUG: soft lockup - CPU#21 stuck for 22s! [kworker/u162:2:4347]
kernel: Modules linked in: dm_round_robin 8021q garp mrp ebt_arp ebt_among vhost_net vhost macvtap macvlan tun vfio_pci vfio_iommu_type1 vfio i40evf ip6table_filter ip6_tables iptable_filter ebtable_filter ebtables iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi xfs skx_edac edac_core intel_powerclamp coretemp intel_rapl libcrc32c iosf_mbi kvm_intel kvm dm_service_time irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ses enclosure ipmi_si ipmi_devintf sg pcspkr hpilo hpwdt ipmi_msghandler wmi mei_me mei acpi_power_meter shpchp lpc_ich nfsd auth_rpcgss dm_multipath dm_mod nfs_acl lockd grace br_netfilter bridge sunrpc stp llc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic uas usb_storage sr_mod cdrom mgag200 i2c_algo_bit drm_kms_helper
kernel: syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel i40e serio_raw tg3 ahci libahci smartpqi libata scsi_transport_sas ptp i2c_core pps_core
kernel: CPU: 21 PID: 4347 Comm: kworker/u162:2 Tainted: G             L ------------   3.10.0-693.5.2.el7.x86_64 #1
kernel: Hardware name: HPE ProLiant DL380 Gen10/ProLiant DL380 Gen10, BIOS U30 06/15/2018
kernel: Workqueue: i40e i40e_service_task [i40e]
kernel: task: ffff887f3e526eb0 ti: ffff887f38458000 task.ti: ffff887f38458000
kernel: RIP: 0010:[<ffffffff810fa3de>]  [<ffffffff810fa3de>] native_queued_spin_lock_slowpath+0x1be/0x1e0
kernel: RSP: 0018:ffff887f3845bc70  EFLAGS: 00000202
kernel: RAX: 0000000000000001 RBX: 000000000000000f RCX: 0000000000000001
kernel: RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff887f3ab65220
kernel: RBP: ffff887f3845bc70 R08: 0000000000000101 R09: 000000000000fffd
kernel: R10: 0000000000000000 R11: ffff887f3845bb4e R12: 0000000000000003
kernel: R13: ffff887f3845bc40 R14: 000000000000ffff R15: ffffffff8132f6b1
kernel: FS:  0000000000000000(0000) GS:ffff887f3ea40000(0000) knlGS:0000000000000000
kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
kernel: CR2: 00007f12bf7c4248 CR3: 00000000019f2000 CR4: 00000000003427e0
kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
kernel: Stack:
kernel: ffff887f3845bc80 ffffffff8169e6bf ffff887f3845bc90 ffffffff816abc53
kernel: ffff887f3845bd40 ffffffffc016fa30 ffff887f3777e000 ffff887f3ab64dd0
kernel: 0000000000001000 ffff887f00000100 00000000ff09dd20 ffff887f373ee000
kernel: Call Trace:
kernel: [<ffffffff8169e6bf>] queued_spin_lock_slowpath+0xb/0xf
kernel: [<ffffffff816abc53>] _raw_spin_lock_bh+0x33/0x40
kernel: [<ffffffffc016fa30>] i40e_sync_vsi_filters+0x820/0xe70 [i40e]
kernel: [<ffffffff816a77e2>] ? mutex_lock+0x12/0x2f
kernel: [<ffffffffc01700f2>] i40e_sync_filters_subtask+0x72/0x90 [i40e]
kernel: [<ffffffffc0177533>] i40e_service_task+0x183/0x14d0 [i40e]
kernel: [<ffffffff810ce55e>] ? dequeue_task_fair+0x41e/0x660
kernel: [<ffffffff810a5dce>] ? move_linked_works+0x5e/0x90
kernel: [<ffffffff810a64bf>] ? pwq_activate_delayed_work+0x3f/0xb0
kernel: [<ffffffff810a882a>] process_one_work+0x17a/0x440
kernel: [<ffffffff810a94f6>] worker_thread+0x126/0x3c0
kernel: [<ffffffff810a93d0>] ? manage_workers.isra.24+0x2a0/0x2a0
kernel: [<ffffffff810b099f>] kthread+0xcf/0xe0
kernel: [<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
kernel: [<ffffffff816b4fd8>] ret_from_fork+0x58/0x90
kernel: [<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
kernel: Code: 37 81 fe 00 01 00 00 74 f4 e9 95 fe ff ff 0f 1f 80 00 00 00 00 83 fa 01 75 11 0f 1f 00 e9 69 fe ff ff 0f 1f 00 85 c0 74 0c f3 90 <8b> 07 0f b6 c0 83 f8 03 75 f0 b8 01 00 00 00 66 89 07 5d c3 f3

Environment

  • Red Hat Enterprise Linux 7.4
  • i40e driver

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content