Soft lockup on kworker in using i40e network driver in Red Hat Enterprise Linux 7.4
Issue
- The
thread soft lockup messages
are printed invar/log/messages
.
kernel: NMI watchdog: BUG: soft lockup - CPU#21 stuck for 22s! [kworker/u162:2:4347]
kernel: Modules linked in: dm_round_robin 8021q garp mrp ebt_arp ebt_among vhost_net vhost macvtap macvlan tun vfio_pci vfio_iommu_type1 vfio i40evf ip6table_filter ip6_tables iptable_filter ebtable_filter ebtables iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi xfs skx_edac edac_core intel_powerclamp coretemp intel_rapl libcrc32c iosf_mbi kvm_intel kvm dm_service_time irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ses enclosure ipmi_si ipmi_devintf sg pcspkr hpilo hpwdt ipmi_msghandler wmi mei_me mei acpi_power_meter shpchp lpc_ich nfsd auth_rpcgss dm_multipath dm_mod nfs_acl lockd grace br_netfilter bridge sunrpc stp llc ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic uas usb_storage sr_mod cdrom mgag200 i2c_algo_bit drm_kms_helper
kernel: syscopyarea sysfillrect sysimgblt fb_sys_fops ttm crct10dif_pclmul crct10dif_common drm crc32c_intel i40e serio_raw tg3 ahci libahci smartpqi libata scsi_transport_sas ptp i2c_core pps_core
kernel: CPU: 21 PID: 4347 Comm: kworker/u162:2 Tainted: G L ------------ 3.10.0-693.5.2.el7.x86_64 #1
kernel: Hardware name: HPE ProLiant DL380 Gen10/ProLiant DL380 Gen10, BIOS U30 06/15/2018
kernel: Workqueue: i40e i40e_service_task [i40e]
kernel: task: ffff887f3e526eb0 ti: ffff887f38458000 task.ti: ffff887f38458000
kernel: RIP: 0010:[<ffffffff810fa3de>] [<ffffffff810fa3de>] native_queued_spin_lock_slowpath+0x1be/0x1e0
kernel: RSP: 0018:ffff887f3845bc70 EFLAGS: 00000202
kernel: RAX: 0000000000000001 RBX: 000000000000000f RCX: 0000000000000001
kernel: RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff887f3ab65220
kernel: RBP: ffff887f3845bc70 R08: 0000000000000101 R09: 000000000000fffd
kernel: R10: 0000000000000000 R11: ffff887f3845bb4e R12: 0000000000000003
kernel: R13: ffff887f3845bc40 R14: 000000000000ffff R15: ffffffff8132f6b1
kernel: FS: 0000000000000000(0000) GS:ffff887f3ea40000(0000) knlGS:0000000000000000
kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
kernel: CR2: 00007f12bf7c4248 CR3: 00000000019f2000 CR4: 00000000003427e0
kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
kernel: Stack:
kernel: ffff887f3845bc80 ffffffff8169e6bf ffff887f3845bc90 ffffffff816abc53
kernel: ffff887f3845bd40 ffffffffc016fa30 ffff887f3777e000 ffff887f3ab64dd0
kernel: 0000000000001000 ffff887f00000100 00000000ff09dd20 ffff887f373ee000
kernel: Call Trace:
kernel: [<ffffffff8169e6bf>] queued_spin_lock_slowpath+0xb/0xf
kernel: [<ffffffff816abc53>] _raw_spin_lock_bh+0x33/0x40
kernel: [<ffffffffc016fa30>] i40e_sync_vsi_filters+0x820/0xe70 [i40e]
kernel: [<ffffffff816a77e2>] ? mutex_lock+0x12/0x2f
kernel: [<ffffffffc01700f2>] i40e_sync_filters_subtask+0x72/0x90 [i40e]
kernel: [<ffffffffc0177533>] i40e_service_task+0x183/0x14d0 [i40e]
kernel: [<ffffffff810ce55e>] ? dequeue_task_fair+0x41e/0x660
kernel: [<ffffffff810a5dce>] ? move_linked_works+0x5e/0x90
kernel: [<ffffffff810a64bf>] ? pwq_activate_delayed_work+0x3f/0xb0
kernel: [<ffffffff810a882a>] process_one_work+0x17a/0x440
kernel: [<ffffffff810a94f6>] worker_thread+0x126/0x3c0
kernel: [<ffffffff810a93d0>] ? manage_workers.isra.24+0x2a0/0x2a0
kernel: [<ffffffff810b099f>] kthread+0xcf/0xe0
kernel: [<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
kernel: [<ffffffff816b4fd8>] ret_from_fork+0x58/0x90
kernel: [<ffffffff810b08d0>] ? insert_kthread_work+0x40/0x40
kernel: Code: 37 81 fe 00 01 00 00 74 f4 e9 95 fe ff ff 0f 1f 80 00 00 00 00 83 fa 01 75 11 0f 1f 00 e9 69 fe ff ff 0f 1f 00 85 c0 74 0c f3 90 <8b> 07 0f b6 c0 83 f8 03 75 f0 b8 01 00 00 00 66 89 07 5d c3 f3
Environment
- Red Hat Enterprise Linux 7.4
- i40e driver
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.