RHEL7: Soft lockup occurred at mfe_fileaccess_wake_up_all_events_and_reset_scanningQueue().
Issue
- Server rebooted due to kernel panic with below logs:
[6215420.764559] NMI watchdog: BUG: soft lockup - CPU#18 stuck for 22s! [Broker KM Evnt:4084]
[6215420.765386] Modules linked in: mfe_fileaccess_100609126(OE) iptable_filter team_mode_roundrobin team xfs libcrc32c vfat fat dm_service_time sb_edac intel_powerclamp coretemp intel_rapl iosf_mbi kvm_intel kvm irqbypass crc32_pclmul iTCO_wdt iTCO_vendor_support ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ipmi_ssif pcspkr lpc_ich i2c_i801 ioatdma hpwdt hpilo dca dm_multipath sg wmi ipmi_si ipmi_devintf pcc_cpufreq ipmi_msghandler acpi_power_meter binfmt_misc ip_tables ext4 mbcache jbd2 sd_mod mgag200 lpfc i2c_algo_bit drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm drm nvmet_fc nvmet crc32c_intel crc_t10dif crct10dif_generic crct10dif_pclmul nvme_fc hpsa nvme_fabrics nvme_core be2net scsi_transport_fc drm_panel_orientation_quirks scsi_transport_sas scsi_tgt
[6215420.765428] crct10dif_common dm_mirror dm_region_hash dm_log dm_mod
[6215420.765433] CPU: 18 PID: 4084 Comm: Broker KM Evnt Kdump: loaded Tainted: G OEL ------------ 3.10.0-1062.9.1.el7.x86_64 #1
[6215420.765435] Hardware name: HP ProLiant BL460c Gen9, BIOS I36 10/17/2018
[6215420.765437] task: ffff933f844e41c0 ti: ffff934708284000 task.ti: ffff934708284000
[6215420.765439] RIP: 0010:[<ffffffffc06b9588>] [<ffffffffc06b9588>] mfe_fileaccess_wake_up_all_events_and_reset_scanningQueue+0x298/0x4f0 [mfe_fileaccess_100609126]
[6215420.765443] RSP: 0018:ffff934708287bb0 EFLAGS: 00000212
[6215420.765445] RAX: ffff93471bac6690 RBX: ffff934708287b40 RCX: ffff933fcf7e48b0
[6215420.765447] RDX: 0000000000000001 RSI: 00000000241c9fa6 RDI: ffffffffc06c35ec
[6215420.765449] RBP: ffff934708287bf0 R08: 8800000000000000 R09: 8000000000000000
[6215420.765451] R10: be20000000000000 R11: 0001ceea2d3557c4 R12: ffffffff8b8e10f6
[6215420.765453] R13: ffff934708287bb0 R14: 0000000000000000 R15: 0000000000000000
[6215420.765456] FS: 00007f421bfff700(0000) GS:ffff934edf380000(0000) knlGS:0000000000000000
[6215420.765458] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[6215420.765460] CR2: 00007f7208cd4907 CR3: 00000001e77ba000 CR4: 00000000001607e0
[6215420.765461] Call Trace:
[6215420.765466] [<ffffffff8be8d400>] netlink_unicast+0x170/0x210
[6215420.765469] [<ffffffff8be8d7a8>] netlink_sendmsg+0x308/0x420
[6215420.765473] [<ffffffff8be2f3a6>] sock_sendmsg+0xb6/0xf0
[6215420.765476] [<ffffffff8ba55657>] ? path_get+0x27/0x30
[6215420.765480] [<ffffffff8be2fad1>] SYSC_sendto+0x121/0x1c0
[6215420.765484] [<ffffffff8b93dd0a>] ? audit_filter_inodes+0xda/0x130
[6215420.765487] [<ffffffff8be315ee>] SyS_sendto+0xe/0x10
[6215420.765490] [<ffffffff8bf8dede>] system_call_fastpath+0x25/0x2a
[6215420.765492] Code: 48 8b 05 54 9b 00 00 48 8b 40 08 48 8b 18 48 85 db 74 1d 48 3b 73 40 0f 84 ce 00 00 00 48 8b 83 98 00 00 00 48 8b 40 08 48 8b 18 <48> 85 db 75 e3 31 d2 48 c7 c7 ec 35 6c c0 c6 07 00 0f 1f 40 00
Environment
- Red Hat Enterprise Linux 7
- McAfeeESP
- Out-of-tree (O) kernel module:
[mfe_fileaccess_100609126]
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.