A soft lockup occurs where one task is calling smp_call_function_many_cond() and waiting for anoter CPU to handle the IPI

Issue

• The VM crashed due to a soft lockup.

[Wed Oct  9 19:01:55 EDT 2024] Kernel panic - not syncing: softlockup: hung tasks
[Wed Oct  9 19:01:55 EDT 2024] CPU: 3 PID: 2934634 Comm: kworker/3:0 Tainted: P           OEL    -------- -  - 4.18.0-553.16.1.el8_10.x86_64 #1
[Wed Oct  9 19:01:55 EDT 2024] Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 11/12/2020
[Wed Oct  9 19:01:55 EDT 2024] Workqueue: events drm_fb_helper_damage_work [drm_kms_helper]
[Wed Oct  9 19:01:55 EDT 2024] Call Trace:
[Wed Oct  9 19:02:05 EDT 2024]  <IRQ>
[Wed Oct  9 19:02:05 EDT 2024]  dump_stack+0x41/0x60
[Wed Oct  9 19:02:05 EDT 2024]  panic+0xe7/0x2ac
[Wed Oct  9 19:02:05 EDT 2024]  watchdog_timer_fn.cold.10+0x85/0x9e
[Wed Oct  9 19:02:05 EDT 2024]  ? watchdog+0x30/0x30
[Wed Oct  9 19:02:05 EDT 2024]  __hrtimer_run_queues+0x101/0x280
[Wed Oct  9 19:02:05 EDT 2024]  hrtimer_interrupt+0x100/0x220
[Wed Oct  9 19:02:05 EDT 2024]  ? sched_clock+0x5/0x10
[Wed Oct  9 19:02:05 EDT 2024]  smp_apic_timer_interrupt+0x6a/0x130
[Wed Oct  9 19:02:05 EDT 2024]  apic_timer_interrupt+0xf/0x20
[Wed Oct  9 19:02:05 EDT 2024]  </IRQ>
[Wed Oct  9 19:02:05 EDT 2024] RIP: 0010:smp_call_function_many_cond+0x266/0x2f0
[Wed Oct  9 19:02:05 EDT 2024] Code: 89 c7 e8 0d ad 84 00 3b 05 3b 51 e1 01 0f 83 27 fe ff ff 48 63 d0 49 8b 0e 48 03 0c d5 80 68 dc b1 8b 11 83 e2 01 74 09 f3 90 <8b> 11 83 e2 01 75 f7 eb c9 48 c7 c2 a0 48 9c b2 4c 89 ee 44 89 e7
[Wed Oct  9 19:02:05 EDT 2024] RSP: 0018:ffffa85c012cfc50 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff13
[Wed Oct  9 19:02:05 EDT 2024] RAX: 0000000000000002 RBX: 0000000000000000 RCX: ffff93d637d3a680
[Wed Oct  9 19:02:05 EDT 2024] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff93d500023f38
[Wed Oct  9 19:02:05 EDT 2024] RBP: ffff93d5000234c8 R08: 0000000080000000 R09: 000000000000000f
[Wed Oct  9 19:02:05 EDT 2024] R10: ffff93d5000234c8 R11: 0000000000000000 R12: ffffffffb0bb028b
[Wed Oct  9 19:02:05 EDT 2024] R13: 0000000000000004 R14: ffff93d637db4340 R15: 0000000000000002
[Wed Oct  9 19:02:05 EDT 2024]  ? on_each_cpu+0x2b/0x60
[Wed Oct  9 19:02:05 EDT 2024]  ? load_new_mm_cr3+0xe0/0xe0
[Wed Oct  9 19:02:05 EDT 2024]  ? load_new_mm_cr3+0xe0/0xe0
[Wed Oct  9 19:02:05 EDT 2024]  on_each_cpu+0x2b/0x60
[Wed Oct  9 19:02:05 EDT 2024]  flush_tlb_kernel_range+0x48/0x90
[Wed Oct  9 19:02:05 EDT 2024]  ? _cond_resched+0x15/0x30
[Wed Oct  9 19:02:05 EDT 2024]  ? unmap_kernel_range_noflush+0x3f6/0x4f0
[Wed Oct  9 19:02:05 EDT 2024]  __purge_vmap_area_lazy+0x70/0x730
[Wed Oct  9 19:02:05 EDT 2024]  free_vmap_area_noflush+0xed/0x100
[Wed Oct  9 19:02:05 EDT 2024]  remove_vm_area+0x95/0xa0
[Wed Oct  9 19:02:05 EDT 2024]  __vunmap+0x59/0x220
[Wed Oct  9 19:02:05 EDT 2024]  ttm_bo_vunmap+0x27/0xb0 [ttm]
[Wed Oct  9 19:02:05 EDT 2024]  drm_gem_vunmap.part.22+0x1e/0x40 [drm]
[Wed Oct  9 19:02:05 EDT 2024]  drm_gem_vunmap_unlocked+0x2d/0x40 [drm]
[Wed Oct  9 19:02:05 EDT 2024]  drm_fbdev_fb_dirty+0xf6/0x350 [drm_kms_helper]
[Wed Oct  9 19:02:05 EDT 2024]  drm_fb_helper_damage_work+0x86/0x160 [drm_kms_helper]
[Wed Oct  9 19:02:05 EDT 2024]  process_one_work+0x1d3/0x390
[Wed Oct  9 19:02:05 EDT 2024]  ? process_one_work+0x390/0x390
[Wed Oct  9 19:02:05 EDT 2024]  worker_thread+0x30/0x390
[Wed Oct  9 19:02:05 EDT 2024]  ? process_one_work+0x390/0x390
[Wed Oct  9 19:02:05 EDT 2024]  kthread+0x134/0x150
[Wed Oct  9 19:02:05 EDT 2024]  ? set_kthread_struct+0x50/0x50
[Wed Oct  9 19:02:05 EDT 2024]  ret_from_fork+0x1f/0x40
[Wed Oct  9 19:02:05 EDT 2024] Kernel Offset: 0x2fa00000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
[Wed Oct  9 19:02:05 EDT 2024] ---[ end Kernel panic - not syncing: softlockup: hung tasks ]---