Frequent soft lockup and crash possibly caused by the faulty hardware
Issue
- The kernel crashes due to the soft lockup frequently.
[ 1505.783936] Kernel panic - not syncing: softlockup: hung tasks
[ 1505.783952] CPU: 27 PID: 3241 Comm: node_exporter Kdump: loaded Tainted: G W L ------------ 3.10.0-1160.66.1.el7.x86_64 #1
[ 1505.783982] Hardware name: Dell Inc. PowerEdge R640/0RGP26, BIOS 2.12.2 07/09/2021
[ 1505.784001] Call Trace:
[ 1505.784009] <IRQ> [<ffffffffb13865a9>] dump_stack+0x19/0x1b
[ 1505.784026] [<ffffffffb13802b1>] panic+0xe8/0x21f
[ 1505.784042] [<ffffffffb0d4ef8a>] watchdog_timer_fn+0x20a/0x220
[ 1505.784057] [<ffffffffb0d4ed80>] ? watchdog+0x40/0x40
[ 1505.784072] [<ffffffffb0cca38e>] __hrtimer_run_queues+0x10e/0x270
[ 1505.784087] [<ffffffffb0cca8ef>] hrtimer_interrupt+0xaf/0x1d0
[ 1505.784103] [<ffffffffb0c5ce2b>] local_apic_timer_interrupt+0x3b/0x60
[ 1505.784120] [<ffffffffb139ea23>] smp_apic_timer_interrupt+0x43/0x60
[ 1505.784136] [<ffffffffb139afba>] apic_timer_interrupt+0x16a/0x170
[ 1505.784154] <EOI> [<ffffffffb0dde9fd>] ? kvmalloc_node+0x8d/0xe0
[ 1505.784173] [<ffffffffb0d16b66>] ? generic_exec_single+0x106/0x1c0
[ 1505.784189] [<ffffffffb0fbbea0>] ? sbitmap_queue_init_node+0x1b0/0x1b0
[ 1505.784206] [<ffffffffb0fbbea0>] ? sbitmap_queue_init_node+0x1b0/0x1b0
[ 1505.784225] [<ffffffffb0d16c7f>] smp_call_function_single+0x5f/0xa0
[ 1505.784241] [<ffffffffb0fbbffd>] rdmsr_on_cpu+0x5d/0x90
[ 1505.784256] [<ffffffffc062b327>] show_crit_alarm+0x47/0x80 [coretemp]
[ 1505.784273] [<ffffffffb0e28d8c>] ? __kmalloc_node+0x5c/0x2b0
[ 1505.784289] [<ffffffffb10b6ed3>] dev_attr_show+0x23/0x60
[ 1505.784304] [<ffffffffb138a812>] ? mutex_lock+0x12/0x2f
[ 1505.784318] [<ffffffffb0edbd3f>] sysfs_kf_seq_show+0xcf/0x1f0
[ 1505.784333] [<ffffffffb0eda3f6>] kernfs_seq_show+0x26/0x30
[ 1505.784901] [<ffffffffb0e76db0>] seq_read+0x130/0x450
[ 1505.785425] [<ffffffffb0edad55>] kernfs_fop_read+0x105/0x170
[ 1505.785947] [<ffffffffb0e4e30f>] vfs_read+0x9f/0x170
[ 1505.786458] [<ffffffffb0e4f155>] SyS_read+0x55/0xd0
[ 1505.786958] [<ffffffffb1399f92>] system_call_fastpath+0x25/0x2a
Environment
- Red Hat Enterprise Linux 7.9.z
- kernel-3.10.0-1160.66.1.el7
- Dell PowerEdge R640
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.