Hard lockup detected due to a timer interrupt storm in tick_nohz_stop_sched_tick in Red Hat Enterprise Linux 7
Issue
- Hard lockup with below call trace:
[323271.825843] Kernel panic - not syncing: Hard LOCKUP
[323271.827423] CPU: 11 PID: 0 Comm: swapper/11 Tainted: G OE ------------ 3.10.0-693.el7.x86_64 #1
[323271.829055] Hardware name: New H3C Technologies Co., Ltd. R4900 G2/RS32M2C9S, BIOS 1.01.22 07/05/2018
[323271.830715] ffff8810e951bd00 79e65ebce0fb5ce5 ffff88203f2c5b18 ffffffff816a3d91
[323271.832397] ffff88203f2c5b98 ffffffff8169dc54 0000000000000010 ffff88203f2c5ba8
[323271.834090] ffff88203f2c5b48 79e65ebce0fb5ce5 0000000000000000 ffffffff8190ac2f
[323271.835778] Call Trace:
[323271.837440] <NMI> [<ffffffff816a3d91>] dump_stack+0x19/0x1b
[323271.839100] [<ffffffff8169dc54>] panic+0xe8/0x20d
[323271.840719] [<ffffffff8108771f>] nmi_panic+0x3f/0x40
[323271.842332] [<ffffffff8112fa75>] watchdog_overflow_callback+0xf5/0x100
[323271.843956] [<ffffffff8116e561>] __perf_event_overflow+0x51/0xf0
[323271.845578] [<ffffffff811770b4>] perf_event_overflow+0x14/0x20
[323271.847201] [<ffffffff81009f78>] intel_pmu_handle_irq+0x218/0x4f0
[323271.848825] [<ffffffff81324abc>] ? ioremap_page_range+0x26c/0x3d0
[323271.850440] [<ffffffff811c0a04>] ? vunmap_page_range+0x1b4/0x300
[323271.852056] [<ffffffff811c0b61>] ? unmap_kernel_range_noflush+0x11/0x20
[323271.853647] [<ffffffff813da15e>] ? ghes_copy_tofrom_phys+0x10e/0x210
[323271.855213] [<ffffffff813da300>] ? ghes_read_estatus+0xa0/0x190
[323271.856771] [<ffffffff816ac06b>] perf_event_nmi_handler+0x2b/0x50
[323271.858328] [<ffffffff816ad427>] nmi_handle.isra.0+0x87/0x160
[323271.859879] [<ffffffff816ad710>] do_nmi+0x210/0x450
[323271.861422] [<ffffffff816ac8d3>] end_repeat_nmi+0x1e/0x2e
[323271.862962] [<ffffffff810f31db>] ? tick_nohz_stop_sched_tick+0x4b/0x370
[323271.864512] [<ffffffff810f31db>] ? tick_nohz_stop_sched_tick+0x4b/0x370
[323271.866039] [<ffffffff810f31db>] ? tick_nohz_stop_sched_tick+0x4b/0x370
[323271.867538] <<EOE>> <IRQ> [<ffffffff81033619>] ? sched_clock+0x9/0x10
[323271.869032] [<ffffffff810f359f>] __tick_nohz_idle_enter+0x9f/0x160
[323271.870497] [<ffffffff810f3bb8>] tick_nohz_irq_exit+0xa8/0xb0
[323271.871963] [<ffffffff81090e49>] irq_exit+0x89/0x110
[323271.873416] [<ffffffff816b76c2>] smp_apic_timer_interrupt+0x42/0x50
[323271.874877] [<ffffffff816b5c1d>] apic_timer_interrupt+0x6d/0x80
[323271.876333] <EOI> [<ffffffff816ab7c9>] ? poll_idle+0x49/0x85
[323271.877804] [<ffffffff816ab798>] ? poll_idle+0x18/0x85
[323271.879273] [<ffffffff815279f0>] cpuidle_enter_state+0x40/0xc0
[323271.880743] [<ffffffff81527b48>] cpuidle_idle_call+0xd8/0x210
[323271.882178] [<ffffffff81034fee>] arch_cpu_idle+0xe/0x30
[323271.883579] [<ffffffff810e7bca>] cpu_startup_entry+0x14a/0x1c0
[323271.884981] [<ffffffff81051af6>] start_secondary+0x1b6/0x230
Environment
- Red Hat Enterprise Linux 7
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.