Kernel crashes due to a hard lockup on KVM host

Solution Unverified - Updated -

Issue

  • Kernel crashes due to a hard lockup on KVM host

  • Panic message logged in kernel ring buffer

[3355434.344089] Kernel panic - not syncing: Hard LOCKUP
[3355434.344336] CPU: 3 PID: 41753 Comm: CPU 1/KVM Not tainted 3.10.0-514.el7.x86_64 #1
[3355434.344579] Hardware name: Dell Inc. PowerEdge R630/02C2CP, BIOS 2.2.5 09/06/2016
[3355434.344830]  ffffffff818d9764 000000001a97d07b ffff883ffde45b18 ffffffff81685eac
[3355434.345109]  ffff883ffde45b98 ffffffff8167f2b3 0000000b00000010 ffff883ffde45ba8
[3355434.345385]  ffff883ffde45b48 000000001a97d07b ffff883ffde45b88 ffffffff818d946a
[3355434.345674] Call Trace:
[3355434.345955]  <NMI>  [<ffffffff81685eac>] dump_stack+0x19/0x1b
[3355434.346258]  [<ffffffff8167f2b3>] panic+0xe3/0x1f2
[3355434.346555]  [<ffffffff8108562f>] nmi_panic+0x3f/0x40
[3355434.346843]  [<ffffffff8112f0e6>] watchdog_overflow_callback+0xf6/0x100
[3355434.347137]  [<ffffffff8117465e>] __perf_event_overflow+0x8e/0x1f0
[3355434.347456]  [<ffffffff811752a4>] perf_event_overflow+0x14/0x20
[3355434.347800]  [<ffffffff81009d88>] intel_pmu_handle_irq+0x1f8/0x4e0
[3355434.348171]  [<ffffffff81319d7c>] ? ioremap_page_range+0x27c/0x3e0
[3355434.348512]  [<ffffffff811bedf4>] ? vunmap_page_range+0x1c4/0x310
[3355434.348886]  [<ffffffff811bef51>] ? unmap_kernel_range_noflush+0x11/0x20
[3355434.349246]  [<ffffffff813c93d4>] ? ghes_copy_tofrom_phys+0x124/0x210
[3355434.349600]  [<ffffffff813c9560>] ? ghes_read_estatus+0xa0/0x190
[3355434.349965]  [<ffffffff8168daeb>] perf_event_nmi_handler+0x2b/0x50
[3355434.350345]  [<ffffffff8168ef19>] nmi_handle.isra.0+0x69/0xb0
[3355434.350730]  [<ffffffff8168f093>] do_nmi+0x133/0x410
[3355434.351123]  [<ffffffff8168e353>] end_repeat_nmi+0x1e/0x2e
[3355434.351533]  [<ffffffffa4398390>] ? vmx_invpcid_supported+0x20/0x20 [kvm_intel]
[3355434.351956]  [<ffffffff8132593a>] ? delay_tsc+0x3a/0x70
[3355434.352413]  [<ffffffff8132593a>] ? delay_tsc+0x3a/0x70
[3355434.352830]  [<ffffffff8132593a>] ? delay_tsc+0x3a/0x70
[3355434.353244]  <<EOE>>  [<ffffffff8132585f>] __delay+0xf/0x20
[3355434.353698]  [<ffffffffa092bb04>] wait_lapic_expire+0x124/0x150 [kvm]
[3355434.354186]  [<ffffffffa09047cd>] vcpu_enter_guest+0x22d/0x1100 [kvm]
[3355434.354628]  [<ffffffffa08f6b8c>] ? kvm_check_async_pf_completion+0x8c/0xb0 [kvm]
[3355434.355106]  [<ffffffffa090ca3d>] kvm_arch_vcpu_ioctl_run+0xcd/0x450 [kvm]
[3355434.355609]  [<ffffffffa08f1a31>] kvm_vcpu_ioctl+0x2b1/0x640 [kvm]
[3355434.356096]  [<ffffffff810f7a72>] ? do_futex+0x122/0x5b0
[3355434.356586]  [<ffffffff81211ed5>] do_vfs_ioctl+0x2d5/0x4b0
[3355434.357103]  [<ffffffff812aea5e>] ? file_has_perm+0xae/0xc0
[3355434.357602]  [<ffffffff81212151>] SyS_ioctl+0xa1/0xc0
[3355434.358108]  [<ffffffff816964c9>] system_call_fastpath+0x16/0x1b

Environment

  • Red Hat Enterprise Linux 7.3 (kernel-3.10.0-514.el7)
  • KVM hypervisor

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In