Hard LOCKUP panic while servicing completion interrupt for HPSA.

Solution Unverified - Updated -

Issue

  • System crashes with Hard LOCKUP panic with following kernel stack trace:
PID: 42726  TASK: ffff887f7cec8fd0  CPU: 1   COMMAND: "kworker/u128:0"
 #0 [ffff883f7f6489f0] machine_kexec at ffffffff8105c58b
 #1 [ffff883f7f648a50] __crash_kexec at ffffffff81106742
 #2 [ffff883f7f648b20] panic at ffffffff8169fd6f
 #3 [ffff883f7f648ba0] nmi_panic at ffffffff8108919f
 #4 [ffff883f7f648bb0] watchdog_overflow_callback at ffffffff81131775
 #5 [ffff883f7f648bc8] __perf_event_overflow at ffffffff81170261
 #6 [ffff883f7f648c00] perf_event_overflow at ffffffff81178db4
 #7 [ffff883f7f648c10] intel_pmu_handle_irq at ffffffff81009f88
 #8 [ffff883f7f648e38] perf_event_nmi_handler at ffffffff816af02b
 #9 [ffff883f7f648e58] nmi_handle at ffffffff816b0c57
#10 [ffff883f7f648eb0] do_nmi at ffffffff816b0f40
#11 [ffff883f7f648ef0] end_repeat_nmi at ffffffff816b00b9
    [exception RIP: native_queued_spin_lock_slowpath+0x116]
    RIP: ffffffff810fc036  RSP: ffff883f7f643c18  RFLAGS: 00000046
    RAX: 0000000000000000  RBX: 0000000000000046  RCX: 0000000000090000
    RDX: ffffffff81b4e5f0  RSI: 000000003e7e7dc0  RDI: ffff8841edfe7b28
    RBP: ffff883f7f643c18   R8: ffff883f7f6595c0   R9: 0000000000000000
    R10: 0000000000000000  R11: ffff883f7f643da8  R12: ffff8841edfe7b20
    R13: ffff883f77078000  R14: 0000000000000001  R15: ffff8841edfe7948
    ORIG_RAX: ffffffffffffffff  CS: 0010  SS: 0018
--- <NMI exception stack> ---
#12 [ffff883f7f643c18] native_queued_spin_lock_slowpath at ffffffff810fc036
#13 [ffff883f7f643c20] queued_spin_lock_slowpath at ffffffff816a070f
#14 [ffff883f7f643c30] _raw_spin_lock_irqsave at ffffffff816adea7
#15 [ffff883f7f643c48] complete at ffffffff810bf11d
#16 [ffff883f7f643c70] finish_cmd at ffffffffc00ab078 [hpsa]
#17 [ffff883f7f643cd8] do_hpsa_intr_msi at ffffffffc00abf91 [hpsa]
#18 [ffff883f7f643d08] __handle_irq_event_percpu at ffffffff8113272e
#19 [ffff883f7f643d50] handle_irq_event_percpu at ffffffff811328e2
#20 [ffff883f7f643d80] handle_irq_event at ffffffff8113296c
#21 [ffff883f7f643da8] handle_edge_irq at ffffffff811355f7
#22 [ffff883f7f643dc8] handle_irq at ffffffff8102d2de
#23 [ffff883f7f643e10] do_IRQ at ffffffff816be97d
#24 [ffff883f7f643eb8] __do_softirq at ffffffff8109256a
#25 [ffff883f7f643f48] call_softirq at ffffffff816bd3ac
#26 [ffff883f7f643f60] do_softirq at ffffffff8102d405
#27 [ffff883f7f643f80] irq_exit at ffffffff81092945
#28 [ffff883f7f643f98] smp_apic_timer_interrupt at ffffffff816bea52
#29 [ffff883f7f643fb0] apic_timer_interrupt at ffffffff816b9d32
--- <IRQ stack> ---
#30 [ffff8841edfe7948] apic_timer_interrupt at ffffffff816b9d32
    [exception RIP: console_unlock+0x46d]
    RIP: ffffffff8108be5d  RSP: ffff8841edfe79f0  RFLAGS: 00000246
    RAX: 0000000000000000  RBX: ffffffff81d981b2  RCX: 00000000ffffffff
    RDX: ffff8841edfe7978  RSI: 0000000000000004  RDI: 0000000000000246
    RBP: ffff8841edfe7a20   R8: 0000000000000000   R9: ffff883f7543ef00
    R10: 00000000000003ff  R11: 0000000000000001  R12: 0000001081fe1048
    R13: ffffffff8140af69  R14: ffff8841edfe79b8  R15: ffffffff816b3d6a
    ORIG_RAX: ffffffffffffff10  CS: 0010  SS: 0018
#31 [ffff8841edfe7a28] vprintk_emit at ffffffff8108c264
#32 [ffff8841edfe7a98] dev_vprintk_emit at ffffffff8143cd62
#33 [ffff8841edfe7b50] dev_printk_emit at ffffffff8143cdde
#34 [ffff8841edfe7bb0] __dev_printk at ffffffff8143d26e
#35 [ffff8841edfe7bc0] dev_err at ffffffff8143d55c
#36 [ffff8841edfe7c30] hpsa_update_scsi_devices at ffffffffc00b05d7 [hpsa]
#37 [ffff8841edfe7d58] hpsa_scan_start at ffffffffc00b1be0 [hpsa]
#38 [ffff8841edfe7dc0] hpsa_rescan_ctlr_worker at ffffffffc00b2321 [hpsa]
#39 [ffff8841edfe7e20] process_one_work at ffffffff810aa3ba
#40 [ffff8841edfe7e68] worker_thread at ffffffff810ab086
#41 [ffff8841edfe7ec8] kthread at ffffffff810b252f
#42 [ffff8841edfe7f50] ret_from_fork at ffffffff816b8798

Environment

  • Red Hat Enterprise Linux 7
    • kernel version 3.10.0-693.11.6.el7.x86_64
    • HP HPSA Driver (v 3.4.18-0-RH1)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content