Hard LOCKUP panic while servicing completion interrupt for HPSA.
Issue
- System crashes with Hard LOCKUP panic with following kernel stack trace:
PID: 42726 TASK: ffff887f7cec8fd0 CPU: 1 COMMAND: "kworker/u128:0"
#0 [ffff883f7f6489f0] machine_kexec at ffffffff8105c58b
#1 [ffff883f7f648a50] __crash_kexec at ffffffff81106742
#2 [ffff883f7f648b20] panic at ffffffff8169fd6f
#3 [ffff883f7f648ba0] nmi_panic at ffffffff8108919f
#4 [ffff883f7f648bb0] watchdog_overflow_callback at ffffffff81131775
#5 [ffff883f7f648bc8] __perf_event_overflow at ffffffff81170261
#6 [ffff883f7f648c00] perf_event_overflow at ffffffff81178db4
#7 [ffff883f7f648c10] intel_pmu_handle_irq at ffffffff81009f88
#8 [ffff883f7f648e38] perf_event_nmi_handler at ffffffff816af02b
#9 [ffff883f7f648e58] nmi_handle at ffffffff816b0c57
#10 [ffff883f7f648eb0] do_nmi at ffffffff816b0f40
#11 [ffff883f7f648ef0] end_repeat_nmi at ffffffff816b00b9
[exception RIP: native_queued_spin_lock_slowpath+0x116]
RIP: ffffffff810fc036 RSP: ffff883f7f643c18 RFLAGS: 00000046
RAX: 0000000000000000 RBX: 0000000000000046 RCX: 0000000000090000
RDX: ffffffff81b4e5f0 RSI: 000000003e7e7dc0 RDI: ffff8841edfe7b28
RBP: ffff883f7f643c18 R8: ffff883f7f6595c0 R9: 0000000000000000
R10: 0000000000000000 R11: ffff883f7f643da8 R12: ffff8841edfe7b20
R13: ffff883f77078000 R14: 0000000000000001 R15: ffff8841edfe7948
ORIG_RAX: ffffffffffffffff CS: 0010 SS: 0018
--- <NMI exception stack> ---
#12 [ffff883f7f643c18] native_queued_spin_lock_slowpath at ffffffff810fc036
#13 [ffff883f7f643c20] queued_spin_lock_slowpath at ffffffff816a070f
#14 [ffff883f7f643c30] _raw_spin_lock_irqsave at ffffffff816adea7
#15 [ffff883f7f643c48] complete at ffffffff810bf11d
#16 [ffff883f7f643c70] finish_cmd at ffffffffc00ab078 [hpsa]
#17 [ffff883f7f643cd8] do_hpsa_intr_msi at ffffffffc00abf91 [hpsa]
#18 [ffff883f7f643d08] __handle_irq_event_percpu at ffffffff8113272e
#19 [ffff883f7f643d50] handle_irq_event_percpu at ffffffff811328e2
#20 [ffff883f7f643d80] handle_irq_event at ffffffff8113296c
#21 [ffff883f7f643da8] handle_edge_irq at ffffffff811355f7
#22 [ffff883f7f643dc8] handle_irq at ffffffff8102d2de
#23 [ffff883f7f643e10] do_IRQ at ffffffff816be97d
#24 [ffff883f7f643eb8] __do_softirq at ffffffff8109256a
#25 [ffff883f7f643f48] call_softirq at ffffffff816bd3ac
#26 [ffff883f7f643f60] do_softirq at ffffffff8102d405
#27 [ffff883f7f643f80] irq_exit at ffffffff81092945
#28 [ffff883f7f643f98] smp_apic_timer_interrupt at ffffffff816bea52
#29 [ffff883f7f643fb0] apic_timer_interrupt at ffffffff816b9d32
--- <IRQ stack> ---
#30 [ffff8841edfe7948] apic_timer_interrupt at ffffffff816b9d32
[exception RIP: console_unlock+0x46d]
RIP: ffffffff8108be5d RSP: ffff8841edfe79f0 RFLAGS: 00000246
RAX: 0000000000000000 RBX: ffffffff81d981b2 RCX: 00000000ffffffff
RDX: ffff8841edfe7978 RSI: 0000000000000004 RDI: 0000000000000246
RBP: ffff8841edfe7a20 R8: 0000000000000000 R9: ffff883f7543ef00
R10: 00000000000003ff R11: 0000000000000001 R12: 0000001081fe1048
R13: ffffffff8140af69 R14: ffff8841edfe79b8 R15: ffffffff816b3d6a
ORIG_RAX: ffffffffffffff10 CS: 0010 SS: 0018
#31 [ffff8841edfe7a28] vprintk_emit at ffffffff8108c264
#32 [ffff8841edfe7a98] dev_vprintk_emit at ffffffff8143cd62
#33 [ffff8841edfe7b50] dev_printk_emit at ffffffff8143cdde
#34 [ffff8841edfe7bb0] __dev_printk at ffffffff8143d26e
#35 [ffff8841edfe7bc0] dev_err at ffffffff8143d55c
#36 [ffff8841edfe7c30] hpsa_update_scsi_devices at ffffffffc00b05d7 [hpsa]
#37 [ffff8841edfe7d58] hpsa_scan_start at ffffffffc00b1be0 [hpsa]
#38 [ffff8841edfe7dc0] hpsa_rescan_ctlr_worker at ffffffffc00b2321 [hpsa]
#39 [ffff8841edfe7e20] process_one_work at ffffffff810aa3ba
#40 [ffff8841edfe7e68] worker_thread at ffffffff810ab086
#41 [ffff8841edfe7ec8] kthread at ffffffff810b252f
#42 [ffff8841edfe7f50] ret_from_fork at ffffffff816b8798
Environment
- Red Hat Enterprise Linux 7
- kernel version 3.10.0-693.11.6.el7.x86_64
- HP HPSA Driver (v 3.4.18-0-RH1)
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.