System crashed with error 'IP: qla2x00_async_iocb_timeout+0x44/0x130'

Solution Unverified - Updated -

Issue

  • After fw errors on Qlogic FC HBA, the system got crashed with following call traces:

    qla2xxx [0000:88:00.1]-d035:10: Cmd access timeout, cmd=0x69, Exiting.
    qla2xxx [0000:88:00.1]-707c:10: ISP reset active.
    qla2xxx [0000:88:00.1]-707c:10: ISP reset active.
    qla2xxx [0000:88:00.1]-1015:10: cmd=0x69, waited 30000 msecs
    qla2xxx [0000:88:00.1]-d04c:10: MBX Command timeout for cmd 69, iocontrol=0 jiffies=100067515 mb[0-3]=[0x0 0x4953 0x5020 0x2532] mb7 0x1 host_status 0x0 hccr 0x0
    qla2xxx [0000:88:00.1]-d009:10: Firmware has been previously dumped (ffffa43f32c0d000) -- ignoring request.
    qla2xxx [0000:88:00.1]-500a:10: LOOP UP detected (8 Gbps).
    qla2xxx [0000:88:00.1]-803b:10: Firmware ready **** FAILED ****.
    qla2xxx [0000:88:00.0]-1015:9: cmd=0x31, waited 30000 msecs
    qla2xxx [0000:88:00.0]-d04c:9: MBX Command timeout for cmd 31, iocontrol=8 jiffies=100067e59 mb[0-3]=[0x4000 0xa0 0x7ff0 0x5000] mb7 0x80 host_status 0x40008010 hccr 0x0
    qla2xxx [0000:88:00.0]-d009:9: Firmware has been previously dumped (ffffa43f32a7b000) -- ignoring request.
    qla2xxx [0000:88:00.0]-101e:9: Mailbox cmd timeout occurred, cmd=0x31, mb[0]=0x31. Scheduling ISP abort 
    qla2xxx [0000:88:00.0]-00af:9: Performing ISP error recovery - ha=ffff8d2fbfd4f000.
    qla2xxx [0000:88:00.0]-500a:9: LOOP UP detected (8 Gbps).
    [...]
    BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
    IP: [<ffffffffc05a0744>] qla2x00_async_iocb_timeout+0x44/0x130 [qla2xxx]
    PGD 0 
    Oops: 0000 [#1] SMP 
    Modules linked in: vxodm(POE) vxgms(POE) vxglm(POE) dmpjbod(POE) 
    ...
    CPU: 0 PID: 0 Comm: swapper/0 Kdump: loaded Tainted: P        W  OE  ------------   3.10.0-862.el7.x86_64 #1
    Hardware name: HP ProLiant DL380 Gen9/ProLiant DL380 Gen9, BIOS P89 09/13/2016
    task: ffffffffa7216480 ti: ffffffffa7200000 task.ti: ffffffffa7200000
    RIP: 0010:[<ffffffffc05a0744>]  [<ffffffffc05a0744>] qla2x00_async_iocb_timeout+0x44/0x130 [qla2xxx]
    RSP: 0018:ffff8d6dbfc03dd8  EFLAGS: 00010046
    [...]
    Call Trace:
    <IRQ> 
    [<ffffffffa66bd991>] ? run_posix_cpu_timers+0x51/0x830
    [<ffffffffc059d159>] qla2x00_sp_timeout+0x59/0x90 [qla2xxx]
    [<ffffffffa66a1828>] call_timer_fn+0x38/0x110
    [<ffffffffc059d100>] ? qla_83xx_start_iocbs+0x50/0x50 [qla2xxx]
    [<ffffffffa66a3d1d>] run_timer_softirq+0x22d/0x310
    [<ffffffffa669a945>] __do_softirq+0xf5/0x280
    [<ffffffffa6d22d2c>] call_softirq+0x1c/0x30
    [<ffffffffa662d625>] do_softirq+0x65/0xa0
    [<ffffffffa669acc5>] irq_exit+0x105/0x110
    [<ffffffffa6d240a8>] smp_apic_timer_interrupt+0x48/0x60
    [<ffffffffa6d207f2>] apic_timer_interrupt+0x162/0x170
    <EOI> 
    [<ffffffffa6b69367>] ? cpuidle_enter_state+0x57/0xd0
    [...]
    

Environment

  • Red Hat Enterprise Linux 7.5
  • Qlogic FC HBA

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.