System crashed with error 'IP: qla2x00_async_iocb_timeout+0x44/0x130'

Solution Unverified - Updated -

Issue

  • After fw errors on Qlogic FC HBA, the system got crashed with following call traces:

    qla2xxx [0000:88:00.1]-d035:10: Cmd access timeout, cmd=0x69, Exiting.
    qla2xxx [0000:88:00.1]-707c:10: ISP reset active.
    qla2xxx [0000:88:00.1]-707c:10: ISP reset active.
    qla2xxx [0000:88:00.1]-1015:10: cmd=0x69, waited 30000 msecs
    qla2xxx [0000:88:00.1]-d04c:10: MBX Command timeout for cmd 69, iocontrol=0 jiffies=100067515 mb[0-3]=[0x0 0x4953 0x5020 0x2532] mb7 0x1 host_status 0x0 hccr 0x0
    qla2xxx [0000:88:00.1]-d009:10: Firmware has been previously dumped (ffffa43f32c0d000) -- ignoring request.
    qla2xxx [0000:88:00.1]-500a:10: LOOP UP detected (8 Gbps).
    qla2xxx [0000:88:00.1]-803b:10: Firmware ready **** FAILED ****.
    qla2xxx [0000:88:00.0]-1015:9: cmd=0x31, waited 30000 msecs
    qla2xxx [0000:88:00.0]-d04c:9: MBX Command timeout for cmd 31, iocontrol=8 jiffies=100067e59 mb[0-3]=[0x4000 0xa0 0x7ff0 0x5000] mb7 0x80 host_status 0x40008010 hccr 0x0
    qla2xxx [0000:88:00.0]-d009:9: Firmware has been previously dumped (ffffa43f32a7b000) -- ignoring request.
    qla2xxx [0000:88:00.0]-101e:9: Mailbox cmd timeout occurred, cmd=0x31, mb[0]=0x31. Scheduling ISP abort 
    qla2xxx [0000:88:00.0]-00af:9: Performing ISP error recovery - ha=ffff8d2fbfd4f000.
    qla2xxx [0000:88:00.0]-500a:9: LOOP UP detected (8 Gbps).
    [...]
    BUG: unable to handle kernel NULL pointer dereference at 0000000000000010
    IP: [<ffffffffc05a0744>] qla2x00_async_iocb_timeout+0x44/0x130 [qla2xxx]
    PGD 0 
    Oops: 0000 [#1] SMP 
    Modules linked in: vxodm(POE) vxgms(POE) vxglm(POE) dmpjbod(POE) 
    ...
    CPU: 0 PID: 0 Comm: swapper/0 Kdump: loaded Tainted: P        W  OE  ------------   3.10.0-862.el7.x86_64 #1
    Hardware name: HP ProLiant DL380 Gen9/ProLiant DL380 Gen9, BIOS P89 09/13/2016
    task: ffffffffa7216480 ti: ffffffffa7200000 task.ti: ffffffffa7200000
    RIP: 0010:[<ffffffffc05a0744>]  [<ffffffffc05a0744>] qla2x00_async_iocb_timeout+0x44/0x130 [qla2xxx]
    RSP: 0018:ffff8d6dbfc03dd8  EFLAGS: 00010046
    [...]
    Call Trace:
    <IRQ> 
    [<ffffffffa66bd991>] ? run_posix_cpu_timers+0x51/0x830
    [<ffffffffc059d159>] qla2x00_sp_timeout+0x59/0x90 [qla2xxx]
    [<ffffffffa66a1828>] call_timer_fn+0x38/0x110
    [<ffffffffc059d100>] ? qla_83xx_start_iocbs+0x50/0x50 [qla2xxx]
    [<ffffffffa66a3d1d>] run_timer_softirq+0x22d/0x310
    [<ffffffffa669a945>] __do_softirq+0xf5/0x280
    [<ffffffffa6d22d2c>] call_softirq+0x1c/0x30
    [<ffffffffa662d625>] do_softirq+0x65/0xa0
    [<ffffffffa669acc5>] irq_exit+0x105/0x110
    [<ffffffffa6d240a8>] smp_apic_timer_interrupt+0x48/0x60
    [<ffffffffa6d207f2>] apic_timer_interrupt+0x162/0x170
    <EOI> 
    [<ffffffffa6b69367>] ? cpuidle_enter_state+0x57/0xd0
    [...]
    

Environment

  • Red Hat Enterprise Linux 7.5
    • Qlogic FC HBA

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In