dm-multipath losing more than expected number of paths during storage controller reboot

Solution Verified - Updated -

Issue

  • During the storage controller reboot, dm-multipath is losing the paths from both affected and non-affected controllers.

    Some of the paths (e.g. sdas in following output) are not mapped from affected storage controller, but it is also marked as failed:

    kernel: ibmvfc 3000000a: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7
    kernel: ibmvfc 30000007: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7
    kernel: ibmvfc 30000009: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7
    kernel: ibmvfc 30000008: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7
    kernel: ibmvfc 30000009: Link Down event received. scsi_id: 0, wwpn: 0, node_name: 0
    kernel: sd 3:0:2:254: [sdbh] tag#49 Command (00) : port login required (2:10) flags: 0 fcp_rsp: 0, resid=0, scsi_status: 0
    kernel: sd 3:0:2:254: [sdbh] tag#49 FAILED Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK
    kernel: sd 3:0:2:254: [sdbh] tag#49 CDB: Test Unit Ready 00 00 00 00 00 00
    kernel: ibmvfc 30000009: Link Up event received. scsi_id: 0, wwpn: 0, node_name: 0
    kernel: sd 3:0:2:251: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdbe, sector 7272712 flags 4201
    kernel: device-mapper: multipath: 253:2: Failing path 67:128.
    kernel: sd 3:0:2:252: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdbf, sector 338082096 flags ca01
    kernel: sd 3:0:2:252: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdbf, sector 338211048 flags ca01
    kernel: sd 3:0:2:254: rejecting I/O to offline device
    kernel: device-mapper: multipath: 253:3: Failing path 67:144.
    multipathd[5836]: sdbe: mark as failed
    [...]
    kernel: sd 3:0:0:251: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdas, sector 7272712 flags 4201
    kernel: device-mapper: multipath: 253:2: Failing path 66:192.
    kernel: sd 3:0:0:252: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdat, sector 2936012160 flags 4200
    kernel: device-mapper: multipath: 253:3: Failing path 66:208.
    multipathd[5836]: sdas: mark as failed                                       <---
    [...]
    

Environment

  • Red Hat Enterprise Linux 8.1
  • RHEL installed on IBM LPAR
  • IBM Virtual FC adapters managed by ibmvfc module
  • device-mapper-multipath

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In