dm-multipath losing more than expected number of paths during storage controller reboot

Solution Verified - Updated -

Issue

  • During the storage controller reboot, dm-multipath is losing the paths from both affected and non-affected controllers.

    Some of the paths (e.g. sdas in following output) are not mapped from affected storage controller, but it is also marked as failed:

    kernel: ibmvfc 3000000a: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7
    kernel: ibmvfc 30000007: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7
    kernel: ibmvfc 30000009: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7
    kernel: ibmvfc 30000008: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7
    kernel: ibmvfc 30000009: Link Down event received. scsi_id: 0, wwpn: 0, node_name: 0
    kernel: sd 3:0:2:254: [sdbh] tag#49 Command (00) : port login required (2:10) flags: 0 fcp_rsp: 0, resid=0, scsi_status: 0
    kernel: sd 3:0:2:254: [sdbh] tag#49 FAILED Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK
    kernel: sd 3:0:2:254: [sdbh] tag#49 CDB: Test Unit Ready 00 00 00 00 00 00
    kernel: ibmvfc 30000009: Link Up event received. scsi_id: 0, wwpn: 0, node_name: 0
    kernel: sd 3:0:2:251: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdbe, sector 7272712 flags 4201
    kernel: device-mapper: multipath: 253:2: Failing path 67:128.
    kernel: sd 3:0:2:252: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdbf, sector 338082096 flags ca01
    kernel: sd 3:0:2:252: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdbf, sector 338211048 flags ca01
    kernel: sd 3:0:2:254: rejecting I/O to offline device
    kernel: device-mapper: multipath: 253:3: Failing path 67:144.
    multipathd[5836]: sdbe: mark as failed
    [...]
    kernel: sd 3:0:0:251: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdas, sector 7272712 flags 4201
    kernel: device-mapper: multipath: 253:2: Failing path 66:192.
    kernel: sd 3:0:0:252: rejecting I/O to offline device
    kernel: print_req_error: I/O error, dev sdat, sector 2936012160 flags 4200
    kernel: device-mapper: multipath: 253:3: Failing path 66:208.
    multipathd[5836]: sdas: mark as failed                                       <---
    [...]
    

Environment

  • Red Hat Enterprise Linux 8.1
  • RHEL installed on IBM LPAR
  • IBM Virtual FC adapters managed by ibmvfc module
  • device-mapper-multipath

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content