dm-multipath losing more than expected number of paths during storage controller reboot
Issue
-
During the storage controller reboot, dm-multipath is losing the paths from both affected and non-affected controllers.
Some of the paths (e.g.
sdasin following output) are not mapped from affected storage controller, but it is also marked as failed:kernel: ibmvfc 3000000a: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7 kernel: ibmvfc 30000007: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7 kernel: ibmvfc 30000009: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7 kernel: ibmvfc 30000008: 1xxxx: Query Target failed: command failed (2:8000) unknown fc type (0) no additional explanation (0) rc=0xF7 kernel: ibmvfc 30000009: Link Down event received. scsi_id: 0, wwpn: 0, node_name: 0 kernel: sd 3:0:2:254: [sdbh] tag#49 Command (00) : port login required (2:10) flags: 0 fcp_rsp: 0, resid=0, scsi_status: 0 kernel: sd 3:0:2:254: [sdbh] tag#49 FAILED Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK kernel: sd 3:0:2:254: [sdbh] tag#49 CDB: Test Unit Ready 00 00 00 00 00 00 kernel: ibmvfc 30000009: Link Up event received. scsi_id: 0, wwpn: 0, node_name: 0 kernel: sd 3:0:2:251: rejecting I/O to offline device kernel: print_req_error: I/O error, dev sdbe, sector 7272712 flags 4201 kernel: device-mapper: multipath: 253:2: Failing path 67:128. kernel: sd 3:0:2:252: rejecting I/O to offline device kernel: print_req_error: I/O error, dev sdbf, sector 338082096 flags ca01 kernel: sd 3:0:2:252: rejecting I/O to offline device kernel: print_req_error: I/O error, dev sdbf, sector 338211048 flags ca01 kernel: sd 3:0:2:254: rejecting I/O to offline device kernel: device-mapper: multipath: 253:3: Failing path 67:144. multipathd[5836]: sdbe: mark as failed [...] kernel: sd 3:0:0:251: rejecting I/O to offline device kernel: print_req_error: I/O error, dev sdas, sector 7272712 flags 4201 kernel: device-mapper: multipath: 253:2: Failing path 66:192. kernel: sd 3:0:0:252: rejecting I/O to offline device kernel: print_req_error: I/O error, dev sdat, sector 2936012160 flags 4200 kernel: device-mapper: multipath: 253:3: Failing path 66:208. multipathd[5836]: sdas: mark as failed <--- [...]
Environment
- Red Hat Enterprise Linux 8.1
- RHEL installed on IBM LPAR
- IBM Virtual FC adapters managed by
ibmvfcmodule - device-mapper-multipath
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.