NVMe-o-FC device using dm-multipath, paths failing if max_segments is lower than max_discard_segments

Issue

• When I/O is performed on NVMe-o-FC device configured using DM-Multipath, paths to device starts failing with following messages in syslog. Issue is not present with native nvme multipathing.

[root@hostname ~]# multipath -ll /dev/mapper/mpatha
mpatha (eui.6xxxxxx000000000000123456789aa2b) dm-4 NVME,HPE Alletra
size=300G features='1 queue_if_no_path' hwhandler='0' wp=rw
|-+- policy='service-time 0' prio=50 status=enabled
| |- 2:133:2:2   nvme2n2  259:2   failed ready running
| |- 5:134:2:2   nvme5n2  259:27  failed ready running
| |- 1:135:2:2   nvme1n2  259:73  failed ready running
| `- 6:136:2:2   nvme6n2  259:126 failed ready running
`-+- policy='service-time 0' prio=10 status=enabled
  |- 0:389:2:2   nvme0n2  259:52  failed ready running
  |- 3:390:2:2   nvme3n2  259:89  failed ready running
  |- 4:391:2:2   nvme4n2  259:105 failed ready running
  `- 7:392:2:2   nvme7n2  259:150 failed ready running

kernel: blk_cloned_rq_check_limits: over max segments limit. (256 > 65)
kernel: device-mapper: multipath: 253:4: Failing path 259:118.
kernel: blk_cloned_rq_check_limits: over max segments limit. (256 > 65)
kernel: device-mapper: multipath: 253:4: Failing path 259:77.
....
multipathd[3459]: mpatha: remaining active paths: 3
multipathd[3459]: nvme3n2: mark as failed
multipathd[3459]: mpatha: remaining active paths: 2
multipathd[3459]: nvme4n2: mark as failed
multipathd[3459]: mpatha: remaining active paths: 1
multipathd[3459]: nvme7n2: mark as failed
multipathd[3459]: mpatha: remaining active paths: 0
multipath[296873]: dm-4: no usable paths found
....
kernel: device-mapper: multipath: 253:4: Reinstating path 259:2.
kernel: blk_cloned_rq_check_limits: over max segments limit. (256 > 65)
kernel: device-mapper: multipath: 253:4: Failing path 259:2.
kernel: device-mapper: multipath: 253:4: Reinstating path 259:27.