When using virtio disks for the installation of new machines, multipath fails and there are many "Connectivity lost for initiator" messages on RHEV-H logs.
Issue
- When using virtio disks for the installation of new machines, multipath fails and there are many "Connectivity lost for initiator" messages on RHEV-H logs.
kernel: bfa 0000:0b:00.0: Remote port (WWN = 50:06:0e:80:10:46:74:00) connectivity lost for logical port (WWN = 10:00:8c:7c:ff:20:6e:ea)
kernel: bfa 0000:0b:00.0: Target (WWN = 50:06:0e:80:10:46:74:00) connectivity lost for initiator (WWN = 10:00:8c:7c:ff:20:6e:ea)
kernel: bfa 0000:0e:00.0: Remote port (WWN = 50:06:0e:80:10:46:74:00) connectivity lost for logical port (WWN = 10:00:8c:7c:ff:20:6e:7a)
kernel: bfa 0000:0e:00.0: Target (WWN = 50:06:0e:80:10:46:74:00) connectivity lost for initiator (WWN = 10:00:8c:7c:ff:20:6e:7a)
kernel: modinfo[9403]: segfault at 2f ip 00007faacd82757c sp 00007fff8b964750 error 4 in libc-2.12.so[7faacd7e0000+186000]
360060e801046740004f2baf000000001 dm-5 HITACHI,DF600F
size=1.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
|- 3:0:1:1 sdg 8:96 active ready running
|- 1:0:1:1 sdc 8:32 active ready running
|- 2:0:1:1 sde 8:64 active ready running
`- 4:0:1:1 sdi 8:128 active ready running
- When using IDE, there is no issues. Using virtio causes path failure and eventually they can't access the LUNs. This platform has 2 hypervisors, 2 LUNs (2TB and 1.6TB). This system uses Brocade FC HBAs (bfa) to access the FCP storage domain.
Environment
- Red Hat Enterprise Linux (RHEL), including
- Red Hat Enterprise Linux 5 (RHEL5) - Observed on kernel 2.6.18-308.el5
- Red Hat Enterprise Linux 6 (RHEL6) - Observed on kernel 2.6.32-220.13.1.el6
- Red Hat Enterprise Linux 7 (RHEL7) - Observed on kernel 3.10.0-327.el7
- Red Hat Enterprise Virtualization (RHEV) 3.0 - Observed on Hypervisor 2.6.32-220.13.1.el6.
- Issue observed when using RHEV/KVM virtualization on Red Hat kernel.
- Issue occurs when guests use virtio storage provided by HBA
- Issue does NOT occur when guests use IDE storage provided by HBA
- Hitachi Fabric Switches and SAN.
- Fabric port speed configured to "auto"
- HP OEM Brocade HBA's:
$ grep "Fibre Channel" lspci
0b:00.0 Fibre Channel: Brocade Communications Systems, Inc. 425/825/42B/82B 4Gbps/8Gbps PCIe dual port FC HBA (rev 01)
0b:00.1 Fibre Channel: Brocade Communications Systems, Inc. 425/825/42B/82B 4Gbps/8Gbps PCIe dual port FC HBA (rev 01)
0e:00.0 Fibre Channel: Brocade Communications Systems, Inc. 425/825/42B/82B 4Gbps/8Gbps PCIe dual port FC HBA (rev 01)
0e:00.1 Fibre Channel: Brocade Communications Systems, Inc. 425/825/42B/82B 4Gbps/8Gbps PCIe dual port FC HBA (rev 01)
- Using Tech-Preview bfa driver (provided by Red Hat kernel):
kernel: TECH PREVIEW: Brocade FCOE/FC Adapter Driver may not be fully supported.
kernel: Please review provided documentation for limitations.
kernel: Brocade BFA FC/FCOE SCSI driver - version: 3.0.2.2
kernel: bfa 0000:0b:00.0: firmware: requesting cbfw.bin
kernel: bfa 0000:0b:00.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
kernel: scsi1 : Brocade FC/FCOE Adapter, hwpath: 0000:0b:00.0 driver: 3.0.2.2
- Issue also observed on HP bfa driver version 3.0.3.0
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.