When using virtio disks for the installation of new machines, multipath fails and there are many "Connectivity lost for initiator" messages on RHEV-H logs.

Solution Unverified - Updated -

Issue

  • When using virtio disks for the installation of new machines, multipath fails and there are many "Connectivity lost for initiator" messages on RHEV-H logs.
kernel: bfa 0000:0b:00.0: Remote port (WWN = 50:06:0e:80:10:46:74:00) connectivity lost for logical port (WWN = 10:00:8c:7c:ff:20:6e:ea)
kernel: bfa 0000:0b:00.0: Target (WWN = 50:06:0e:80:10:46:74:00) connectivity lost for initiator (WWN = 10:00:8c:7c:ff:20:6e:ea)
kernel: bfa 0000:0e:00.0: Remote port (WWN = 50:06:0e:80:10:46:74:00) connectivity lost for logical port (WWN = 10:00:8c:7c:ff:20:6e:7a)
kernel: bfa 0000:0e:00.0: Target (WWN = 50:06:0e:80:10:46:74:00) connectivity lost for initiator (WWN = 10:00:8c:7c:ff:20:6e:7a)
kernel: modinfo[9403]: segfault at 2f ip 00007faacd82757c sp 00007fff8b964750 error 4 in libc-2.12.so[7faacd7e0000+186000]
360060e801046740004f2baf000000001 dm-5 HITACHI,DF600F
size=1.6T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=0 status=active
  |- 3:0:1:1 sdg 8:96  active ready running
  |- 1:0:1:1 sdc 8:32  active ready running
  |- 2:0:1:1 sde 8:64  active ready running
  `- 4:0:1:1 sdi 8:128 active ready running
  • When using IDE, there is no issues. Using virtio causes path failure and eventually they can't access the LUNs. This platform has 2 hypervisors, 2 LUNs (2TB and 1.6TB). This system uses Brocade FC HBAs (bfa) to access the FCP storage domain.

Environment

  • Red Hat Enterprise Linux (RHEL), including
    • Red Hat Enterprise Linux 5 (RHEL5) - Observed on kernel 2.6.18-308.el5
    • Red Hat Enterprise Linux 6 (RHEL6) - Observed on kernel 2.6.32-220.13.1.el6
    • Red Hat Enterprise Linux 7 (RHEL7) - Observed on kernel 3.10.0-327.el7
    • Red Hat Enterprise Virtualization (RHEV) 3.0 - Observed on Hypervisor 2.6.32-220.13.1.el6.
  • Issue observed when using RHEV/KVM virtualization on Red Hat kernel.
    • Issue occurs when guests use virtio storage provided by HBA
    • Issue does NOT occur when guests use IDE storage provided by HBA
  • Hitachi Fabric Switches and SAN.
    • Fabric port speed configured to "auto"
  • HP OEM Brocade HBA's:
$ grep "Fibre Channel" lspci 
0b:00.0 Fibre Channel: Brocade Communications Systems, Inc. 425/825/42B/82B 4Gbps/8Gbps PCIe dual port FC HBA (rev 01)
0b:00.1 Fibre Channel: Brocade Communications Systems, Inc. 425/825/42B/82B 4Gbps/8Gbps PCIe dual port FC HBA (rev 01)
0e:00.0 Fibre Channel: Brocade Communications Systems, Inc. 425/825/42B/82B 4Gbps/8Gbps PCIe dual port FC HBA (rev 01)
0e:00.1 Fibre Channel: Brocade Communications Systems, Inc. 425/825/42B/82B 4Gbps/8Gbps PCIe dual port FC HBA (rev 01)
  • Using Tech-Preview bfa driver (provided by Red Hat kernel):
kernel: TECH PREVIEW: Brocade FCOE/FC Adapter Driver may not be fully supported.
kernel: Please review provided documentation for limitations.
kernel: Brocade BFA FC/FCOE SCSI driver - version: 3.0.2.2
kernel: bfa 0000:0b:00.0: firmware: requesting cbfw.bin
kernel: bfa 0000:0b:00.0: PCI INT A -> GSI 31 (level, low) -> IRQ 31
kernel: scsi1 : Brocade FC/FCOE Adapter, hwpath: 0000:0b:00.0 driver: 3.0.2.2
  • Issue also observed on HP bfa driver version 3.0.3.0

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content