Does Qemu support non zero pci domains for device assignments in Red Hat Enterprise Linux 6 ?

Solution Unverified - Updated -

Issue

  • Does Qemu support non zero pci domains for device assignments in Red Hat Enterprise Linux 6
  • After assigning a sriov virtual function whose pci domain in non-zero, qemu-kvm fails to start with the message "Unable to read from monitor: connection reset by peer".
    From the libvirt qemu logs
2014-03-27 03:21:44.828+0000: starting up
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin QEMU_AUDIO_DRV=spice /usr/libexec/qemu-kvm -name TESTVM -S -M rhel6.5.0 -cpu Nehalem -enable-kvm -m 4096 -realtime mlock=off -smp 4,sockets=4,cores=1,threads=1 -uuid cb0b2870-7014-4e4b-949f-dffd8a7ab326 -smbios type=1,manufacturer=Red Hat,product=RHEV Hypervisor,version=6Server-6.5.0.1.el6,serial=8B2C9555-5C8E-4221-BF48-DFF302443042,uuid=cb0b2870-7014-4e4b-949f-dffd8a7ab326 -nodefconfig -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/atest35.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2014-03-27T11:21:45,driftfix=slew -no-shutdown -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x6 -drive if=none,media=cdrom,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-drive,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0 -drive file=/rhev/data-center/d767e826-ecd2-4da3-b6a5-71836bbdefef/d55178d9-8e55-40f5-b89b-0fb5db21909c/images/b952d1b8-fc1e-4863-9f6c-dbfa0e1abf8c/5854527a-a560-44b6-8706-86555f7bcf47,if=none,id=drive-virtio-disk0,format=raw,serial=b952d1b8-fc1e-4863-9f6c-dbfa0e1abf8c,cache=none,werror=stop,rerror=stop,aio=threads -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -netdev tap,fd=27,id=hostnet0,vhost=on,vhostfd=28 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:c0:c0:12,bus=pci.0,addr=0x4 -netdev tap,fd=29,id=hostnet1,vhost=on,vhostfd=30 -device virtio-net-pci,netdev=hostnet1,id=net1,mac=00:1a:4a:c0:c0:13,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/cb0b2870-7014-4e4b-949f-dffd8a7ab326.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/cb0b2870-7014-4e4b-949f-dffd8a7ab326.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev spicevmc,id=charchannel2,name=vdagent -device virtserialport,bus=virtio-serial0.0,nr=3,chardev=charchannel2,id=channel2,name=com.redhat.spice.0 -spice port=5900,tls-port=5901,addr=172.21.25.74,x509-dir=/etc/pki/vdsm/libvirt-spice,tls-channel=main,tls-channel=display,tls-channel=inputs,tls-channel=cursor,tls-channel=playback,tls-channel=record,tls-channel=smartcard,tls-channel=usbredir,seamless-migration=on -k en-us -vga qxl -global qxl-vga.ram_size=67108864 -global qxl-vga.vram_size=33554432 -device pci-assign,host=01:00.2,id=hostdev0,configfd=31,bus=pci.0,addr=0x7 -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x8
get_real_device: /sys/bus/pci/devices/0000:01:00.2/resource: No such file or directory
qemu-kvm: -device pci-assign,host=01:00.2,id=hostdev0,configfd=31,bus=pci.0,addr=0x7: pci-assign: Error: Couldn't get real device (hostdev0)!
qemu-kvm: -device pci-assign,host=01:00.2,id=hostdev0,configfd=31,bus=pci.0,addr=0x7: Device 'pci-assign' could not be initialized
2014-03-27 03:21:45.167+0000: shutting down

Environment

  • Red Hat Enterprise Linux 6
  • Red Hat Enterprise Linux 6 update 5 Hypervisor
  • SRIOV Hook script (Modified. More details on diagnostic section(
  • RHEV 3.3
  • SGI uv2000
  • SRIOV Configuration
  • Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection
  • Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In