Instance using SR-IOV with Intel NIC using i40e driver fails with 'Cannot set interface MAC/vlanid...vf 6: Resource temporarily unavailable'

Issue

• Instance using SR-IOV with Intel NIC using i40e driver fails with

  Cannot set interface MAC/vlanid to <MAC_ADDRESS>/0 for ifname <INTERFACE> vf 6: Resource temporarily unavailable
  

• /var/log/messages shows that the MAC address can not be set:

  kernel: i40evf <PCI_ID>: Unable to send opcode 2 to PF, err I40E_ERR_QUEUE_EMPTY, aq_err OK
  libvirtd: <TIME_STAMP>: 2815: error : virNetDevSetVfConfig:1623 : Cannot set interface MAC/vlanid to <MAC_ADDRESS>/0 for ifname <INTERFACE> vf 6: Resource temporarily unavailable
  kernel: i40e <PCI_ID>: VF 6 still in reset. Try again.
  libvirtd: <TIME_STAMP>: warning : qemuProcessBuildDestroyHugepagesPath:3321 : Unable to remove hugepage path: /dev/hugepages/libvirt/qemu/38-instance-00000069 (errno=2)
  kernel: i40evf <PCI_ID>: enabling device (0000 -> 0002)
  ovs-vsctl: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=5 -- --if-exists del-port tapb6459a37-56
  ovs-vsctl: ovs|00001|vsctl|INFO|Called as ovs-vsctl --timeout=5 -- --if-exists del-port tapafc23e3d-61
  kernel: i40evf <PCI_ID>: Device is still in reset (-16), retrying
  

  Note that time stamps, hostnames, and system-unique information (eg: MAC addresses, interfaces, PCI addresses) have been omitted from the above output