VM migration in RHEV environment failed due to libvirt error "Failed to inquire lock: No such process"
Issue
-
All VMs running on a specific RHEV host could not be migrated to any other host.
-
The vdsm logs on the source host contain an "libvirtError: Failed to inquire lock: No such process" error;
Thread-202::ERROR::2014-04-14 14:29:21,774::vm::338::vm.Vm::(run) vmId=`ac0d50b1-1ecf-487d-bf1d-afb9e9b030fb`::Failed to migrate
Traceback (most recent call last):
File "/usr/share/vdsm/vm.py", line 324, in run
self._startUnderlyingMigration()
File "/usr/share/vdsm/vm.py", line 406, in _startUnderlyingMigration
None, maxBandwidth)
File "/usr/share/vdsm/vm.py", line 845, in f
ret = attr(*args, **kwargs)
File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper
ret = f(*args, **kwargs)
File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1178, in migrateToURI2
if ret == -1: raise libvirtError ('virDomainMigrateToURI2() failed', dom=self)
libvirtError: Failed to inquire lock: No such process
- The vdsm logs on the destination host contain;
Thread-179721::ERROR::2014-04-14 14:29:17,692::vm::2169::vm.Vm::(_startUnderlyingVm) vmId=`ac0d50b1-1ecf-487d-bf1d-afb9e9b030fb`::The vm start process failed
Traceback (most recent call last):
File "/usr/share/vdsm/vm.py", line 2147, in _startUnderlyingVm
self._waitForIncomingMigrationFinish()
File "/usr/share/vdsm/vm.py", line 3571, in _waitForIncomingMigrationFinish
self._connection.lookupByUUIDString(self.id),
File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 76, in wrapper
ret = f(*args, **kwargs)
File "/usr/lib64/python2.6/site-packages/libvirt.py", line 2858, in lookupByUUIDString
if ret is None:raise libvirtError('virDomainLookupByUUIDString() failed', conn=self)
libvirtError: Domain not found: no domain with matching uuid 'ac0d50b1-1ecf-487d-bf1d-afb9e9b030fb'
Environment
- Red Hat Enterprise Virtualization 3.x
- Red Hat Enterprise Linux 6.5 hosts;
- vdsm-4.13.2-0.11
- libvirt-0.10.2-29.el6_5.4
- libvirt-lock-sanlock-0.10.2-29.el6_5.4
- sanlock-2.8-1
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.