libvirtd problem - error from service: ListActivatableNames: Connection is closed

Solution Verified - Updated -

Issue

  • After rebooting all hosts, VMs cannot launched anymore. They stay in error state. From nova compute logs:
2015-09-22 08:48:47.690 5418 ERROR nova.compute.manager [-] [instance: 5ea265ec-848a-410a-8510-8e924cdedb80] Instance failed to spawn
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80] Traceback (most recent call last):
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2288, in _build_resources
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     yield resources
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2158, in _build_and_run_instance
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     block_device_info=block_device_info)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2635, in spawn
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     block_device_info, disk_info=disk_info)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4558, in _create_domain_and_network
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     power_on=power_on)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4482, in _create_domain
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     LOG.error(err)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     six.reraise(self.type_, self.value, self.tb)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4472, in _create_domain
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     domain.createWithFlags(launch_flags)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 183, in doit
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     result = proxy_call(self._autowrap, f, *args, **kwargs)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 141, in proxy_call
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     rv = execute(f, *args, **kwargs)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 122, in execute
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     six.reraise(c, e, tb)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 80, in tworker
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     rv = meth(*args, **kwargs)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 996, in createWithFlags
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80]     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80] libvirtError: error from service: ListActivatableNames: Connection is closed
2015-09-22 08:48:47.690 5418 TRACE nova.compute.manager [instance: 5ea265ec-848a-410a-8510-8e924cdedb80] 
2015-09-22 08:48:47.691 5418 AUDIT nova.compute.manager [req-01c93cc2-9ab1-4a9f-b018-efbedf996b17 None] [instance: 5ea265ec-848a-410a-8510-8e924cdedb80] Terminating instance
2015-09-22 08:48:47.701 5418 INFO nova.virt.libvirt.driver [-] [instance: 5ea265ec-848a-410a-8510-8e924cdedb80] Instance destroyed successfully.

Environment

  • Red Hat Open Stack 5,6

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content