Why does instances fail to start after patching compute node with error "filter 'nova-instance-instance-xxx-yyy' already exists with uuid" ?

Solution Verified - Updated -

Issue

  • After upgrade of RHEL 7.0 based compute node to latest packages, existing instances fail to start .
  • Existing Instance fail to start when nwfilter is already defined .
  • Instance fail with error "filter 'nova-instance-instance-xxx-yyy' already exists with uuid" .

2015-03-24 11:32:21.175 3112 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: operation failed: filter 'nova-instance-instance-0000008a-fa163e4965fe' already exists with uuid 552e20d8-c90b-7bbf-6909-d6e4c8e9f4ac 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last): 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher incoming.message)) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher return self._do_dispatch(endpoint, method, ctxt, args) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher result = getattr(endpoint, method)(ctxt, **new_args) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in wrapped 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher payload) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__ 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in wrapped 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher return f(self, context, *args, **kw) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 276, in decorated_function 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher pass 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__ 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 262, in decorated_function 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 329, in decorated_function 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher function(self, context, *args, **kwargs) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 305, in decorated_function 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher e, sys.exc_info()) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__ 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 292, in decorated_function 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher return function(self, context, *args, **kwargs) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2330, in start_instance 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher self._power_on(context, instance) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2318, in _power_on 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher block_device_info) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2198, in power_on 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher self._hard_reboot(context, instance, network_info, block_device_info) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2162, in _hard_reboot 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher vifs_already_plugged=True) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3740, in _create_domain_and_network 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher network_info) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/firewall.py", line 285, in setup_basic_filtering 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher self.nwfilter.setup_basic_filtering(instance, network_info) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/firewall.py", line 126, in setup_basic_filtering 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher vif)) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/firewall.py", line 233, in _define_filter 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher self._conn.nwfilterDefineXML(xml) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 179, in doit 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher result = proxy_call(self._autowrap, f, *args, **kwargs) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 139, in proxy_call 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher rv = execute(f,*args,**kwargs) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 77, in tworker 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher rv = meth(*args,**kwargs) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher File "/usr/lib64/python2.7/site-packages/libvirt.py", line 4044, in nwfilterDefineXML 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher if ret is None:raise libvirtError('virNWFilterDefineXML() failed', conn=self) 2015-03-24 11:32:21.175 3112 TRACE oslo.messaging.rpc.dispatcher libvirtError: operation failed: filter 'nova-instance-instance-0000008a-fa163e4965fe' already exists with uuid 552e20d8-c90b-7bbf-6909-d6e4c8e9f4ac

Environment

  • Red Hat OpenStack 5.0 on RHEL 7
  • python-nova-2014.1.3-9.el7ost.noarch

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content