Not able to create the snapshot of dpdk based instance

Solution In Progress - Updated -

Issue

  • Not able to create the snapshot of dpdk based instance.
  • Snapshot command on dpdk based instance didn't throw any error on terminal but snapshot is not created.
  • Snapshot of dpdk based instance is getting failed with following call trace in compute node /var/log/nova/nova-compute.log log file
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server [req-f815e4d0-1555-459d-9e33-6a591e003e6a fb779c2a36a34a95b04571ecad682431 b08633e159af4c8c8757fb31e7ed41e4 - - -] Exception during message handling
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 150, in dispatch
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 121, in _do_dispatch
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 75, in wrapped
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     function_name, call_dict, binary)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     self.force_reraise()
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 66, in wrapped
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 188, in decorated_function
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     LOG.warning(msg, e, instance=instance)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     self.force_reraise()
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 157, in decorated_function
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 216, in decorated_function
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     kwargs['instance'], e, sys.exc_info())
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     self.force_reraise()
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 204, in decorated_function
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 242, in decorated_function
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     instance=instance)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     self.force_reraise()
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 232, in decorated_function
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     *args, **kwargs)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3038, in snapshot_instance
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     task_states.IMAGE_SNAPSHOT)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 3068, in _snapshot_instance
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     update_task_state)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1470, in snapshot
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     instance)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1563, in _prepare_domain_for_snapshot
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     self.suspend(context, instance)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2445, in suspend
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     guest.save_memory_state()
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/guest.py", line 425, in save_memory_state
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     self._domain.managedSave(0)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 186, in doit
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 144, in proxy_call
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1417, in managedSave
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server     if ret == -1: raise libvirtError ('virDomainManagedSave() failed', dom=self)
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server libvirtError: internal error: unable to execute QEMU command 'migrate': Migration disabled: vhost-user backend lacks VHOST_USER_PROTOCOL_F_LOG_SHMFD feature.
2017-03-28 08:53:34.075 49980 ERROR oslo_messaging.rpc.server

Environment

  • Red Hat OpenStack Platform 10.0
  • ovs-dpdk 2.5

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content