Migration failed

Solution In Progress - Updated -

Issue

  • During failover test , we did one path down from 4 path after that live migration got failed and system went into error state:
(overcloud) [stack@undercloud ~]$ nova show c56c8650-315a-4b52-b3f8-bf70f8f7f602
+------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property                                 | Value                                                                                                                                                                                                                                            |
+------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| OS-DCF:diskConfig                        | MANUAL                                                                                                                                                                                                                                           |
| OS-EXT-AZ:availability_zone              | nova                                                                                                                                                                                                                                          |
| OS-EXT-SRV-ATTR:host                     | overcloud-compute-0.localdomain                                                                                                                                                                                                                   |
| OS-EXT-SRV-ATTR:hostname                 | test-vm                                                                                                                                                                                                                           |
| OS-EXT-SRV-ATTR:hypervisor_hostname      | overcloud-compute-0.localdomain                                                                                                                                                                                                                   |
| OS-EXT-SRV-ATTR:instance_name            | instance-00000217                                                                                                                                                                                                                                |
| OS-EXT-SRV-ATTR:kernel_id                |                                                                                                                                                                                                                                                  |
| OS-EXT-SRV-ATTR:launch_index             | 0                                                                                                                                                                                                                                                |
| OS-EXT-SRV-ATTR:ramdisk_id               |                                                                                                                                                                                                                                                  |
| OS-EXT-SRV-ATTR:reservation_id           | r-u756jke2                                                                                                                                                                                                                                       |
| OS-EXT-SRV-ATTR:root_device_name         | /dev/vda                                                                                                                                                                                                                                         |
| OS-EXT-SRV-ATTR:user_data                | -                                                                                                                                                                                                                                                |
| OS-EXT-STS:power_state                   | 0                                                                                                                                                                                                                                                |
| OS-EXT-STS:task_state                    | -                                                                                                                                                                                                                                                |
| OS-EXT-STS:vm_state                      | error                                                                                                                                                                                                                                            |
| OS-SRV-USG:launched_at                   | 2019-05-21T22:43:50.000000                                                                                                                                                                                                                       |
| OS-SRV-USG:terminated_at                 | -                                                                                                                                                                                                                                                |
| accessIPv4                               |                                                                                                                                                                                                                                                  |
| accessIPv6                               |                                                                                                                                                                                                                                                  |
| config_drive                             |                                                                                                                                                                                                                                                  |
| created                                  | 2019-05-21T22:43:39Z                                                                                                                                                                                                                             |
| description                              | puvl-pa-sendercluster1                                                                                                                                                                                                                           |
| fault                                    | {"message": "Unable to find a Fibre Channel volume device.", "code": 500, "details": "  File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 202, in decorated_function                                                       |
|                                          |     return function(self, context, *args, **kwargs)                                                                                                                                                                                              |
|                                          |   File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 3282, in reboot_instance                                                                                                                                               |
|                                          |     self._set_instance_obj_error_state(context, instance)                                                                                                                                                                                        |
|                                          |   File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 220, in __exit__                                                                                                                                                        |
|                                          |     self.force_reraise()                                                                                                                                                                                                                         |
|                                          |   File \"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py\", line 196, in force_reraise                                                                                                                                                   |
|                                          |     six.reraise(self.type_, self.value, self.tb)                                                                                                                                                                                                 |
|                                          |   File \"/usr/lib/python2.7/site-packages/nova/compute/manager.py\", line 3257, in reboot_instance                                                                                                                                               |
|                                          |     bad_volumes_callback=bad_volumes_callback)                                                                                                                                                                                                   |
|                                          |   File \"/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 2702, in reboot                                                                                                                                                    |
|                                          |     block_device_info)                                                                                                                                                                                                                           |
|                                          |   File \"/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 2796, in _hard_reboot                                                                                                                                              |
|                                          |     mdevs=mdevs)                                                                                                                                                                                                                                 |
|                                          |   File \"/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 5429, in _get_guest_xml                                                                                                                                            |
|                                          |     context, mdevs)                                                                                                                                                                                                                              |
|                                          |   File \"/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 5219, in _get_guest_config                                                                                                                                         |
|                                          |     flavor, guest.os_type)                                                                                                                                                                                                                       |
|                                          |   File \"/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 4065, in _get_guest_storage_config                                                                                                                                 |
|                                          |     self._connect_volume(context, connection_info, instance)                                                                                                                                                                                     |
|                                          |   File \"/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 1252, in _connect_volume                                                                                                                                           |
|                                          |     vol_driver.connect_volume(connection_info, instance)                                                                                                                                                                                         |
|                                          |   File \"/usr/lib/python2.7/site-packages/nova/virt/libvirt/volume/fibrechannel.py\", line 54, in connect_volume                                                                                                                                 |
|                                          |     device_info = self.connector.connect_volume(connection_info['data'])                                                                                                                                                                         |
|                                          |   File \"/usr/lib/python2.7/site-packages/os_brick/utils.py\", line 137, in trace_logging_wrapper                                                                                                                                                |
|                                          |     return f(*args, **kwargs)                                                                                                                                                                                                                    |
|                                          |   File \"/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py\", line 274, in inner                                                                                                                                                    |
|                                          |     return f(*args, **kwargs)                                                                                                                                                                                                                    |
|                                          |   File \"/usr/lib/python2.7/site-packages/os_brick/initiator/connectors/fibre_channel.py\", line 233, in connect_volume                                                                                                                          |
|                                          |     timer.start(interval=2).wait()                                                                                                                                                                                                               |
|                                          |   File \"/usr/lib/python2.7/site-packages/eventlet/event.py\", line 121, in wait                                                                                                                                                                 |
|                                          |     return hubs.get_hub().switch()                                                                                                                                                                                                               |
|                                          |   File \"/usr/lib/python2.7/site-packages/eventlet/hubs/hub.py\", line 294, in switch                                                                                                                                                            |
|                                          |     return self.greenlet.switch()

Environment

  • Red Hat OpenStack Platform 13.0 (RHOSP)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content