Error during live-migration with error /etc/multipath.conf does not exist
Issue
- While migrating a set of instances:
openstack server migrate 366ec0bc-def7-48e7-a05c-7fb9589b09bc --live comp1
- migration fails with error, as reported in /var/log/containers/nova/nova-compute.log:
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] Traceback (most recent call last):
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 6192, in _do_live_migration
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] block_migration, migrate_data)
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 6937, in live_migration
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] migrate_data)
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 7420, in _live_migration
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] finish_event, disk_paths)
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 7331, in _live_migration_monitor
[...]
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] ProcessExecutionError: Unexpected error while running command.
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] Command: multipath -f /dev/disk/by-id/dm-uuid-mpath-160060e8012a705005040a70500000322
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] Exit code: 1
ERROR nova.compute.manager [instance: 366ec0bc-def7-48e7-a05c-7fb9589b09bc] Stdout: u'Sep 23 12:45:58 | /etc/multipath.conf does not exist, blacklisting all devices.\nSep 23 12:45:58 | A default multipath.conf file is located at\nSep 23 12:45:58 | /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf\nSep 23 12:45:58 | You can run /sbin/mpathconf --enable to create\nSep 23 12:45:58 | /etc/multipath.conf. See man mpathconf(8) for more details\nSep 23 12:45:58 | 160060e8012a705005040a70500000322p1: map in use\nSep 23 12:45:58 | failed to remove multipath map /dev/disk/by-id/dm-uuid-mpath-160060e8012a705005040a70500000322\n'
Migration failed on 2 different instances, vm are now in ERROR status and are unusable.
- The failure here looks like multiple instances looking at the same mpath devices.
Environment
- Red Hat OpenStack Platform 13 (RHOSP13)
- LVM configured on the volumes attached to instances
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.