VM Import failed on the destination data center even after the orphaned volume was removed
Environment
- Red Hat Enterprise Virtualization 3.0
Issue
- VM Import failed on the destination data center even after the orphaned volume was removed
Resolution
- Run the following:
# dmsetup remove <logical volume that's failing to be created>
- And then perform the import again.
Root Cause
- The logical volume that RHEV is trying to create when importing already exists in the device-mapper maps. It must be removed from device-mapper so that the logical volume can be created.
Diagnostic Steps
- rhevm:
2012-09-12 19:03:50,535 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (pool-10-thread-42) -- copyImage parameters:
sdUUID=d83b6812-1de2-4232-93f1-b361ec866d03
spUUID=dd2087c2-c9f3-40aa-b28f-945bcc55e0cb
vmGUID=420e0670-742d-4901-a9c1-dff82ac10327
srcImageGUID=47b29c0d-f415-4cb1-b4ed-972785a80650
srcVolUUID=dc201a07-d588-444a-a11f-c4c51dce7ec1
dstImageGUID=47b29c0d-f415-4cb1-b4ed-972785a80650
dstVolUUID=dc201a07-d588-444a-a11f-c4c51dce7ec1
descr=_Undefined_5/28/2010 8:30:36 AM
2012-09-12 19:03:50,987 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (pool-10-thread-42) FINISH, CopyImageVDSCommand, return: 00000000-0000-0000-0000-000000000000, log id: 5910525b
2012-09-12 19:03:50,989 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-10-thread-42) BaseAsyncTask::AddOrUpdateTaskInDB: Adding task 0eef7687-6291-4c3b-9aaf-3f4572fc4fbb to DataBase
...
2012-09-12 19:03:58,933 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (QuartzScheduler_Worker-80) Error code CannotCreateLogicalVolume and error message VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Cannot create Logical Volume
- vdsm.log on host
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::DEBUG::2012-09-12 23:03:50,988::task::907::TaskManager.Task::(_runJobs) Task.run: running job 0: copyImage: <bound method Secure.run of <storage.spm.Secure instance at 0xef6680>> (args: ('d83b6812-1de2-4232-93f1-b361ec866d03', 'dd2087c2-c9f3-40aa-b28f-945bcc55e0cb', '420e0670-742d-4901-a9c1-dff82ac10327', '47b29c0d-f415-4cb1-b4ed-972785a80650', 'dc201a07-d588-444a-a11f-c4c51dce7ec1', '47b29c0d-f415-4cb1-b4ed-972785a80650', 'dc201a07-d588-444a-a11f-c4c51dce7ec1', '_Undefined_5/28/2010 8:30:36 AM', 'fef46b38-e253-4045-ab41-c2d45767e80a', 8, 5, 1, False, True) kwargs: {})
...
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::INFO::2012-09-12 23:03:52,232::image::451::Storage.Image::(isLegal) image 47b29c0d-f415-4cb1-b4ed-972785a80650 in domain fef46b38-e253-4045-ab41-c2d45767e80a has vollist []
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::INFO::2012-09-12 23:03:52,233::image::760::Storage.Image::(copy) delete image 47b29c0d-f415-4cb1-b4ed-972785a80650 on domain fef46b38-e253-4045-ab41-c2d45767e80a before overwriting
...
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::WARNING::2012-09-12 23:03:53,506::lvm::660::Storage.LVM::(getLv) lv: dc201a07-d588-444a-a11f-c4c51dce7ec1 not found in lvs vg: fef46b38-e253-4045-ab41-c2d45767e80a response
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::INFO::2012-09-12 23:03:53,508::image::86::Storage.Image::(create) Create placeholder /rhev/data-center/dd2087c2-c9f3-40aa-b28f-945bcc55e0cb/fef46b38-e253-4045-ab41-c2d45767e80a/images/47b29c0d-f415-4cb1-b4ed-972785a80650 for image's volumes
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::DEBUG::2012-09-12 23:03:53,510::task::755::TaskManager.Task::(_save) _save: orig /rhev/data-center/dd2087c2-c9f3-40aa-b28f-945bcc55e0cb/mastersd/master/tasks/0eef7687-6291-4c3b-9aaf-3f4572fc4fbb temp /rhev/data-center/dd2087c2-c9f3-40aa-b28f-945bcc55e0cb/mastersd/master/tasks/0eef7687-6291-4c3b-9aaf-3f4572fc4fbb.temp
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::INFO::2012-09-12 23:03:53,522::blockVolume::172::Storage.Volume::(create) blockVolume: creating LV: volUUID dc201a07-d588-444a-a11f-c4c51dce7ec1
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::DEBUG::2012-09-12 23:03:53,524::task::755::TaskManager.Task::(_save) _save: orig /rhev/data-center/dd2087c2-c9f3-40aa-b28f-945bcc55e0cb/mastersd/master/tasks/0eef7687-6291-4c3b-9aaf-3f4572fc4fbb temp /rhev/data-center/dd2087c2-c9f3-40aa-b28f-945bcc55e0cb/mastersd/master/tasks/0eef7687-6291-4c3b-9aaf-3f4572fc4fbb.temp
[mku: the lvcreate command]
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::DEBUG::2012-09-12 23:03:53,538::lvm::374::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 filter = [ \\"a%360a9800064664350646f6b526f4f742f|360a9800064664350646f6b526f4f7579|360a9800064664350646f6b526f4f7751|360a9800064664350646f6b526f4f786b|360a9800064664350646f6b526f4f7a33|360a9800064664350646f6b526f503052|360a9800064664350646f6d302d58454f|360a9800064664350646f6d302d584669%\\", \\"r%.*%\\" ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 10m --name dc201a07-d588-444a-a11f-c4c51dce7ec1 fef46b38-e253-4045-ab41-c2d45767e80a' (cwd None)
.......
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::DEBUG::2012-09-12 23:03:54,046::lvm::374::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' WARNING: This metadata update is NOT backed up\n device-mapper: create ioctl failed: Device or resource busy\n Failed to activate new LV.\n WARNING: This metadata update is NOT backed up\n'; <rc> = 5
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::ERROR::2012-09-12 23:03:54,055::blockVolume::185::Storage.Volume::(create) Unexpected error
Traceback (most recent call last):
File "/usr/share/vdsm/storage/blockVolume.py", line 180, in create
File "/usr/share/vdsm/storage/lvm.py", line 1027, in createLV
CannotCreateLogicalVolume: Cannot create Logical Volume: ('fef46b38-e253-4045-ab41-c2d45767e80a', 'dc201a07-d588-444a-a11f-c4c51dce7ec1')
0eef7687-6291-4c3b-9aaf-3f4572fc4fbb::ERROR::2012-09-12 23:03:54,056::image::783::Storage.Image::(copy) Unexpected error
Traceback (most recent call last):
File "/usr/share/vdsm/storage/image.py", line 770, in copy
File "/usr/share/vdsm/storage/blockSD.py", line 445, in createVolume
File "/usr/share/vdsm/storage/blockVolume.py", line 180, in create
File "/usr/share/vdsm/storage/lvm.py", line 1027, in createLV
CannotCreateLogicalVolume: Cannot create Logical Volume: ('fef46b38-e253-4045-ab41-c2d45767e80a', 'dc201a07-d588-444a-a11f-c4c51dce7ec1')
- In dmsetup_ls_--tree:
fef46b38--e253--4045--ab41--c2d45767e80a-dc201a07--d588--444a--a11f--c4c51dce7e...
└─360a9800064664350646f6b526f4f7a33 (253:4)
├─ (65:96)
├─ (65:0)
├─ (65:128)
└─ (8:64)
This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
