Migrate volume fails catalog error

Solution Verified - Updated -

Issue

After upgrade the OSP9 to OSP10. When we try to migrate betwen two backeds we have the following errors.

ERROR cinder.scheduler.manager [req-6f06f347-7b30-49e9-a190-8376b40d233c 03f6769b9e8044ec9a3da12ae3a0d094 631dd6970f63484ab90d4be51cba2fc0 - - -] Failed to schedule_migrate_volume_to_host: No valid host was found. Cannot place volume 96ba5555-32a0-48d5-aca2-92e0c3975b23 on cinder-volume@INTX

--------------------------------------
INFO cinder.volume.manager [req-8d212764-f6d4-4503-8669-39e09de2663c 03f6769b9e8044ec9a3da12ae3a0d094 7563da5ac7c4423aa971c1d7d55340e2 - - -] Created volume successfully
ERROR cinder.volume.manager [req-8d212764-f6d4-4503-8669-39e09de2663c 03f6769b9e8044ec9a3da12ae3a0d094 7563da5ac7c4423aa971c1d7d55340e2 - - -] Failed to copy volume 96ba5555-32a0-48d5-aca2-92e0c3975b23 to 14b3043b-00fc-4e68-930d-17923deaa61f
ERROR cinder.volume.manager Traceback (most recent call last):
ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1910, in _migrate_volume_generic
ERROR cinder.volume.manager     new_volume.id)
ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/compute/nova.py", line 178, in update_server_volume
ERROR cinder.volume.manager     nova = novaclient(context, admin_endpoint=True, privileged_user=True)
ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/cinder/compute/nova.py", line 136, in novaclient
ERROR cinder.volume.manager     **region_filter)
ERROR cinder.volume.manager   File "/usr/lib/python2.7/site-packages/novaclient/service_catalog.py", line 84, in url_for
ERROR cinder.volume.manager     raise novaclient.exceptions.EndpointNotFound()
ERROR cinder.volume.manager EndpointNotFound
ERROR cinder.volume.manager
DEBUG oslo_messaging._drivers.amqpdriver [req-8d212764-f6d4-4503-8669-39e09de2663c 03f6769b9e8044ec9a3da12ae3a0d094 7563da5ac7c4423aa971c1d7d55340e2 - - -] CAST unique_id: f458ccf92332489ebd7a5c4d864ecaaf exchange 'openstack' topic 'cinder-volume.cinder-volume@INT_SAAS_LNX_03' _send /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py:568
DEBUG oslo_db.sqlalchemy.engines [req-8d212764-f6d4-4503-8669-39e09de2663c 03f6769b9e8044ec9a3da12ae3a0d094 7563da5ac7c4423aa971c1d7d55340e2 - - -] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION _check_effective_sql_mode /usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py:261
ERROR oslo_messaging.rpc.server [req-8d212764-f6d4-4503-8669-39e09de2663c 03f6769b9e8044ec9a3da12ae3a0d094 7563da5ac7c4423aa971c1d7d55340e2 - - -] Exception during message handling
ERROR oslo_messaging.rpc.server Traceback (most recent call last):
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming
ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 150, in dispatch
ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 121, in _do_dispatch
ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 4560, in migrate_volume
ERROR oslo_messaging.rpc.server     new_type_id=new_type_id, volume=volume)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 2116, in migrate_volume
ERROR oslo_messaging.rpc.server     volume.save()
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
ERROR oslo_messaging.rpc.server     self.force_reraise()
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 2109, in migrate_volume
ERROR oslo_messaging.rpc.server     new_type_id)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1917, in _migrate_volume_generic
ERROR oslo_messaging.rpc.server     new_volume)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
ERROR oslo_messaging.rpc.server     self.force_reraise()
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1910, in _migrate_volume_generic
ERROR oslo_messaging.rpc.server     new_volume.id)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/compute/nova.py", line 178, in update_server_volume
ERROR oslo_messaging.rpc.server     nova = novaclient(context, admin_endpoint=True, privileged_user=True)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/compute/nova.py", line 136, in novaclient
ERROR oslo_messaging.rpc.server     **region_filter)
ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/novaclient/service_catalog.py", line 84, in url_for
ERROR oslo_messaging.rpc.server     raise novaclient.exceptions.EndpointNotFound()
ERROR oslo_messaging.rpc.server EndpointNotFound
ERROR oslo_messaging.rpc.server
DEBUG cinder.volume.drivers.netapp.dataontap.client.client_cmode [-] Could not delete QOS policy groups. Details: NetApp API failed. Reason - 13005:Unable to find API: qos-policy-group-delete-iter remove_unused_qos_policy_groups /usr/lib/python2.7/site-packages/cinder/volume/drivers/netapp/dataontap/client/client_cmode.py:580

Environment

Red Hat OpenStack Platform 10.0

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content