Nova is trying to delete the hypervisor host when keystone is unavailable during startup

Solution Verified - Updated -

Issue

Nova is trying to delete the hypervisor host when keystone is unavailable during startup when Ironic Driver is used. Keystone takes a while to start but nova-compute doesn't wait and tries to delete the hypervisor host and subsequent restart of nova-compute restart leads to following error

2018-08-01 23:45:47.736 40915 INFO nova.compute.resource_tracker [req-37e1cb45-91e0-4f50-bfb8-3416fb03ee6a - - - - -] Compute node record created for overcloud-compute-0:91c68de7-a0d9-4188-aeb2-4ffa88e7df14 with uuid: 3aff31ab-8ce5-43dd-8698-7cb7049e52e4
2018-08-01 23:46:08.329 40915 ERROR nova.scheduler.client.report [req-37e1cb45-91e0-4f50-bfb8-3416fb03ee6a - - - - -] [req-a1b6c6f3-7a44-4c86-bf6f-86fbea62f1a0] Failed to create resource provider record in placement API for UUID 3aff31ab-8ce5-43dd-8698-7cb7049e52e4. Got 409: {"errors": [{"status": 409, "request_id": "req-a1b6c6f3-7a44-4c86-bf6f-86fbea62f1a0", "detail": "There was a conflict when trying to complete your request.\n\n Conflicting resource provider name: 91c68de7-a0d9-4188-aeb2-4ffa88e7df14 already exists.  ", "title": "Conflict"}]}.
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager [req-37e1cb45-91e0-4f50-bfb8-3416fb03ee6a - - - - -] Error updating resources for node 91c68de7-a0d9-4188-aeb2-4ffa88e7df14.: ResourceProviderCreationFailed: Failed to create resource provider 91c68de7-a0d9-4188-aeb2-4ffa88e7df14
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager Traceback (most recent call last):
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 7277, in update_available_resource_for_node
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     rt.update_available_resource(context, nodename)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 680, in update_available_resource
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     self._update_available_resource(context, resources)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 274, in inner
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     return f(*args, **kwargs)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 704, in _update_available_resource
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     self._init_compute_node(context, resources)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 590, in _init_compute_node
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     self._update(context, cn)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 878, in _update
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     inv_data,
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 68, in set_inventory_for_provider
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     parent_provider_uuid=parent_provider_uuid,
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 37, in __run_method
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     return getattr(self.instance, __name)(*args, **kwargs)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 1093, in set_inventory_for_provider
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     parent_provider_uuid=parent_provider_uuid)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 664, in _ensure_resource_provider
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     parent_provider_uuid=parent_provider_uuid)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 66, in wrapper
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     return f(self, *a, **k)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager   File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 611, in _create_resource_provider
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager     raise exception.ResourceProviderCreationFailed(name=name)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager ResourceProviderCreationFailed: Failed to create resource provider 91c68de7-a0d9-4188-aeb2-4ffa88e7df14
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager

Environment

Red Hat OpenStack Platform 13

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.