Nova is trying to delete the hypervisor host when keystone is unavailable during startup
Issue
Nova is trying to delete the hypervisor host when keystone is unavailable during startup when Ironic Driver is used. Keystone takes a while to start but nova-compute doesn't wait and tries to delete the hypervisor host and subsequent restart of nova-compute restart leads to following error
2018-08-01 23:45:47.736 40915 INFO nova.compute.resource_tracker [req-37e1cb45-91e0-4f50-bfb8-3416fb03ee6a - - - - -] Compute node record created for overcloud-compute-0:91c68de7-a0d9-4188-aeb2-4ffa88e7df14 with uuid: 3aff31ab-8ce5-43dd-8698-7cb7049e52e4
2018-08-01 23:46:08.329 40915 ERROR nova.scheduler.client.report [req-37e1cb45-91e0-4f50-bfb8-3416fb03ee6a - - - - -] [req-a1b6c6f3-7a44-4c86-bf6f-86fbea62f1a0] Failed to create resource provider record in placement API for UUID 3aff31ab-8ce5-43dd-8698-7cb7049e52e4. Got 409: {"errors": [{"status": 409, "request_id": "req-a1b6c6f3-7a44-4c86-bf6f-86fbea62f1a0", "detail": "There was a conflict when trying to complete your request.\n\n Conflicting resource provider name: 91c68de7-a0d9-4188-aeb2-4ffa88e7df14 already exists. ", "title": "Conflict"}]}.
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager [req-37e1cb45-91e0-4f50-bfb8-3416fb03ee6a - - - - -] Error updating resources for node 91c68de7-a0d9-4188-aeb2-4ffa88e7df14.: ResourceProviderCreationFailed: Failed to create resource provider 91c68de7-a0d9-4188-aeb2-4ffa88e7df14
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager Traceback (most recent call last):
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 7277, in update_available_resource_for_node
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager rt.update_available_resource(context, nodename)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 680, in update_available_resource
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager self._update_available_resource(context, resources)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 274, in inner
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager return f(*args, **kwargs)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 704, in _update_available_resource
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager self._init_compute_node(context, resources)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 590, in _init_compute_node
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager self._update(context, cn)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 878, in _update
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager inv_data,
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 68, in set_inventory_for_provider
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager parent_provider_uuid=parent_provider_uuid,
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 37, in __run_method
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager return getattr(self.instance, __name)(*args, **kwargs)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 1093, in set_inventory_for_provider
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager parent_provider_uuid=parent_provider_uuid)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 664, in _ensure_resource_provider
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager parent_provider_uuid=parent_provider_uuid)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 66, in wrapper
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager return f(self, *a, **k)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager File "/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 611, in _create_resource_provider
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager raise exception.ResourceProviderCreationFailed(name=name)
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager ResourceProviderCreationFailed: Failed to create resource provider 91c68de7-a0d9-4188-aeb2-4ffa88e7df14
2018-08-01 23:46:08.330 40915 ERROR nova.compute.manager
Environment
Red Hat OpenStack Platform 13
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
