Overcloud update failed stuck IN_PROGRESS
Issue
- Overcloud deploy fails during scale up of existing deployment. This scale up failed due to the internal network connectivity error (the interal api and storage networks). This was a cabling mismatch on the switch. This was resolved and the deploy restarted.
- Subsequent deploy attempts fail quickly with a 409:
(undercloud) [stack@director stack]$ ./deployCloud.sh
Started Mistral Workflow tripleo.validations.v1.check_pre_deployment_validations. Execution ID: f664a766-bc8b-4c4e-9326-c4315c7db1c7
Waiting for messages on queue 'tripleo' with no timeout.
{u'body': {u'exception': u'Object DELETE failed: https://<ip>:13808/v1/AUTH_<redacted>/zaqar_message%3Atripleo%<redacted>/<redacted> 409 Conflict [first 60 chars of response] <html><h1>Conflict</h1><p>There was a conflict when trying t', u'error': u'Unexpected error.'}, u'headers': {u'status': 500}, u'request': {u'action': u'queue_delete', u'body': {u'queue_name': u'tripleo'}, u'api': u'v2', u'headers': {u'Client-ID': u'<redacted>', u'X-Project-ID': u'<redacted>'}}}
real 1m56.668s
user 0m1.227s
sys 0m0.200s
- the overcloud stack is stuck UPDATE_IN_PROGRESS
$ openstack stack list
+--------------------------------------+-----------------+----------------------------------+--------------------+----------------------+----------------------+
| ID | Stack Name | Project | Stack Status | Creation Time | Updated Time |
+--------------------------------------+-----------------+----------------------------------+--------------------+----------------------+----------------------+
| <id> | overcloud | <project> | UPDATE_IN_PROGRESS | 2019-08-02T16:57:22Z | 2021-03-09T13:57:36Z |
+--------------------------------------+-----------------+----------------------------------+--------------------+----------------------+----------------------+
Environment
- Red Hat OpenStack Platform 10.0
- Red Hat OpenStack Platform 13.0
- Red Hat OpenStack Platform 16.x
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.
