Overcloud update fails when deleting openstack-cinder-backup docker image

Solution In Progress - Updated -

Issue

  • Overcloud update fails when deleting openstack-cinder-backup docker image with an error similar to this one:
[stack@undercloud ~]$ openstack overcloud update run --nodes Controller
[...]
Thursday 04 July 2019  17:47:21 +0200 (0:00:00.184)       0:34:04.254 ********* 
skipping: [overcloud-controller-3] => {"changed": false, "skip_reason": "Conditional result was False"}

TASK [include] *****************************************************************
Thursday 04 July 2019  17:47:21 +0200 (0:00:00.188)       0:34:04.443 ********* 
included: /var/lib/mistral/498b808d-4873-42c6-b406-a900d4f08c0b/Controller/update_tasks.yaml for pollux-controller-3

TASK [Get docker Cinder-Backup image] ******************************************
Thursday 04 July 2019  17:47:22 +0200 (0:00:00.457)       0:34:04.901 ********* 
ok: [overcloud-controller-3] => {"ansible_facts": {"docker_image": "172.16.0.16:8787/rhosp13/openstack-cinder-backup:13.0-75.1557945142", "docker_image_latest": "10.10.10.10:8787/rhosp13/openstack-cinder-backup:pcmklatest"}, "changed": false}

TASK [Get previous Cinder-Backup image id] *************************************
Thursday 04 July 2019  17:47:22 +0200 (0:00:00.225)       0:34:05.126 ********* 
changed: [overcloud-controller-3] => {"changed": true, "cmd": "docker images | awk '/cinder-backup.* pcmklatest/{print $3}' | uniq", "delta": "0:00:00.087935", "end": "2019-07-04 17:47:22.602477", "rc": 0, "start": "2019-07-04 17:47:22.514542", "stderr": "", "stderr_lines": [], "stdout": "e3477ccc7803\n77f944e8a691", "stdout_lines": ["e3477ccc7803", "77f944e8a691"]}

TASK [Get a list of container using Cinder-Backup image] ***********************
Thursday 04 July 2019  17:47:22 +0200 (0:00:00.535)       0:34:05.662 ********* 
changed: [overcloud-controller-3] => {"changed": true, "cmd": "docker ps -a -q -f 'ancestor=e3477ccc7803\n77f944e8a691'", "delta": "0:00:00.047015", "end": "2019-07-04 17:47:23.081447", "rc": 0, "start": "2019-07-04 17:47:23.034432", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}

TASK [Remove any container using the same Cinder-Backup image] *****************
Thursday 04 July 2019  17:47:23 +0200 (0:00:00.483)       0:34:06.145 ********* 

TASK [Remove previous Cinder-Backup images] ************************************
Thursday 04 July 2019  17:47:23 +0200 (0:00:00.178)       0:34:06.324 ********* 
fatal: [overcloud-controller-3]: FAILED! => {"changed": true, "cmd": "docker rmi -f e3477ccc7803\n77f944e8a691", "delta": "0:00:00.318367", "end": "2019-07-04 17:47:24.036464", "msg": "non-zero return code", "rc": 127, "start": "2019-07-04 17:47:23.718097", "stderr": "/bin/sh: line 1: 77f944e8a691: command not found", "stderr_lines": ["/bin/sh: line 1: 77f944e8a691: command not found"], "stdout": "Untagged: registry.access.redhat.com/rhosp13/openstack-cinder-backup:latest\nUntagged: registry.access.redhat.com/rhosp13/openstack-cinder-backup:pcmklatest\nUntagged: registry.access.redhat.com/rhosp13/openstack-cinder-backup@sha256:3366a9bc0252ce6fd49d1337041fa0d70aac28691785ec9f049356c6ce205cad\nDeleted: sha256:e3477ccc7803df9cfb4908efbb0fe7a442db1752fe287d76b56445952ec2295a\nDeleted: sha256:0757c15168b61abd8b0102a4f9f43da46782240c2bcfaa85b98520ae962284ab", "stdout_lines": ["Untagged: registry.access.redhat.com/rhosp13/openstack-cinder-backup:latest", "Untagged: registry.access.redhat.com/rhosp13/openstack-cinder-backup:pcmklatest", "Untagged: registry.access.redhat.com/rhosp13/openstack-cinder-backup@sha256:3366a9bc0252ce6fd49d1337041fa0d70aac28691785ec9f049356c6ce205cad", "Deleted: sha256:e3477ccc7803df9cfb4908efbb0fe7a442db1752fe287d76b56445952ec2295a", "Deleted: sha256:0757c15168b61abd8b0102a4f9f43da46782240c2bcfaa85b98520ae962284ab"]}
[...]

Environment

  • Red Hat OpenStack Platform 13.0 (RHOSP)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In