Red Hat Ansible Automation Platform upgrade fails on task "TASK [ansible.automation_platform_installer.podman : Reset podman for awx user to apply configs] ***"

Issue

• Red Hat Ansible Automation Platform upgrade fails on task "TASK [ansible.automation_platform_installer.podman : Reset podman for awx user to apply configs] ***" with the following error.

  TASK [ansible.automation_platform_installer.podman : Reset podman for awx user to apply configs] ***
  task path: /opt/ansible-automation-platform/installer/collections/ansible_collections/ansible/automation_platform_installer/roles/podman/tasks/main.yml:136
  changed: [ansible.example.local] => {"changed": true, "cmd": ["podman", "system", "reset", "-f"], "delta": "0:00:00.352750", "end": "2024-01-23 09:56:55.174610", "msg": "", "rc": 0, "start": "2024-01-23 09:56:54.821860", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
  fatal: [ansible.example.local]: FAILED! => {"changed": true, "cmd": ["podman", "system", "reset", "-f"], "delta": "0:00:24.152959", "end": "2024-01-23 09:57:18.171150", "msg": "non-zero return code", "rc": 125, "start": "2024-01-23 09:56:54.018191", "stderr": "time=\"2024-01-23T09:56:54-06:00\" level=error msg=\"cleaning up storage: removing container f69ac058d9280b4c90d5f255b5abae5eafe92f0399266274b1248018f330865b root filesystem: unmounting \\\"/var/lib/awx/.local/share/containers/storage/overlay/1b5f65d5bca7d94b4cfbc48bed22617734b078c662c6e60c313cee30aefcf017/merged\\\": invalid argument\"\ntime=\"2024-01-23T09:57:18-06:00\" level=error msg=\"image used by f69ac058d9280b4c90d5f255b5abae5eafe92f0399266274b1248018f330865b: image is in use by a container: consider listing external containers and force-removing image\"", "stderr_lines": ["time=\"2024-01-23T09:56:54-06:00\" level=error msg=\"cleaning up storage: removing container f69ac058d9280b4c90d5f255b5abae5eafe92f0399266274b1248018f330865b root filesystem: unmounting \\\"/var/lib/awx/.local/share/containers/storage/overlay/1b5f65d5bca7d94b4cfbc48bed22617734b078c662c6e60c313cee30aefcf017/merged\\\": invalid argument\"", "time=\"2024-01-23T09:57:18-06:00\" level=error msg=\"image used by f69ac058d9280b4c90d5f255b5abae5eafe92f0399266274b1248018f330865b: image is in use by a container: consider listing external containers and force-removing image\""], "stdout": "", "stdout_lines": []}
  changed: [ansible.example.local] => {"changed": true, "cmd": ["podman", "system", "reset", "-f"], "delta": "0:00:38.462540", "end": "2024-01-23 09:57:32.104333", "msg": "", "rc": 0, "start": "2024-01-23 09:56:53.641793", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}
      changed: [ansible.example.local] => {"changed": true, "cmd": ["podman", "system", "reset", "-f"], "delta": "0:00:55.495355", "end": "2024-01-23 09:57:50.451172", "msg": "", "rc": 0, "start": "2024-01-23 09:56:54.955817", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []}