Permission denied upon stack redeployment with same name in Red Hat OpenStack Platform 16

Issue

Initially, the overcloud deployment failed due to incorrect parameters in rhsm.yaml file. Later I removed the existing stack, fixed the template and tried to redeploy. But then it failed during the deployment due to permission issue on /var/lib/mistral/stack1/.git/index [1]. I tried updating the owner:group to mistral. But, no luck. To workaround the issue, I used different overcloud stack name.

[1]

(undercloud) [stack@director01 scripts]$ bash deploy.sh
[...]
ssh admin enablement workflow - COMPLETE.
Removing TripleO short term key from 172.23.208.99
Warning: Permanently added '172.23.208.99' (ECDSA) to the list of known hosts.
Removing TripleO short term key from 172.23.208.66
Warning: Permanently added '172.23.208.66' (ECDSA) to the list of known hosts.
Removing TripleO short term key from 172.23.208.65
Warning: Permanently added '172.23.208.65' (ECDSA) to the list of known hosts.
Removing TripleO short term key from 172.23.208.94
Warning: Permanently added '172.23.208.94' (ECDSA) to the list of known hosts.
Removing TripleO short term key from 172.23.208.57
Warning: Permanently added '172.23.208.57' (ECDSA) to the list of known hosts.
Removing short term keys locally
Enabling ssh admin - COMPLETE.
Waiting for messages on queue 'tripleo' with no timeout.
The action raised an exception [action_ex_id=92ab67d4-b2c0-41c2-91f7-7e86980f8903, msg='[Errno 13] Permission denied: '/var/lib/mistral/stack1/.git/index'', action_cls='<class 'mistral.actions.action_factory.DownloadConfigAction'>', attributes='{}', params='{'work_dir': '/var/lib/mistral/stack1', 'container_config': 'stack1-config'}']
Overcloud configuration failed.

2020-03-02 14:01:24.598 7 DEBUG swiftclient [req-d0dc741f-80f2-49a2-a7eb-533b9a17424c 1d1d32783fff4ffc81448d5b83e62b25 08a5df2269874d74959f0c03d44ce0b6 - default default] R
EQ: curl -i https://172.23.208.52:13808/v1/AUTH_08a5df2269874d74959f0c03d44ce0b6/stack1-config/.git/index -X GET -H "X-Auth-Token: gAAAAABeXVE7_5TS..." http_log /usr/lib/pyth
on3.6/site-packages/swiftclient/client.py:182
2020-03-02 14:01:24.599 7 DEBUG swiftclient [req-d0dc741f-80f2-49a2-a7eb-533b9a17424c 1d1d32783fff4ffc81448d5b83e62b25 08a5df2269874d74959f0c03d44ce0b6 - default default] R
ESP STATUS: 200 OK http_log /usr/lib/python3.6/site-packages/swiftclient/client.py:183
2020-03-02 14:01:24.599 7 DEBUG swiftclient [req-d0dc741f-80f2-49a2-a7eb-533b9a17424c 1d1d32783fff4ffc81448d5b83e62b25 08a5df2269874d74959f0c03d44ce0b6 - default default] R
ESP HEADERS: {'Content-Type': 'application/octet-stream', 'Etag': '4511e34a0203130e98c7b1c7329c34c7', 'Last-Modified': 'Mon, 02 Mar 2020 19:01:19 GMT', 'X-Timestamp': '1583
175678.52963', 'Accept-Ranges': 'bytes', 'Content-Length': '24408', 'X-Trans-Id': 'txdf08625dfd0840f895758-005e5d5804', 'X-Openstack-Request-Id': 'txdf08625dfd0840f895758-0
05e5d5804', 'Date': 'Mon, 02 Mar 2020 19:01:24 GMT'} http_log /usr/lib/python3.6/site-packages/swiftclient/client.py:184
2020-03-02 14:01:24.600 7 WARNING mistral.executors.default_executor [req-d0dc741f-80f2-49a2-a7eb-533b9a17424c 1d1d32783fff4ffc81448d5b83e62b25 08a5df2269874d74959f0c03d44c
e0b6 - default default] The action raised an exception [action_ex_id=92ab67d4-b2c0-41c2-91f7-7e86980f8903, msg='[Errno 13] Permission denied: '/var/lib/mistral/stack1/.git/in
dex'', action_cls='<class 'mistral.actions.action_factory.DownloadConfigAction'>', attributes='{}', params='{'work_dir': '/var/lib/mistral/stack1', 'container_config': 'stack1-
config'}']: PermissionError: [Errno 13] Permission denied: '/var/lib/mistral/stack1/.git/index'
2020-03-02 14:01:24.600 7 ERROR mistral.executors.default_executor Traceback (most recent call last):
2020-03-02 14:01:24.600 7 ERROR mistral.executors.default_executor   File "/usr/lib/python3.6/site-packages/mistral/executors/default_executor.py", line 133, in _do_run_act
ion
2020-03-02 14:01:24.600 7 ERROR mistral.executors.default_executor     result = action.run(action_ctx)
2020-03-02 14:01:24.600 7 ERROR mistral.executors.default_executor   File "/usr/lib/python3.6/site-packages/tripleo_common/actions/config.py", line 124, in run
2020-03-02 14:01:24.600 7 ERROR mistral.executors.default_executor     self.work_dir)
2020-03-02 14:01:24.600 7 ERROR mistral.executors.default_executor   File "/usr/lib/python3.6/site-packages/tripleo_common/utils/swift.py", line 98, in download_container
2020-03-02 14:01:24.600 7 ERROR mistral.executors.default_executor     with open(path, 'wb') as f:
2020-03-02 14:01:24.600 7 ERROR mistral.executors.default_executor PermissionError: [Errno 13] Permission denied: '/var/lib/mistral/stack1/.git/index'
2020-03-02 14:01:24.600 7 ERROR mistral.executors.default_executor

[root@director01 mistral]# ll /var/lib/mistral/stack1/.git
total 40
-rw-r--r--.   1 42430 42430    92 Mar  2 14:01 config
-rw-r--r--.   1 42430 42430    73 Mar  2 14:01 description
-rw-r--r--.   1 42430 42430    23 Mar  2 14:01 HEAD
drwxr-xr-x.   2 42430 42430   210 Mar  2 12:29 hooks
-rw-r--r--.   1 root  root  24408 Mar  2 13:33 index
drwxr-xr-x.   2 42430 42430    21 Mar  2 12:29 info
drwxr-xr-x.   3 42430 42430    30 Mar  2 12:29 logs
drwxr-xr-x. 115 42430 42430  4096 Mar  2 12:30 objects
drwxr-xr-x.   3 42430 42430    19 Mar  2 12:30 refs