Initial overcloud deploy with hitachi driver failed

Issue

• We are trying to deploy overcloud with cinder hitachi driver, but on inicial deploy it fails

• Our environment is these:

3 controllers in VmWare ( supported throught support exception)
2 Compute nodes in Cisco UCS 

• We are doing a basic installation to test the cinder driver but in the inicial deploy it fails in the step 5:

(undercloud) [stack@undercloud ~]$ cat basic-deploy.sh
#!/bin/bash

openstack overcloud deploy --templates /usr/share/openstack-tripleo-heat-templates \
-r /home/stack/templates/roles_data.yaml \
-e /home/stack/templates/environments/node-info.yaml \
-e /home/stack/templates/environments/overcloud_images.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/network-isolation.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/neutron-ovs-dvr.yaml \
-e /home/stack/templates/environments/network-environment.yaml \
-e /usr/share/openstack-tripleo-heat-templates/environments/disable-telemetry.yaml \
-e /home/stack/templates/environments/25-hostname-map.yaml \
-e /home/stack/templates/environments/30-fixed-ip-vips.yaml \
-e /home/stack/templates/environments/30-ips-from-pool-all.yaml \
-e /home/stack/templates/environments/custom-domain.yaml \
-e /home/stack/templates/environments/firstboot.yaml \
-e /home/stack/templates/environments/cinder-extra-config.yml \
-e /home/stack/templates/custom_overcloud_images.yaml \
-e /home/stack/templates/custom_env.yaml \
 --ntp-server 10.10.10.10

• The files custom_overcloud_images.yaml and custom_env.yaml are created according the Oficial Hitachi documentation.

• Deployment fails like this:

(undercloud) [stack@undercloud ~]$ time sh basic-deploy.sh
...
...
2020-10-17 17:14:27Z [AllNodesDeploySteps.ControllerDeployment_Step5.2]: CREATE_COMPLETE  state changed
2020-10-17 17:14:30Z [AllNodesDeploySteps.ControllerDeployment_Step5.1]: SIGNAL_IN_PROGRESS  Signal: deployment c61cefd7-08ab-4686-91d2-ec7a346f87f3 succeeded
2020-10-17 17:14:30Z [AllNodesDeploySteps.ControllerDeployment_Step5.1]: CREATE_COMPLETE  state changed
2020-10-17 17:14:53Z [AllNodesDeploySteps.ControllerDeployment_Step5.0]: SIGNAL_IN_PROGRESS  Signal: deployment eb5b35b5-36f0-477f-bb53-8a4338490c7e failed (2)
2020-10-17 17:14:54Z [AllNodesDeploySteps.ControllerDeployment_Step5.0]: CREATE_FAILED  Error: resources[0]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 2
2020-10-17 17:14:54Z [AllNodesDeploySteps.ControllerDeployment_Step5]: CREATE_FAILED  Resource CREATE failed: Error: resources[0]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 2
2020-10-17 17:14:55Z [AllNodesDeploySteps.ControllerDeployment_Step5]: CREATE_FAILED  Error: resources.ControllerDeployment_Step5.resources[0]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status code: 2
2020-10-17 17:14:55Z [AllNodesDeploySteps]: CREATE_FAILED  Resource CREATE failed: Error: resources.ControllerDeployment_Step5.resources[0]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status code: 2
2020-10-17 17:14:55Z [AllNodesDeploySteps]: CREATE_FAILED  Error: resources.AllNodesDeploySteps.resources.ControllerDeployment_Step5.resources[0]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status code: 2
2020-10-17 17:14:55Z [overcloud]: UPDATE_FAILED  Resource CREATE failed: Error: resources.AllNodesDeploySteps.resources.ControllerDeployment_Step5.resources[0]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status code: 2

 Stack overcloud UPDATE_FAILED

overcloud.AllNodesDeploySteps.ControllerDeployment_Step5.0:
  resource_type: OS::Heat::StructuredDeployment
  physical_resource_id: eb5b35b5-36f0-477f-bb53-8a4338490c7e
  status: CREATE_FAILED
  status_reason: |
    Error: resources[0]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 2
  deploy_stdout: |
    ...
            "Completed $ docker run --name cinder_api_online_migrations --label config_id=tripleo_step5 --label container_name=cinder_api_online_migrations --label managed_by=paunch --label config_data={\"start_order\": 2, \"image\": \"10.10.10.11:8787/rhosp13/openstack-cinder-api:13.0-124\", \"command\": \"/usr/bin/bootstrap_host_exec cinder_api su cinder -s /bin/bash -c 'cinder-manage db online_data_migrations'\", \"user\": \"root\", \"volumes\": [\"/etc/hosts:/etc/hosts:ro\", \"/etc/localtime:/etc/localtime:ro\", \"/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro\", \"/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro\", \"/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro\", \"/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro\", \"/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro\", \"/dev/log:/dev/log\", \"/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro\", \"/etc/puppet:/etc/puppet:ro\", \"/var/lib/config-data/cinder/etc/my.cnf.d/tripleo.cnf:/etc/my.cnf.d/tripleo.cnf:ro\", \"/var/lib/config-data/cinder/etc/cinder/:/etc/cinder/:ro\", \"/var/log/containers/cinder:/var/log/cinder\", \"/var/log/containers/httpd/cinder-api:/var/log/httpd\"], \"net\": \"host\", \"detach\": false, \"privileged\": false} --net=host --privileged=false --user=root --volume=/etc/hosts:/etc/hosts:ro --volume=/etc/localtime:/etc/localtime:ro --volume=/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro --volume=/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro --volume=/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro --volume=/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro --volume=/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro --volume=/dev/log:/dev/log --volume=/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro --volume=/etc/puppet:/etc/puppet:ro --volume=/var/lib/config-data/cinder/etc/my.cnf.d/tripleo.cnf:/etc/my.cnf.d/tripleo.cnf:ro --volume=/var/lib/config-data/cinder/etc/cinder/:/etc/cinder/:ro --volume=/var/log/containers/cinder:/var/log/cinder --volume=/var/log/containers/httpd/cinder-api:/var/log/httpd --cpuset-cpus=0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23 10.31.0.1:8787/rhosp13/openstack-cinder-api:13.0-124 /usr/bin/bootstrap_host_exec cinder_api su cinder -s /bin/bash -c 'cinder-manage db online_data_migrations'",
            "stdout: Running batches of 50 until complete.",
            "stderr: Option \"logdir\" from group \"DEFAULT\" is deprecated. Use option \"log-dir\" from group \"DEFAULT\"."
        ]
    }
        to retry, use: --limit @/var/lib/heat-config/heat-config-ansible/4cf78a3a-9a03-4512-b7c0-41a714e2b8c7_playbook.retry

    PLAY RECAP *********************************************************************
    localhost                  : ok=13   changed=8    unreachable=0    failed=1

    (truncated, view all with --long)
  deploy_stderr: |

Heat Stack update failed.
Heat Stack update failed.

real    73m37.493s
user    0m14.766s
sys     0m1.176s