openstack deploy command fails with error when intergrating ceph node with existing overcloud deployment

Issue

• We have an existing openstack overcloud deployment with which I want to integrate a ceph storage node. I make needful changes in ceph-ansible-external.yaml and give it as an environment file to the openstack deploy command like:

  openstack overcloud deploy --templates /home/stack/openstack-tripleo-heat-templates/ -r /home/stack/openstack-tripleo-heat-templates/roles_data.yaml -e /home/stack/templates/node-info.yaml -e /home/stack/openstack-tripleo-heat-templates/environments/network-isolation.yaml -e /home/stack/openstack-tripleo-heat-templates/environments/network-environment.yaml -e /home/stack/tripleo-config-generated-env-files/containers-prepare-parameter.yaml -e /home/stack/tripleo-config-generated-env-files/undercloud_parameters.yaml -e /home/stack/openstack-tripleo-heat-templates/environments/ceph-ansible/ceph-ansible-external.yaml --ntp-server 10.10.10.10 --libvirt-type kvm --log-file overcloud_deploy.log
  

• We get the following error:

  ERROR openstack [  admin] The CephFSID environment value  (7c7129d3-8729-4457-965c-325f8fe793b8) does not match the stack  configuration value (0721b4bb-6198-40a3-952c-3f02a377e4fa). Ensure the CephClusterFSID  param is properly configured  in the storage environment  files.
  

• Our ceph-ansible-external.yaml contains:

  resource_registry:
    OS::TripleO::Services::CephExternal: /home/stack/openstack-tripleo-heat-templates/environments/ceph-ansible/ceph-ansible-external.yaml
  
  parameter_defaults:
    # NOTE: These example parameters are required when using CephExternal
    CephClusterFSID: '7c7129d3-8729-4457-965c-325f8fe793b8'
    CephClientKey: 'AQBmlqtgp5GINhAA/npRo863t9UtC+NiiCCVZA=='
    CephExternalMonHost: '10.10.10.11'
  
    # the following parameters enable Ceph backends for Cinder, Glance, Gnocchi and Nova
    NovaEnableRbdBackend: false
    CinderEnableRbdBackend: true
    #CinderBackupBackend: ceph
    #GlanceBackend: rbd
    # Uncomment below if enabling legacy telemetry
    # GnocchiBackend: rbd
    # If the Ceph pools which host VMs, Volumes and Images do not match these
    # names OR the client keyring to use is not named 'openstack',  edit the
    # following as needed.
    #NovaRbdPoolName: vms
    CinderRbdPoolName: volumes
    #CinderBackupRbdPoolName: backups
    #GlanceRbdPoolName: images
    # Uncomment below if enabling legacy telemetry
    # GnocchiRbdPoolName: metrics
    CephClientUserName: cinder
  
    # finally we disable the Cinder LVM backend
    CinderEnableIscsiBackend: false
  

• This issue occurs when openstack deploy command is triggered for ceph node integration with existing openstack overcloud deployment.