Chapter 3. Configuring multisite storage replication

Procedure

1. Run the following patch command to set the value to true for CSI_ENABLE_OMAP_GENERATOR in the rook-ceph-operator-config ConfigMap.

   $ oc patch cm rook-ceph-operator-config -n openshift-storage --type json --patch  '[{ "op": "add", "path": "/data/CSI_ENABLE_OMAP_GENERATOR", "value": "true" }]'

   Example output:

   configmap/rook-ceph-operator-config patched

2. Run the following patch command to set the value to true for CSI_ENABLE_VOLUME_REPLICATION in the rook-ceph-operator-config ConfigMap.

   $ oc patch cm rook-ceph-operator-config -n openshift-storage --type json --patch  '[{ "op": "add", "path": "/data/CSI_ENABLE_VOLUME_REPLICATION", "value": "true" }]'

   Example output:

   configmap/rook-ceph-operator-config patched

3. Validate that the following two new CSI sidecar containers per csi-rbdplugin-provisioner pod are added.

   $ for l in $(oc get pods -n openshift-storage -l app=csi-rbdplugin-provisioner -o jsonpath={.items[*].spec.containers[*].name}) ; do echo $l ; done | egrep "csi-omap-generator|volume-replication"

   Example output:

   csi-omap-generator
   volume-replication
   csi-omap-generator
   volume-replication

   Note

   The new containers are repeated because there are two csi-rbdplugin-provisioner pods for redundancy.

Procedure

1. Navigate to OperatorHub on the Hub cluster and use the keyword filter to search for ODF Multicluster Orchestrator.
2. Click ODF Multicluster Orchestrator tile.

3. Keep all default settings and click Install.

   The operator resources are installed in openshift-operators and available to all namespaces.

4. Verify that the ODF Multicluster Orchestrator shows a green tick indicating successful installation.

Procedure

1. Click ODF Multicluster Orchestrator to view the operator details.

   You can also click View Operator after the Multicluster Orchestrator is installed successfully.

2. Click on Mirror Peer API Create instance and then select YAML view.

3. Create Mirror Peer in YAML view.

   1. Copy the following YAML to filename mirror-peer.yaml after replacing <cluster1> and <cluster2> with the correct names of your managed clusters in the RHACM console.

      apiVersion: multicluster.odf.openshift.io/v1alpha1
      kind: MirrorPeer
      metadata:
        name: mirrorpeer-<cluster1>-<cluster2>
      spec:
        items:
        - clusterName: <cluster1>
          storageClusterRef:
            name: ocs-storagecluster
            namespace: openshift-storage
        - clusterName: <cluster2>
          storageClusterRef:
            name: ocs-storagecluster
            namespace: openshift-storage

      Note

      There is no need to specify a namespace to create this resource because MirrorPeer is a cluster-scoped resource.

   2. Copy the contents of your unique mirror-peer.yaml file into the YAML view. You must completely replace the original content.
   3. Click Create at the bottom of the YAML view screen.

4. Verify that you can view Phase status as ExchangedSecret.

   Note

   In some deployments, the output for the validation can also be ExchangingSecret which is also an acceptable result.

Procedure

1. Enable cluster level mirroring flag using storage cluster name.

   $ oc patch storagecluster $(oc get storagecluster -n openshift-storage -o=jsonpath='{.items[0].metadata.name}')  -n openshift-storage --type json --patch  '[{ "op": "replace", "path": "/spec/mirroring", "value": {"enabled": true} }]'

   Example output:

   storagecluster.ocs.openshift.io/ocs-storagecluster patched

2. Validate that mirroring is enabled on the default Ceph block pool.

   $ oc get cephblockpool -n openshift-storage -o=jsonpath='{.items[?(@.metadata.ownerReferences[*].kind=="StorageCluster")].spec.mirroring.enabled}{"\n"}'

   Example output:

   true

3. Validate that the rbd-mirror pod is up and running.

   $ oc get pods -o name -l app=rook-ceph-rbd-mirror -n openshift-storage

   Example output:

   pod/rook-ceph-rbd-mirror-a-6486c7d875-56v2v

4. Validate the status of the daemon health.

   $ oc get cephblockpool ocs-storagecluster-cephblockpool -n openshift-storage -o jsonpath='{.status.mirroringStatus.summary}{"\n"}'

   Example output:

   {"daemon_health":"OK","health":"OK","image_health":"OK","states":{}}