OpenShift Data Foundation (ODF) ocs-client-operator Stuck in "Installing" Status

Issue

Note: In ODF v4.18 and below, the OpenShift Data Foundation Client operator stages its resources for future use in ODF v4.19+. In ODF v4.18 and below, the ocs-client-operator-console and the ocs-client-operator-controller-manager deployments remain scaled down, 0/0 until v4.19+ where they're scaled up. Behavior will be different depending on what version you're on. Likely the behavior in v4.19+ will be a result of this solution (blank ocs-client-operator-console-serving-cert), and it will need to be fixed. Please see the solution in correspondence with the environment's respective ODF version:

Symptoms:

• The OpenShift Data Foundation Client operator is stuck in Installing state:

  $ oc get csv -n openshift-storage | grep "ocs-client-operator"
  ocs-client-operator.v4.16.3-rhodf       OpenShift Data Foundation Client   4.16.3-rhodf   ocs-client-operator.v4.16.2-rhodf       Replacing
  ocs-client-operator.v4.16.5-rhodf       OpenShift Data Foundation Client   4.16.5-rhodf   ocs-client-operator.v4.16.3-rhodf       Installing
  

• Below pods stuck in Init:0/1 state in openshift-storage project (v4.18 and below:):

  $ oc get pods -n openshift-storage | grep "ocs-client-operator"
  ocs-client-operator-console-xxxxx-xxxxx              0/1     Init:0/1   0          49s
  ocs-client-operator-controller-manager-xxxxx-xxxxx   0/2     Init:0/1   0          49s
  

• Below pod stuck in CrashLoopBackOff status in openshift-storage project (v4.19+:):

  $ oc get pods -n openshift-storage | grep "ocs-client-operator"
  ocs-client-operator-console-xxxxx-xxxxx                           0/1     CrashLoopBackOff   211        17h
  ocs-client-operator-controller-manager-xxxxx-xxxxx                1/1     Running            0          17h
  

• Other observations of the problem :

  After updating the ODF operator, the ocs-client-operator-console pod fails to start, displaying an error during initialization

  MountVolume.SetUp failed for volume "ocs-client-operator-console-serving-cert" : secret "ocs-client-operator-console-serving-cert" not found
  

  From the operator-lifecycle-manager:

  install failed: deployment ocs-client-operator-controller-manager not ready before timeout: deployment "ocs-client-operator-controller-manager" exceeded its progress deadline.