Monitoring operator is unable to reconcile during RHOCP upgrade due to "object is being deleted: deployments.apps <name> already exists" error
Issue
Monitoring operator
is stuck in progressing state due to below error:
Last Transition Time: 2022-03-25T08:57:52Z
Message: Rolling out the stack.
Reason: RollOutInProgress
Status: True
Type: Progressing
Last Transition Time: 2022-03-24T23:56:18Z
Message: Failed to rollout the stack. Error: updating openshift-state-metrics: reconciling openshift-state-metrics Deployment failed: creating Deployment object failed after update failed: object is being deleted: deployments.apps "openshift-state-metrics" already exists
updating telemeter client: reconciling Telemeter client Deployment failed: creating Deployment object failed after update failed: object is being deleted: deployments.apps "telemeter-client" already exists
updating thanos querier: reconciling Thanos Querier Deployment failed: creating Deployment object failed after update failed: object is being deleted: deployments.apps "thanos-querier" already exists
updating alertmanager: waiting for Alertmanager object changes failed: waiting for Alertmanager openshift-monitoring/main: expected 2 replicas, got 0 updated replicas
updating prometheus-k8s: waiting for Prometheus object changes failed: waiting for Prometheus openshift-monitoring/k8s: expected 2 replicas, got 0 updated replicas
Reason: MultipleTasksFailed
Status: True
Type: Degraded
Environment
- Red Hat OpenShift Container Platform (RHOCP)
- 4.9+
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.