Monitoring Operator Degraded due to Pods Alertmanager and Prometheus Missing during RHOCP Upgrade

Solution Verified - Updated -

Issue

  • Monitoring Operator is degraded
  • During RHOCP upgrade Alertmanager and Prometheus pods are missing from the list of oc get pods' in theopenshift-monitoring` namespace
$ oc get pods -n openshift-monitoring

NAME                                         READY  STATUS   RESTARTS  AGE
cluster-monitoring-operator-xxxxxxxxx-xxxxx  2/2    Running  0         2d
grafana-xxxxxxxxxx-xxxxx                     3/3    Running  0         2d
kube-state-metrics-xxxxxxxxxx-xxxxx          3/3    Running  0         2d
node-exporter-xxxxx                          2/2    Running  0         2d
node-exporter-xxxxx                          2/2    Running  0         2d
node-exporter-xxxxx                          2/2    Running  0         2d
node-exporter-xxxxx                          2/2    Running  0         2d
openshift-state-metrics-xxxxxxxxxx-xxxxx     3/3    Running  0         1d
openshift-state-metrics-xxxxxxxxxx-xxxxx     3/3    Running  0         2d
prometheus-adapter-xxxxxxxxxx-xxxxx          1/1    Running  0         2d
prometheus-adapter-xxxxxxxxxx-xxxxx          1/1    Running  0         2d
prometheus-operator-xxxxxxxxxx-xxxxx         2/2    Running  0         2d
telemeter-client-xxxxxxxxxx-xxxxx            3/3    Running  0         2d
telemeter-client-xxxxxxxxxx-xxxxx            3/3    Running  0         1d
thanos-querier-xxxxxxxxxx-xxxxx              6/6    Running  0         1d
thanos-querier-xxxxxxxxxx-xxxxx              6/6    Running  0         1d
thanos-querier-xxxxxxxxxx-xxxxx              5/5    Running  0         2d
thanos-querier-xxxxxxxxxx-xxxxx              5/5    Running  0         2d

$ oc get co

NAME                                      VERSION  AVAILABLE  PROGRESSING  DEGRADED  SINCE
monitoring                                4.9.48   False      True         True      1m38s

Environment

  • Red Hat OpenShift Container Platform (RHOCP)
    • 4

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content