AlertmanagerDown and clusterMonitoringOperatorDown alerts fired due Prometheus database not enough free space in RHCOP 3.11
Issue
- Alerts seem to be false because alertmanager and cluster monitoring operator pods are running.
READY STATUS RESTARTS AGE
alertmanager-main-0 3/3 Running 0 6d
alertmanager-main-1 3/3 Running 0 6d
alertmanager-main-2 3/3 Running 0 6d
cluster-monitoring-operator-6f5fbd6f8b-rp7tj 1/1 Running 0 7d
grafana-857fc848bf-r8dhc 2/2 Running 0 7d
kube-state-metrics-88548b8d-grhrx 3/3 Running 0 6d
node-exporter-8pm6z 2/2 Running 0 6d
node-exporter-bldxj 2/2 Running 0 6d
node-exporter-jbk8g 2/2 Running 0 6d
node-exporter-jhv88 2/2 Running 0 6d
node-exporter-k7kc8 2/2 Running 0 6d
node-exporter-pc8zj 2/2 Running 2 6d
node-exporter-vbx29 2/2 Running 0 6d
node-exporter-x5wbj 2/2 Running 0 6d
prometheus-k8s-0 4/4 Running 1 7d
prometheus-k8s-1 4/4 Running 1 7d
prometheus-operator-7855c8646b-mjgfk 1/1 Running 0 7d
Environment
- Openshift Cluster Platform(OCP) 3.11.
- Openshift Cluster Storage
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.
