OpenShift Metrics not working because of Cassandra failing to process data
Issue
- The metrics status page on https://metrics.app.ose-cloud.net/hawkular/metrics shows STARTED even when
cassandra
is not working and reporting the below error:
01:38:55,702 ERROR [org.hawkular.metrics.api.jaxrs.util.ApiUtils] (http-/0.0.0.0:8080-1) HAWKMETRICS200010: Failed to process request: java.lang.RuntimeException: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
at rx.observables.BlockingObservable.blockForSingle(BlockingObservable.java:472) [rxjava-1.0.13.redhat-2.jar:1.0.13.redhat-2]
at rx.observables.BlockingObservable.lastOrDefault(BlockingObservable.java:262) [rxjava-1.0.13.redhat-2.jar:1.0.13.redhat-2]
Environment
- Red Hat OpenShift Container Platform 3.2
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.