Kibana, Grafana and Prometheus web user interface not accessible in RHOCP 4.x

Solution Verified - Updated -

Issue

  • Kibana container kube-rbac-proxy logs throw below errors while querying OAuth as below:
2022/02/24 10:59:38 oauthproxy.go:656: error redeeming code (client:<x.x.x.x>:<port>): Post "https://oauth-openshift.apps.example.com/oauth/token": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
2022/02/24 10:59:38 oauthproxy.go:445: ErrorPage 500 Internal Error Internal Error
  • Kibana, Grafana and Prometheus web pages failing with 500 Internal Error.

  • ovnkube-node-xxxx pod container kube-rbac-proxy running over the node hosting Kibana, Grafana and Prometheus pods reporting below logs:

2022-01-19T22:48:46.275507246Z E0119 22:48:46.275430    4370 proxy.go:73] Unable to authenticate the request due to an error: context canceled
2022-01-19T22:49:06.277263980Z E0119 22:49:06.277204    4370 webhook.go:111] Failed to make webhook authenticator request: Post "https://<x.x.x.x>:<port>/apis/authentication.k8s.io/v1/tokenreviews": context deadline exceeded

Environment

  • Red Hat OpenShift Container Platform (RHOCP)
    • 4.x

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content