Metrics in the console are not loading in ROSA cluster

Solution Verified - Updated -

Environment

  • Red Hat OpenShift Service on AWS (ROSA)

Issue

  • Website loads much more slowly
  • Metrics are not showing in the console UI

Resolution

  1. Make sure that the infra nodes are not running user workload, causing extra load.
  2. Assess if the infra nodes are not under heavy load, if yes, then contact Red Hat Support to resize accordingly to the latest recommendation at ROSA Sizing documentation

Root Cause

  • Infra nodes can be under heavy memory load, which impacts the requests for API and Ingress that over to the router pods hosted in these machines.
oc adm top node --selector=node-role.kubernetes.io/infra=
NAME CPU(cores) CPU% MEMORY(bytes) MEMORY%
infra-node-01          144m 3% 3825Mi           13%
infra-node-02         2181m 55% 22026Mi      78%
infra-node-03        1399m 35% 20155Mi          71%

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments