After configuring custom retention period for user-workload-monitoring only 15 days of metrics are shown in OSD/ROSA

Solution Verified - Updated -

Environment

  • Red Hat OpenShift Service on AWS (ROSA)
    • 4
  • Red Hat OpenShift Dedicated (OSD)
    • 4
  • user-workload-monitoring (UWM)

Issue

  • After configuring a retention of 60d in the user-workload-monitoring, the metrics are shown for only 15 days in custom namespaces.

Resolution

Ensure that the metrics used in the queries are custom metrics exposed by the custom applications, and not cluster-level metrics. Cluster-level metrics are not available in the user-workload Prometheus component.

Refer to Setting up metrics collection for user-defined projects and Troubleshooting monitoring issues for additional information and examples for custom metrics.

Root Cause

In OSD and ROSA, it is only possible to configure the user-workload-monitoring as explained in the documentation. The user-workload-monitoring only includes custom metrics from user-defined projects, and not include any cluster-level metric, since those are not available to the user-workload Prometheus component.

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments