How to send alerts to external services from OSD or ROSA clusters?

Solution Verified - Updated -

Environment

  • Red Hat OpenShift Service on AWS (ROSA)
    • 4
  • Red Hat OpenShift Dedicated (OSD)
    • 4
  • User Workload Monitoring (UWM)
  • Alertmanager

Issue

  • Is it possible to manage alerts in OSD or ROSA?
  • How to send alerts to Slack webhook from OSD or ROSA clusters?

Resolution

Disclaimer: Links contained herein to external website(s) are provided for convenience only. Red Hat has not reviewed the links and is not responsible for the content or its availability. The inclusion of any link to an external website does not imply endorsement by Red Hat of the website or their entities, products or services. You agree that Red Hat is not responsible or liable for any loss or expenses that may result due to your use of (or reliance on) the external site or content.

Alert routing for user-defined projects is now supported in OpenShift 4.11 and up. This includes Red Hat OpenShift Service on AWS and OpenShift Dedicated clusters running OpenShift 4.11 or higher.

Documentation on how to enable alert routing for user-defined projects is located in Enabling alert routing for user-defined projects in ROSA and Enabling alert routing for user-defined projects in OSD.
Documentation on how to configure alert routing to external receivers is located in Applying a custom configuration to Alertmanager for user-defined alert routing in ROSA and in Applying a custom configuration to Alertmanager for user-defined alert routing in OSD.

Note: There is an example for configuring Alertmanager to send alerts to a slack channel in Custom Alerts in ROSA 4.11. This example is not supported by Red Hat Support. While this doesn't mean that the support of the cluster is void, it does mean that Red Hat Support is not able to help in case of issues with the procedure.

Workaround for 4.9 and 4.10

For users running OSD or ROSA version 4.10 or 4.9, there is an unsupported procedure documented in Custom Alertmanager in ROSA 4.9 that demonstrates how to deploy a custom Alertmanager instance. This workaround is not supported by Red Hat Support. While this doesn't mean that the support of the cluster is void, it does mean that Red Hat Support is not able to help in case of issues with the procedure.

Root Cause

Alert routing for user-defined projects is now supported in Red Hat OpenShift Service on AWS (ROSA) and OpenShift Dedicated (OSD) clusters running OpenShift 4.11 or higher.

Diagnostic Steps

Check the version of the cluster OSD/ROSA cluster:

$ oc get clusterversion
NAME      VERSION   AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.11.4    True        False         8d      Cluster version is 4.11.4

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments