required label missing from the metric error sending metrics to Telemetry in RHOCP 4

Issue

• The Prometheus pods in the openshift-user-workload-monitoring are throwing the error: a required label is missing from the metric:

  $ oc -n openshift-user-workload-monitoring logs prometheus-user-workload-0 -c prometheus|grep "a required label is missing from the metric"|head -1
  2024-06-20T15:56:33.282092583Z ts=2024-06-20T15:56:33.281Z caller=dedupe.go:112 component=remote level=error remote_name=5a6833 url=https://infogw.api.openshift.com/metrics/v1/receive msg="non-recoverable error" count=1 exemplarCount=0 err="server returned HTTP status 400 Bad Request: a required label is missing from the metric"
  

• A configuration exists in the User Workload Monitoring namespace not generated manually that leads to the error required label is missing from the metric when sending the metrics to the Red Hat Telemetry: https://infogw.api.openshift.com/metrics/v1/receive