Authentication, console and ingress operator are degraded with the error "Client.Timeout exceeded while awaiting headers"

Solution Verified - Updated -

Issue

  • Cluster operators are degraded with errors related to their healthecks:

    $ oc get co |grep -E "NAME|console|authentication"
    NAME                                       VERSION   AVAILABLE   PROGRESSING   DEGRADED   SINCE   MESSAGE
    authentication                             4.12.13   False       False         False      104s    OAuthServerRouteEndpointAccessibleControllerAvailable: Get "https://oauth-openshift.apps.ocp4-upi.testlab.local/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
    console                                    4.12.13   False       False         False      2m20s   RouteHealthAvailable: failed to GET route (https://console-openshift-console.apps.ocp4-upi.testlab.local): Get "https://console-openshift-console.apps.ocp4-upi.testlab.local": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
    
    
    authentication:
    $ oc get co authentication -o json
    "status": {
          "conditions": [
              {
                  "lastTransitionTime": "2023-05-16T16:43:28Z",
                  "message": "OAuthServerRouteEndpointAccessibleControllerDegraded: Get \"https://oauth-openshift.apps.ocp4-upi.testlab.local/healthz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)",
                  "reason": "OAuthServerRouteEndpointAccessibleController_SyncError",
                  "status": "True",
                  "type": "Degraded"
              },
    ...
    
    console:
    $ oc get co console -o json
    ...
              {
                  "lastTransitionTime": "2023-05-14T00:49:53Z",
                  "message": "RouteHealthDegraded: failed to GET route (https://console-openshift-console.apps.ocp4-upi.testlab.local): Get \"https://console-openshift-console.apps.ocp4-upi.testlab.local\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)",
                  "reason": "AsExpected",
                  "status": "False",
                  "type": "Degraded"
              },
    
  • All pods related to the failing operators are up.
  • Checking the specific routes using curl from within the operators pods work but they took a lot of time.

Environment

  • OpenShift Container Platform 4.x
  • UPI Installation

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content