Unresponsive Cluster after performing Limited Live Migration from OpenShift SDN to OVN-Kubernetes

Solution Verified - Updated -

Issue

  • Cluster becomes unresponsive after performing a Limited Live Migrationfrom OpenShift SDNto OVN-Kubernetes.
  • Some APIs stop functioning and see many error like below on the kubeapiserver for multiple pods :
I0507 11:51:55.283722      16 apf_controller.go:455] "Update CurrentCL" plName="exempt" seatDemandHighWatermark=2 seatDemandAvg=0.08120283653423906 seatDemandStdev=0.2750693301817522 seatDemandSmoothed=4.583770143942903 fairFrac=2.273677667534513 currentCL=10 concurrencyDenominator=10 backstop=false
I0507 11:51:55.344366      16 available_controller.go:428] "changing APIService availability" name="v1.packages.operators.coreos.com" oldStatus="False" newStatus="False" message="failing or missing response from https://0.0.0.0:5443/apis/packages.operators.coreos.com/v1: Get \"https://0.0.0.0:5443/apis/packages.operators.coreos.com/v1\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" reason="FailedDiscoveryCheck"
E0507 11:51:55.349487      16 available_controller.go:482] v1.packages.operators.coreos.com failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1.packages.operators.coreos.com": the object has been modified; please apply your changes to the latest version and try again
I0507 11:51:55.381747      16 available_controller.go:428] "changing APIService availability" name="v1beta1.metrics.k8s.io" oldStatus="False" newStatus="False" message="failing or missing response from https://0.0.0.0metrics.k8s.io/v1beta1: Get \"https://0.0.0.0:10250/apis/metrics.k8s.io/v1beta1\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" reason="FailedDiscoveryCheck"
E0507 11:51:55.387764      16 available_controller.go:482] v1beta1.metrics.k8s.io failed with: failing or missing response from https://0.0.0.0:10250/apis/metrics.k8s.io/v1beta1: Get "https://0.0.0.0:10250/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

Environment

  • OpenShift Container Platform
    • 4.16 +

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content