Unresponsive Cluster after performing Limited Live Migration from OpenShift SDN to OVN-Kubernetes
Issue
- Cluster becomes unresponsive after performing a
Limited Live MigrationfromOpenShift SDNtoOVN-Kubernetes. - Some APIs stop functioning and see many error like below on the kubeapiserver for multiple pods :
I0507 11:51:55.283722 16 apf_controller.go:455] "Update CurrentCL" plName="exempt" seatDemandHighWatermark=2 seatDemandAvg=0.08120283653423906 seatDemandStdev=0.2750693301817522 seatDemandSmoothed=4.583770143942903 fairFrac=2.273677667534513 currentCL=10 concurrencyDenominator=10 backstop=false
I0507 11:51:55.344366 16 available_controller.go:428] "changing APIService availability" name="v1.packages.operators.coreos.com" oldStatus="False" newStatus="False" message="failing or missing response from https://0.0.0.0:5443/apis/packages.operators.coreos.com/v1: Get \"https://0.0.0.0:5443/apis/packages.operators.coreos.com/v1\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" reason="FailedDiscoveryCheck"
E0507 11:51:55.349487 16 available_controller.go:482] v1.packages.operators.coreos.com failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1.packages.operators.coreos.com": the object has been modified; please apply your changes to the latest version and try again
I0507 11:51:55.381747 16 available_controller.go:428] "changing APIService availability" name="v1beta1.metrics.k8s.io" oldStatus="False" newStatus="False" message="failing or missing response from https://0.0.0.0metrics.k8s.io/v1beta1: Get \"https://0.0.0.0:10250/apis/metrics.k8s.io/v1beta1\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" reason="FailedDiscoveryCheck"
E0507 11:51:55.387764 16 available_controller.go:482] v1beta1.metrics.k8s.io failed with: failing or missing response from https://0.0.0.0:10250/apis/metrics.k8s.io/v1beta1: Get "https://0.0.0.0:10250/apis/metrics.k8s.io/v1beta1": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
Environment
- OpenShift Container Platform
- 4.16 +
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.