OpenShift Upgrade Stuck on Cluster Operators Degraded: Error creating: Internal error occurred: admission plugin "MutatingAdmissionWebhook" failed to complete mutation in 13s`
Issue
- During the upgrade of OpenShift Container Platform, the upgrade process became stuck, and several Cluster Operators were in a degraded state. The following error message was encountered:
Error Message: Error creating: Internal error occurred: admission plugin "MutatingAdmissionWebhook" failed to complete mutation in 13s.
- Cluster events indicating a timeout with the
vmware-vsphere-csi-driver-webhook
1h39m Normal OperatorStatusChanged deployment/cluster-storage-operator Status for clusteroperator/storage changed: Progressing changed from False to True ("VSphereProgressing: Waiting for Deployment to deploy pods")
1h39m Normal OperatorStatusChanged deployment/cluster-storage-operator Status for clusteroperator/storage changed: Degraded message changed from "VSphereCSIDriverOperatorCRDegraded: VMwareVSphereOperatorCheckDegraded: error logging into vcenter: ServerFaultCode: Cannot complete login due to an incorrect user name or password." to "VSphereCSIDriverOperatorCRDegraded: VMwareVSphereOperatorCheckDegraded: error logging into vcenter: ServerFaultCode: Cannot complete login due to an incorrect user name or password.\nVSphereCSIDriverOperatorDeploymentDegraded: deployment openshift-cluster-csi-drivers/vmware-vsphere-csi-driver-operator has some pods failing; unavailable replicas=1"
1h34m Normal Killing pod/csi-snapshot-controller-8894bfdb6-gbjww Stopping container snapshot-controller
11m Warning FailedCreate replicaset/csi-snapshot-controller-8894bfdb6 Error creating: Internal error occurred: admission plugin "MutatingAdmissionWebhook" failed to complete mutation in 13s
Environment
- Red Hat OpenShift Container Platform
- 4.x
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.