All Node machines in Failed Phase in RHOCP 4

Issue

• One or more Machines object report the Failed phase.

• Machines are in failed state with following error message:

$ oc get machines
NAME                   PHASE   TYPE  REGION  ZONE  AGE
abc-machine-master-0   Failed                      543d

2023-07-03T12:01:49.475638446Z I0703 12:01:49.475630       1 controller.go:57] controllers/MachineSet "msg"="Reconciling" "machineset"="abc-machine-master-0" "namespace"="openshift-machine-api"
2023-07-03T12:01:49.475750169Z I0703 12:01:49.475733       1 controller.go:156] abc-machine-master-0: reconciling Machine
2023-07-03T12:01:49.475769912Z W0703 12:01:49.475754       1 controller.go:260] abc-machine-master-0: machine has gone "Failed" phase. It won't reconcile