Worker nodes stuck in NodeProvisioning, ignitionNotReached

Solution In Progress - Updated -

Environment

  • Red Hat OpenShift Service on AWS hosted control planes

Issue

When attempting to create a Hypershift cluster using the terraform template to create the VPC, the worker nodes never joined and status was NodeProvisioning,ignitionNotReached

rosa list machinepools --cluster=<cluster-id>

ID         AUTOSCALING  DESIRED REPLICAS  CURRENT REPLICAS  INSTANCE TYPE  LABELS    TAINTS    AVAILABILITY ZONE  SUBNET                    VERSION  AUTOREPAIR  TUNING CONFIGS  MESSAGE                                                           
workers-0  No           1                 0                 m5.xlarge                          us-east-2b         subnet-<id>  4.12.18  Yes                         WaitingForAvailableMachines: NodeProvisioning,ignitionNotReached  
workers-1  No           1                 0                 m5.xlarge                          us-east-2a         subnet-<id>  4.12.18  Yes                         WaitingForAvailableMachines: NodeProvisioning,ignitionNotReached

Resolution

Disclaimer: Links contained herein to external website(s) are provided for convenience only. Red Hat has not reviewed the links and is not responsible for the content or its availability. The inclusion of any link to an external website does not imply endorsement by Red Hat of the website or their entities, products or services. You agree that Red Hat is not responsible or liable for any loss or expenses that may result due to your use of (or reliance on) the external site or content.

Note: You may see this issue due to a bug in our provided Terraform which has been fixed at the time of writing

To resolve the issue, you need to perform the following steps:
- Uninstall the cluster
- "terraform destroy" the VPC you created with the old Terraform code
- Start over with VPC creation and cluster install
- Open a support ticket with the Red Hat OpenShift Support Team if you still see the issue.

Root Cause

  • This was a bug in our provided Terraform

Diagnostic Steps

rosa list machinepools --cluster= displays the following message:
WaitingForAvailableMachines: NodeProvisioning,ignitionNotReached

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments