Inferentia & Trainium instances on ROSA
Current Status
The AWS EC2 instance types Trainium and Inferentia (inf, trn) can be added to a Red Hat OpenShift Service on AWS (ROSA) cluster machine-pool, however the accelerator drivers are not installed as part of the resulting worker node(s).
Customers may opt to use these accelerated instance types as worker nodes in a Red Hat OpenShift cluster on AWS, however customers might consider building their own solution for driver software until the supporting drivers are released.
Planned Support Status
Upon releasing the tested and validated software suite for the Trainium and Inferentia instance types on ROSA, AWS will support the use of these instances in a ROSA cluster. Customers can then expect to use these instances types and their accelerated features.
Appendix
Instance types list
The specific instance types made available are these:
trn1.2xlarge
trn1.32xlarge
trn1n.32xlarge
trn2.48xlarge
trn2u.48xlarge
inf1.xlarge
inf1.2xlarge
inf1.6xlarge
inf1.24xlarge
inf2.xlarge
inf2.8xlarge
inf2.24xlarge
inf2.48xlarge
Comments