Inferentia & Trainium instances on ROSA

Updated -

Current Status

The AWS EC2 instance types Trainium and Inferentia (inf, trn) can be added to a Red Hat OpenShift Service on AWS (ROSA) cluster machine-pool, however the accelerator drivers are not installed as part of the resulting worker node(s).
Customers may opt to use these accelerated instance types as worker nodes in a Red Hat OpenShift cluster on AWS, however customers might consider building their own solution for driver software until the supporting drivers are released.

Planned Support Status

Upon releasing the tested and validated software suite for the Trainium and Inferentia instance types on ROSA, AWS will support the use of these instances in a ROSA cluster. Customers can then expect to use these instances types and their accelerated features.

Appendix

Instance types list

The specific instance types made available are these:

trn1.2xlarge
trn1.32xlarge
trn1n.32xlarge

trn2.48xlarge
trn2u.48xlarge

inf1.xlarge
inf1.2xlarge
inf1.6xlarge
inf1.24xlarge

inf2.xlarge
inf2.8xlarge
inf2.24xlarge
inf2.48xlarge

Comments