Trainium3 UltraServers by Amazon

Amazon EC2 Trn3 UltraServers powered by AWS first 3nm AI chip help organizations of all sizes run their most ambitious AI training and inference workloads. Trainium3 UltraServers deliver high performance for AI workloads with up to 4.4x more compute performance, 4x greater energy efficiency, and almost 4x more memory bandwidth than Trainium2 UltraServers—enabling faster AI development with lower operational costs. Trn3 UltraServers scale up to 144 Trainium3 chips, delivering up to 362 FP8 PFLOPs with 4x lower latency to train larger models faster and serve inference at scale.