Custom NeuronLink interconnects and EFA fabric enable ultra-low latency across tens-of-thousands of UltraServers ...
The project uses nearly 500,000 AWS Trainium2 chips, making it the largest Trainium2-based deployment assembled to date.