Official performance reports from Nvidia or xAI, reputable tech news outlets

Nvidia and xAI Unveil Colossus, World's Largest AI Supercomputer Built in 122 Days with 100,000 GPUs and 95% Data Throughput

Oct 28, 2024, 03:16 PM

Nvidia has announced the completion of the world's largest AI supercomputer, the Colossus, built in collaboration with Elon Musk's startup xAI. The supercomputer comprises 100,000 NVIDIA Hopper GPUs and utilizes Nvidia's Spectrum-X Ethernet networking platform, which is crucial for its performance. The project was completed in just 122 days, a feat that Nvidia chief Jensen Huang noted would typically take years for others to achieve. The Colossus supercomputer is designed to handle massive data throughput with 95% efficiency and zero latency issues, with plans for expansion to 200,000 GPUs underway.