Elon Musk's xAI Launches Colossus with 100k H100 Chips, World's Most Powerful AI System

Sep 2, 2024, 04:59 PM

Elon Musk's xAI team has successfully brought the Colossus 100k H100 training cluster online. This supercomputer, estimated to be worth $4 billion, was completed in just 122 days. Colossus is currently the most powerful AI training system in the world, utilizing 100,000 of Nvidia's H100 chips. Plans are underway to double its size to 200,000 units, incorporating 50,000 H200 chips in the coming months.