Elon Musk's xAI to Expand Colossus Supercomputer in Memphis to One Million GPUs

Dec 5, 2024, 08:05 AM

Elon Musk's artificial intelligence startup, xAI, has announced plans to significantly expand its 'Colossus' supercomputer in Memphis, Tennessee, aiming to house at least one million graphics processing units (GPUs). The expansion will increase the facility's capacity from its current 100,000 GPUs, making it the largest supercomputer in the world. This move is part of xAI's strategy to leap ahead of rivals like Google, OpenAI, and Anthropic in the AI race. The expansion is supported by major tech companies such as Nvidia, Dell, and Super Micro Computer, which will also bring operations to Memphis. The project is expected to cost tens of billions of dollars, with local server assembly and substantial GPU supply being key components of the initiative. xAI has also secured a $1.08 billion deal with NVIDIA for priority access to AI servers, aligning with Musk's ambitious AI goals.