Elon Musk Unveils Memphis Supercluster: World's Most Powerful AI Training Cluster with 100,000 GPUs

Jul 22, 2024, 10:31 AM

Elon Musk announced the activation of the Memphis Supercluster, a collaboration between xAI, X, and Nvidia, making it the world's most powerful AI training cluster. Activated at 4:20 a.m. local time, the cluster features 100,000 liquid-cooled H100 Nvidia GPUs on a single RDMA fabric. This advanced setup allows the GPUs to work in tandem, optimizing their performance for AI training. The rapid construction of the datacenter has been noted as a significant achievement. Musk also highlighted the goal of building maximally truth-seeking AI to understand the nature of the Universe.