Elon Musk Announces Activation of Memphis Supercluster with 100,000 GPUs

Jul 22, 2024, 01:39 PM

Elon Musk has announced the activation of the Memphis Supercluster, which is now the world's most powerful AI training cluster. This facility is a collaboration between xAI, X, and Nvidia. The cluster was activated at 4:20 a.m. local time and features 100,000 liquid-cooled H100 GPUs on a single RDMA fabric. The Memphis Supercluster is expected to significantly enhance AI training capabilities, with the next version of Grok being trained on this new model.