Reports from AI research publications or major tech news outlets

xAI's Grok 3 Pretraining Completed on 100k H100 Cluster with 10 Times More Compute

Jan 4, 2025, 02:16 AM

Elon Musk's xAI has completed the pretraining phase for its upcoming AI model, Grok 3, which utilized 10 times more computational power than its predecessor, Grok 2. The pretraining was completed on a 100k H100 cluster. Musk announced that Grok 3 is set to be released soon, with expectations that it will be the most powerful AI in the world. The development of Grok 3 is part of xAI's ongoing efforts to advance AI technology, with the company reportedly working towards linking 1,000,000 GPUs together.