Loading...
Market
Will OpenDiLoCo surpass DeepMind's DDP in performance benchmarks by Q1 2025?
2
Resolution / Starting Odds
Yes • 50%
No • 50%
Benchmark reports or peer-reviewed publications comparing OpenDiLoCo and DDP
Story
PrimeIntellect Open-Sources OpenDiLoCo, Scaling Up DeepMind’s DiLoCo for Global AI Training
Jul 11, 2024, 04:59 PM
DeepMind's Distributed Low-Communication (DiLoCo) method has been open-sourced and scaled up by PrimeIntellect. The new framework, OpenDiLoCo, integrates with FDSP and enables globally distributed AI model training with 90-95% compute utilization across three countries. This development marks a significant step towards decentralized training for AI models, making it more accessible and scalable. PrimeIntellect's work replicates and extends DeepMind's research, tripling the size of the original experiments. Further work is needed as DDP outperforms in some cases.
View original story
Similar markets
Yes • 50%
No • 50%
Yes • 50%
No • 50%
Yes • 50%
No • 50%
GLUE • 25%
SuperGLUE • 25%
SQuAD • 25%
Other • 25%
Google • 25%
Microsoft • 25%
Amazon • 25%
Other • 25%
Yes • 50%
No • 50%
Yes • 50%
No • 50%
Yes • 50%
No • 50%
