Loading...
Market
Which sector will primarily adopt Nous Research's 15B model by end of 2025?
2
Resolution / Starting Odds
Healthcare • 25%
Finance • 25%
Education • 25%
Other • 25%
Nous Research's official reports or industry analysis publications
Story
Nous Research Pre-Trains 15B Model with DeMo and Heterogeneous Hardware
Dec 2, 2024, 05:03 PM
Nous Research has announced the successful pre-training of a 15-billion parameter language model using distributed training over the internet. The model, trained with Nous DisTrO (now DeMo), utilized heterogeneous hardware contributed by partners such as Oracle, LambdaAPI, Northern Data Group, Crusoe Cloud, and the Andromeda Cluster. The training achieved a loss curve and convergence rate that meets or exceeds those of centralized training methods, demonstrating the viability of decentralized training at scale.
View original story
Similar markets
Enterprise • 25%
Education • 25%
Healthcare • 25%
Other • 25%
Enterprise • 33%
Education • 33%
Both equally • 33%
Healthcare • 25%
Finance • 25%
Education • 25%
Technology • 25%
Healthcare • 25%
Finance • 25%
Automotive • 25%
Other • 25%
Customer Service Bots • 25%
Real-time Collaboration Tools • 25%
Interactive Educational Platforms • 25%
Coding and Development Tools • 25%
Natural Language Processing • 25%
Computer Vision • 25%
Robotics • 25%
Other • 25%
Healthcare • 25%
Finance • 25%
Technology • 25%
Other • 25%
Finance • 25%
Healthcare • 25%
Retail • 25%
Manufacturing • 25%
Customer Service • 25%
Real-time Collaboration • 25%
Interactive Education • 25%
Software Development • 25%
Entertainment/Film • 25%
Advertising/Marketing • 25%
Education • 25%
Other • 25%
Banking • 25%
Real Estate • 25%
Technology • 25%
Other • 25%
Tech • 25%
Finance • 25%
Healthcare • 25%
Retail • 25%