Loading...
Market
Will Cerebras' AI inference tool achieve 10% market share in AI computing by the end of 2024?
3
Resolution / Starting Odds
Yes • 50%
No • 50%
Market share data from credible sources like Gartner or IDC
Story
Cerebras Launches World's Fastest AI Inference Tool, 20x Faster Than Nvidia
Aug 27, 2024, 04:04 PM
Cerebras Systems has launched a new AI inference tool that aims to challenge Nvidia's dominance in the AI computing market. The startup claims its new service, known as Cerebras Inference, is the world's fastest AI inference service. It boasts significant performance advantages, including processing speeds of 1,850 tokens per second for Llama 3.1 8B models and 446 tokens per second for 70B models, with a rate of 450 tokens per second for some configurations. The service is priced at 60 cents per million tokens, which is a fifth of the cost offered by hyperscalers, and offers full 16-bit precision for model accuracy. Cerebras' tool is reportedly 20 times faster than Nvidia's GPUs and twice as fast as those from Groq, making it a competitive alternative for AI developers. The service leverages Cerebras' custom waferscale chips to achieve these performance metrics.
View original story
Similar markets
Below 5% • 25%
5% to 10% • 25%
10% to 15% • 25%
Above 15% • 25%
Yes • 50%
No • 50%
Less than 5% • 25%
5% to 10% • 25%
10% to 15% • 25%
More than 15% • 25%
Less than 5% • 25%
5% to 10% • 25%
10% to 15% • 25%
More than 15% • 25%
Yes • 50%
No • 50%
Less than 10% • 25%
10% to 20% • 25%
20% to 30% • 25%
More than 30% • 25%
Less than 5% • 25%
5% to 10% • 25%
10% to 20% • 25%
More than 20% • 25%
Cerebras offers significantly better price-performance • 25%
Cerebras offers slightly better price-performance • 25%
Nvidia offers slightly better price-performance • 25%
Nvidia offers significantly better price-performance • 25%
Less than 5% • 25%
5% to 10% • 25%
10% to 20% • 25%
More than 20% • 25%