Loading...
Market
Will Cerebras Inference service achieve a significant market share by mid-2025?
2
Resolution / Starting Odds
Yes • 50%
No • 50%
Market analysis reports from reputable firms like Gartner or IDC
Story
Cerebras Launches AI Inference Service, 20x Faster with 1,850 Tokens/sec for 8B Model
Aug 27, 2024, 05:22 PM
Cerebras Systems has launched what it claims to be the world's fastest AI inference service, directly challenging Nvidia's dominance in the AI computing sector. The new service, known as Cerebras Inference, utilizes the company's custom wafer-scale AI accelerator chips to achieve significant performance gains. It is capable of processing Llama 3.1 models at impressive speeds: 1,850 tokens per second for the 8B model and 450 tokens per second for the 70B model. Cerebras asserts that its inference tool offers a 20x speed increase over traditional GPU-based systems, and it is priced at 60 cents per million tokens, which is a fifth of the cost compared to hyperscalers. The launch aims to provide a cost-effective and efficient alternative to Nvidia's GPUs, with claims of delivering 100x better price-performance.
View original story
Similar markets
Yes • 50%
No • 50%
Yes • 50%
No • 50%
Below 5% • 25%
5% to 10% • 25%
10% to 15% • 25%
Above 15% • 25%
Yes • 50%
No • 50%
Less than 10% • 25%
10% to 20% • 25%
20% to 30% • 25%
More than 30% • 25%
1st • 25%
2nd • 25%
3rd • 25%
4th or lower • 25%
Yes • 50%
No • 50%
Yes • 50%
No • 50%
Less than 5% • 25%
5% to 10% • 25%
10.1% to 20% • 25%
More than 20% • 25%
Less than 5% • 25%
5% to 10% • 25%
10% to 15% • 25%
More than 15% • 25%