Loading...
Market
Which company will lead in AI tokens per second by December 31, 2025?
3
Resolution / Starting Odds
Cerebras Systems • 25%
OpenAI • 25%
Anthropic • 25%
Other • 25%
Comparative performance metrics from credible tech research firms or industry reports
Story
Cerebras Achieves 969 Tokens/Second with Meta's Llama 3.1 405B, 12x Faster than GPT-4o, 240ms Time-to-First-Token
Nov 19, 2024, 06:44 AM
Cerebras Systems has achieved a significant milestone in AI performance with its deployment of Meta's Llama 3.1 405B model. The system operates at an impressive output of 969 tokens per second, making it 12 times faster than OpenAI's GPT-4o and 18 times faster than Anthropic's Claude 3.5 Sonnet. Additionally, it boasts a time-to-first-token of just 240 milliseconds and supports a context length of 128,000 tokens with 16-bit weights. This performance enhancement is attributed to Cerebras's advanced Wafer Scale Engine (WSE), which has redefined capabilities in AI and scientific computing. The company plans to introduce a public inference endpoint soon, further expanding access to this high-speed AI technology.
View original story
Similar markets
DeepSeek • 25%
OpenAI • 25%
Google DeepMind • 25%
Other • 25%
Meta leads • 33%
OpenAI leads • 33%
Google leads • 33%
OpenAI • 25%
Google • 25%
Meta • 25%
Other • 25%
AMD • 25%
Google • 25%
Microsoft • 25%
Other • 25%
Google • 25%
OpenAI • 25%
Microsoft • 25%
Other • 25%
Amazon • 25%
Nvidia • 25%
Microsoft • 25%
Alphabet • 25%
Nvidia • 25%
Cerebras • 25%
Google • 25%
Other • 25%
OpenAI • 25%
Google • 25%
Microsoft • 25%
Other • 25%
Nvidia maintains lead • 25%
Amazon surpasses Nvidia • 25%
Amazon matches Nvidia • 25%
Other company leads • 25%
Nvidia • 25%
OpenAI • 25%
Anthropic • 25%
Other • 25%
World Labs • 25%
Google • 25%
Meta • 25%
Other • 25%
Intel Core Ultra 200V • 33%
Qualcomm Snapdragon X Elite • 33%
AMD Strix Point • 33%
Other • 1%