Loading...
Market
What will be SambaNova Cloud's market share in AI inference platforms by December 31, 2024?
2
Resolution / Starting Odds
Less than 10% • 25%
10% to 20% • 25%
20% to 30% • 25%
More than 30% • 25%
Market analysis reports from reputable firms like Gartner or IDC
Story
SambaNova Launches Fastest AI Inference Platform for Llama 3.1 at 570 Tokens/Second
Sep 10, 2024, 04:34 PM
SambaNova has announced the launch of its new cloud inference platform, SambaNova Cloud, which offers unprecedented speeds for AI model inference. Notably, the Llama 3.1 405B model achieves a speed of 132 tokens per second in full precision, while the Llama 3.1 70B model reaches up to 570 tokens per second. This performance is significantly faster than traditional GPUs, with claims of up to 10 times faster inference speeds. The platform operates in real-time and serves the Llama 3.1 405B model in 16-bit precision. It is available for developers starting today, with free access via API and no waitlist. The service has been independently verified and is expected to enable advanced AI applications.
View original story
Similar markets
Less than 5% • 25%
5% to 10% • 25%
10.1% to 20% • 25%
More than 20% • 25%
Less than 50% • 25%
50% to 60% • 25%
60% to 70% • 25%
More than 70% • 25%
Above 60% • 33%
50% to 60% • 33%
Below 50% • 34%
Increases by more than 5% • 25%
Remains stable (within 5% change) • 25%
Decreases by less than 5% • 25%
Decreases by more than 5% • 25%
Less than 70% • 25%
70% to 80% • 25%
80% to 90% • 25%
More than 90% • 25%
Increases • 33%
Remains the same • 34%
Decreases • 33%
Less than 20% • 25%
20%-40% • 25%
40%-60% • 25%
More than 60% • 25%
Increase significantly • 25%
Increase moderately • 25%
No change • 25%
Decrease • 25%
NVIDIA > 50% • 25%
NVIDIA 30-50% • 25%
NVIDIA 10-30% • 25%
NVIDIA < 10% • 25%
Above 85% • 25%
80%-85% • 25%
75%-80% • 25%
Below 75% • 25%
Less than 5% • 25%
5% to 10% • 25%
10% to 15% • 25%
More than 15% • 25%
Less than 10% • 25%
10% to 20% • 25%
20% to 30% • 25%
More than 30% • 25%