Loading...
Loading...
Browse all stories on DeepNewz
VisitWhich category will Mistral 2407 lead in benchmark tests by end of 2024?
Coding • 25%
Hard Prompts • 25%
Math • 25%
Longer Queries • 25%
Benchmark test results published by LMSYS or other reputable AI benchmarking platforms
Mistral's Large 2 AI Model 2407 Outperforms Rivals, Achieves €6 Billion Valuation on LMSYS
Aug 6, 2024, 02:45 PM
Mistral's Large 2 AI model is making significant strides in the AI industry by outperforming established models in code generation and mathematical capabilities. The model, which is accessible on major cloud platforms, has demonstrated superior performance in categories such as Coding, Hard Prompts, Math, and Longer Queries, surpassing GPT4-Turbo and Claude 3 Opus. Additionally, Mistral Large 2 has shown competitive performance against Llama 3.1 405B despite being less than one-third its size. The model, identified as 2407, is now available on LMSYS and excels in Instruction Following. The company, backed by Lightspeed, has reached a €6 billion valuation within a year, marking its prominence in the European AI market. Founders Arthur Mensch, Timothée Lacroix, and Guillaume Lample have been pivotal in driving this success.
View original story
GPT-4o • 33%
Gemini 1.5 • 33%
Claude 3.5 Sonnet • 34%
Chatbots • 25%
Virtual assistants • 25%
Content generation • 25%
Coding • 25%
iOS • 25%
macOS • 25%
Android • 25%
Windows • 25%
Best performing model • 25%
Top 3 performing models • 25%
Top 5 performing models • 25%
Not in top 5 • 25%
Top 1 • 25%
Top 2 • 25%
Top 3 • 25%
Below Top 3 • 25%
Below 69.0 • 25%
69.0 to 69.4 • 25%
69.5 to 69.9 • 25%
70.0 or higher • 25%
Cosine • 25%
Amazon • 25%
Cognition • 25%
Other • 25%
Llama 3.1 405B • 25%
GPT-4o • 25%
Claude Sonnet 3.5 • 25%
Other • 25%
Gaming Performance • 25%
Power Efficiency • 25%
AI Capabilities • 25%
Battery Life • 25%
vivo X200 • 25%
OPPO Find X8 • 25%
Samsung Galaxy S25 • 25%
Other • 25%
Ubuntu • 50%
Android • 50%
Yes • 50%
No • 50%
GPT-4 Turbo • 25%
Other • 25%
Llama 3.1 405B • 25%
Claude 3 Opus • 25%