Loading...
Market
Which company will have the highest ELO-rated chatbot by the end of 2024?
2
Resolution / Starting Odds
Google • 25%
OpenAI • 25%
Anthropic • 25%
Other • 25%
LMSYS leaderboard
Story
Google's Gemini 1.5 Pro Tops AI Leaderboard, Surpasses GPT-4o by 14 Points with 1300 ELO
Aug 1, 2024, 04:41 PM
Google has launched a major upgrade to its Gemini chatbot with the introduction of Gemini 1.5 Flash, a lighter and faster model that will power the free tier of Gemini on both web and mobile applications. Concurrently, Google DeepMind's experimental Gemini 1.5 Pro (0801) has been tested in the Chatbot Arena, gathering over 12,000 community votes and claiming the number one spot on the LMSYS leaderboard, surpassing GPT-4o and Claude-3.5 by 14 points. The new version is available for early testing on Google AI Studio and the Gemini API. This significant achievement has been attributed to various advances in post-training, and it marks a notable milestone for Google's AI capabilities, with an ELO rating of 1300.
View original story
Similar markets
Google • 25%
OpenAI • 25%
Anthropic • 25%
Other • 25%
Grok • 25%
ChatGPT • 25%
Claude • 25%
Gemini • 25%
Grok leads • 25%
ChatGPT leads • 25%
Claude leads • 25%
Gemini leads • 25%
ChatGPT-4o • 25%
Gemini 1.5 Pro • 25%
Claude-3.5 • 25%
Other • 25%
OpenAI • 25%
xAI • 25%
Google • 25%
Other • 25%
Gemini 2.0 Flash Thinking • 25%
OpenAI's o1 • 25%
Microsoft's AI Model • 25%
Other • 25%
Google • 25%
OpenAI • 25%
Microsoft • 25%
Other • 25%
Google leads • 33%
Meta leads • 33%
Character AI leads • 33%
Google Bard • 25%
Anthropic Claude • 25%
Meta's LLaMA • 25%
Other • 25%
Replika • 25%
Woebot • 25%
X2AI • 25%
Other • 25%
Goldman Sachs • 25%
Morgan Stanley • 25%
Bank of America • 25%
Citigroup • 25%
xAI • 25%
Anthropic • 25%
Google DeepMind • 25%
Other • 25%