Loading...
Market
Will LiveBench AI be integrated into a major AI competition by mid-2025?
2
Resolution / Starting Odds
Yes • 50%
No • 50%
Official announcements from AI competition organizers or Abacus AI
Story
Abacus AI Launches LiveBench AI for LLM Testing
Aug 11, 2024, 08:00 PM
Abacus AI has unveiled LiveBench AI, a new benchmark tool designed to test large language models (LLMs) on various skills such as reasoning, math, and coding. This innovation aims to enhance the evaluation and performance of LLMs in real-world applications. The introduction of LiveBench AI marks a significant step in AI model testing and research, highlighting Abacus AI's role as a prominent player in the field.
View original story
Similar markets
OpenAI o1-preview • 25%
Anthropic Claude 3.5 Sonnet • 25%
OpenAI o1 mini • 25%
Other • 25%
Yes • 50%
No • 50%
Yes • 50%
No • 50%
Finance • 25%
Healthcare • 25%
Technology • 25%
Other • 25%
OpenAI • 25%
Google DeepMind • 25%
Meta AI • 25%
Other • 25%
Claude 3.5 Sonnet • 33%
GPT-4o • 33%
Google's AI Model • 33%
Yes • 50%
No • 50%
ChatGPT-4o • 25%
Google's Gemini • 25%
Another AI model • 25%
No clear leader • 25%
Yes • 50%
No • 50%
DeepSeek • 25%
OpenAI • 25%
Google DeepMind • 25%
Other • 25%