Loading...
Market
What will be the next significant feature or improvement added to PlanSearch by June 30, 2025?
2
Resolution / Starting Odds
Speed Optimization • 25%
Accuracy Improvement • 25%
Resource Efficiency • 25%
Other • 25%
Official announcements from Scale AI
Story
Scale AI's PlanSearch Enhances Claude 3.5 LLM Code Generation with SOTA Method
Sep 9, 2024, 01:16 PM
Scale AI has proposed a new method called PlanSearch to enhance the diversity and efficiency of large language model (LLM) code generation. This novel search algorithm significantly improves the performance of Claude 3.5, achieving a pass@200 of 77.0% on LiveCodeBench, compared to a pass@1 of 41.4% without search. The method aims to address the challenges of scaling inference capabilities for optimal performance in LLMs. PlanSearch is a state-of-the-art (SOTA) test-time compute method. This development is part of broader efforts to improve LLMs, which are reshaping interactions with technology through applications such as AI-powered chatbots and complex language understanding tasks.
View original story
Similar markets
Yes • 50%
No • 50%
AI Overviews • 25%
Organized with AI • 25%
Traditional Search Results • 25%
Other • 25%
Improved wage transparency • 25%
Easier membership cancellation process • 25%
Enhanced job availability information • 25%
Other • 25%
Apple ID integration • 25%
Biometric authentication • 25%
Multi-chain support • 25%
Other • 25%
Enhanced privacy controls • 25%
New content moderation tools • 25%
Integration with other platforms • 25%
Other major feature • 25%
Enhanced privacy settings • 25%
New content monetization features • 25%
AI-powered content recommendations • 25%
Other • 25%
A paper from Caltech • 25%
A paper from Northeastern University • 25%
A paper from Cursor AI • 25%
Other • 25%
Yes • 50%
No • 50%
Enhanced Content Moderation Tools • 25%
Improved User Interface • 25%
Advanced Privacy Settings • 25%
Other • 25%
New cryptocurrency features • 25%
New stock trading features • 25%
New educational tools • 25%
Other • 25%