Loading...
Market
Will XBOW AI pentester surpass 90% success rate by end of 2024?
3
Resolution / Starting Odds
Yes • 50%
No • 50%
Official reports or publications from GitHub or relevant cybersecurity benchmarks like PentesterLab and PortSwigger
Story
XBOW AI Pentester Matches Human Experts, Achieves 85% Success in 28 Minutes
Aug 5, 2024, 02:25 PM
The team behind GitHub Copilot has launched XBOW, an AI-powered penetration tester that rivals human experts. XBOW, led by Oege de Moor, has demonstrated remarkable capabilities by matching the performance of a 20-year veteran pentester in just 28 minutes, achieving 85% success in identifying vulnerabilities. The AI tool scored an unprecedented 75% on renowned web pentesting benchmarks from PentesterLab and PortSwigger. In a head-to-head competition, XBOW solved 88 out of 104 challenges, matching the performance of human experts given 40 hours. XBOW's performance has shown that AI can significantly accelerate cybersecurity tasks.
View original story
Similar markets
Yes • 50%
No • 50%
Yes • 50%
No • 50%
Very satisfied • 25%
Somewhat satisfied • 25%
Neutral • 25%
Dissatisfied • 25%
0 • 25%
1 • 25%
2 • 25%
3 or more • 25%
Big Sleep • 25%
Gemini 1.5 Pro • 25%
ChatGPT • 25%
Other • 25%
Nemotron 70B • 25%
ChatGPT4o • 25%
Sonnet 3.5 • 25%
Other • 25%