AI model performance rankings from reputable AI research organizations

Anthropic Launches Upgraded Claude 3.5 Models with Improved Coding and Beta 'Computer Use' Feature

Oct 22, 2024, 03:40 PM

Anthropic has announced an upgraded Claude 3.5 Sonnet AI model and introduced a new model, Claude 3.5 Haiku, which is more affordable and optimized for simple queries. The upgraded Claude 3.5 Sonnet offers significant improvements in coding capabilities, achieving a 49% score on the SWE-bench Verified coding benchmark, outperforming all publicly available models. Additionally, Anthropic has introduced a new feature called 'Computer Use', currently in beta and available via API, which allows developers to direct Claude to interpret computer screens and perform actions on behalf of users by imitating mouse and keyboard inputs. This capability enables the AI to browse the web, click, type, and interact with applications, opening up possibilities for automating tasks such as coding with automated debugging, customer support, and testing. The new models and feature are available through Anthropic's API, as well as on Amazon Bedrock and Google Cloud Vertex AI.