Claude Computer use

Claude 3.5 Sonnet and Claude 3.5 Haiku represent significant advancements in AI technology. The upgraded Claude 3.5 Sonnet excels in coding and tool use tasks, showing marked improvements over its predecessor. It leads industry benchmarks in agentic coding, with notable enhancements in reasoning and problem-solving capabilities. Early adopters like GitLab and Cognition have reported substantial benefits in software development and autonomous AI evaluations.

Claude 3.5 Haiku, the next generation of the fastest model, offers superior performance at the same cost and speed as Claude 3 Haiku. It surpasses previous models, including Claude 3 Opus, in intelligence benchmarks and is particularly effective in coding tasks. With low latency and improved instruction following, Claude 3.5 Haiku is ideal for user-facing products and specialized tasks.

A groundbreaking new capability, computer use, is introduced in public beta. This feature allows Claude to interact with computers like humans, performing tasks by looking at screens, moving cursors, clicking buttons, and typing text. Although still experimental and prone to errors, it holds promise for automating complex processes and conducting open-ended tasks. Early users such as Replit and The Browser Company are already exploring its potential.

Developers can access the computer use beta through the Anthropic API, Amazon Bedrock, and Google Cloud’s Vertex AI. Safety measures are in place to mitigate risks associated with this new capability, ensuring responsible deployment. The Claude 3.5 Haiku model will be available later this month, initially as a text-only model, with image input to follow.