Anthropic's Claude gains computer control in Code and Cowork tools
Anthropic has expanded Claude's autonomous capabilities to its Code and Cowork AI tools, allowing the model to control your Mac's mouse, keyboard, and display to complete tasks without manual intervention. The research preview is available now for Claude Pro and Max subscribers on macOS only, with support for other operating systems coming later.
Anthropic has updated Claude's Code and Cowork AI agents with autonomous computer control capabilities, allowing the model to manipulate your Mac's interface directly when needed.
The feature is now available as a research preview for Claude Pro and Max subscribers, though macOS is currently the only supported operating system. Users must have the Claude desktop app running on a compatible Mac and paired with Claude's mobile app to access the functionality.
How It Works
Claude can now autonomously open files, launch applications, control web browsers, and execute developer tools without requiring manual setup or input. The system prioritizes direct integrations with services like Slack and Google Workspace when available, but will fall back to directly controlling your mouse, keyboard, and display if a connector isn't accessible.
According to Anthropic, the model will request explicit user permission before performing any autonomous actions. The feature works across scrolling, clicking, and navigating interfaces as needed to complete assigned tasks.
The implementation integrates with Anthropic's Dispatch feature—a cross-device tool released recently that lets users assign tasks to Claude from their mobile devices. This combination allows users to delegate work to Claude even when they're away from their computer.
Current Limitations
Anthropicbuildsonwork introduced in Claude 3.5 Sonnet in 2024, which first demonstrated autonomous computer interaction capabilities. However, the company acknowledges significant limitations in the current research preview.
"Complex tasks sometimes need a second try, and working through your screen is slower than using a direct integration," Anthropic stated. The company is deliberately releasing the feature early to identify where the technology succeeds and where it struggles.
The feature is limited to macOS for now, with the company planning to expand to other operating systems in the future.
What This Means
This marks a significant step toward Claude functioning as a true autonomous agent capable of handling real-world computer tasks without human intervention. The research preview approach allows Anthropic to gather real-world usage data and improve reliability before wider rollout. However, the acknowledged performance gaps—particularly the need for task retries and slower execution compared to direct API integrations—suggest the technology remains in early stages. The macOS-only limitation also restricts immediate utility for developers and teams using Windows or Linux systems.
Related Articles
US export controls force Anthropic to take Claude Fable 5 offline indefinitely
The US government imposed export controls on Anthropic's newly released Claude Fable 5 and underlying Mythos models on Friday, restricting access even for foreign nationals working at Anthropic in the United States. Anthropic took both models completely offline rather than risk non-compliance, leaving Fable unavailable to all users as of this writing.
Google expands Gemini Android overlay menu with six new tools accessible without opening app
Google has expanded the Gemini overlay plus menu on Android to include six tools: Videos, Music, Canvas, and Guided Learning join the existing Images and Personal Intelligence options. The update, rolling out in Google app version 17.32, allows users to access most Gemini features from anywhere on Android without opening the full app.
U.S. government orders Anthropic to halt exports of Mythos and Fable AI models, both now offline for one week
The White House ordered Anthropic to restrict exports of its Mythos and Fable AI models last Friday, citing national security concerns. Anthropic pulled both models offline within 90 minutes of the Commerce Department directive, marking the first major test of AI export controls.
US government forces Anthropic to pull Fable 5 and Mythos 5 models over guardrail bypass concerns
The US government forced Anthropic to withdraw its Fable 5 and Mythos 5 models, citing national security concerns after Amazon researchers allegedly discovered a method to bypass Fable 5's safety guardrails. Cybersecurity researchers have signed an open letter opposing the ban, with Anthropic noting similar vulnerabilities exist in competing models.
Comments
Loading...