Microsoft Releases Fara1.5-27B, a 27B Vision-Only Web Browsing Agent with 262K Context
Microsoft Research AI Frontiers has released Fara1.5-27B, a 27-billion-parameter multimodal agent that completes web tasks by reading screenshots and emitting click/type/scroll commands. The model, fine-tuned from Qwen3.5-27B, ships under MIT license with a 262K-token context window and is designed to run alongside Microsoft's MagenticLite sandbox.
Microsoft Research AI Frontiers has released Fara1.5-27B, a 27-billion-parameter multimodal model built specifically to act as a computer use agent (CUA) inside web browsers. The model was published on Hugging Face on 21 May 2026 under the MIT license.
Fara1.5-27B perceives the browser exclusively through screenshots — it does not read the DOM or accessibility tree. Given a user goal, the current screenshot, and a history of prior actions, it outputs a chain-of-thought block followed by an XML-tagged tool call (click, type, scroll, visit_url, web_search, and others) with grounded pixel coordinates for actions like clicks and drags. According to Microsoft, this vision-only approach mirrors the input modality available to a human user and removes the need for a separate grounding model.
Architecture and training
Fara1.5-27B is a supervised fine-tune of Qwen3.5-27B, trained on synthetic data generated by Microsoft's internal pipeline, FaraGen1.5, which synthesizes web tasks, executes trajectories, and verifies results before they're used for training. Training ran from January 2026 to April 2026 on 64 NVIDIA B200 GPUs over six days. The model supports a 262,144-token context window, which Microsoft says is sufficient for multi-screenshot trajectories with full action history — though the reference agent loop retains only the three most recent screenshots per turn.
Pricing is not disclosed since the model is released as open weights; deployment cost depends on self-hosted inference infrastructure. Microsoft recommends sharding the 27B model across at least two GPUs in bf16, with A6000, A100, H100, and B200 cards tested. Serving is supported via vLLM (version 0.19.1+) with a max model length of 262,144 tokens.
Safety design: critical points
Microsoft built Fara1.5-27B to pause and request user confirmation at three categories of "critical points": missing personal information (never fabricating fields like email or payment details), underspecified tasks that require clarification, and irreversible actions such as submitting forms, completing purchases, sending messages, or deleting data. The model will proceed past these points only with explicit prior authorization from the user.
The company states the model is co-designed with MagenticLite, a companion deployment framework providing Docker-based sandboxing, domain allow-lists, real-time watch-mode monitoring, and an immediate pause control. Microsoft explicitly warns that developers integrating Fara1.5-27B directly, without MagenticLite's controls, are responsible for implementing equivalent safeguards, and cautions against running the model with unrestricted browser access on machines containing sensitive data.
No third-party benchmark scores were included in the release materials, so performance claims relative to other computer-use agents remain unverified.
What this means
Fara1.5-27B is Microsoft's entry into the increasingly crowded field of browser-operating agents, competing conceptually with efforts like Anthropic's computer use tooling and OpenAI's agentic browsing features. The 27B parameter count and MIT license make it notably more accessible for self-hosting than closed frontier agents, and the vision-only design sidesteps dependency on site-specific DOM access — a common failure point for scraping-based agents. The explicit critical-points safety framework, requiring pauses before payments, submissions, and irreversible actions, addresses a real liability concern for autonomous browser agents, though its effectiveness in practice depends on how reliably the model recognizes those situations across the long tail of real websites. Because no independent benchmark data accompanies this release, claims about task completion reliability should be treated as unverified until third-party evaluation appears.
Related Articles
Microsoft Releases Mage-Flow, a 4B Open-Weight Model That Matches 20B+ Rivals on Image Generation and Editing
Microsoft has released Mage-Flow, a 4B-parameter open-weight foundation model for text-to-image generation and instruction-based editing. The company claims it matches or beats much larger open systems like Qwen-Image (20B) and FLUX.2 (32B) while running faster and using less memory.
Anthropic's Claude Opus 5 Hits 0% Prompt Injection Success Rate in Browser Agent Tests, With Defenses Enabled
Anthropic's system card for Claude Opus 5 reports a 0% prompt injection success rate across 129 browser agent test scenarios when Auto Mode is enabled. On Gray Swan's broader indirect prompt injection benchmark, Opus 5 posted a 2.0% attacker success rate after 15 attempts, the lowest among tested frontier models.
Anthropic Ships Claude Opus 5, Claims Near-Fable Performance at Half the Price
Anthropic released Claude Opus 5 on July 24, 2026, positioning it as a lower-cost alternative to its more expensive Claude Fable 5 model. Independent evaluators Epoch AI and Artificial Analysis report mixed but largely favorable results, with Opus 5 nearly matching Fable 5 on coding benchmarks while cutting cost-per-task by roughly 20%.
Anthropic Ships Claude Opus 5, Claims It Matches Flagship Fable 5 on Coding at Half the Cost
Anthropic released Claude Opus 5 on July 24, its fourth model launch in under two months, priced at $5 per million input tokens and $25 per million output tokens. The company claims the model matches or beats its flagship Fable 5 on most coding and knowledge-work benchmarks while posting the lowest deception rate of any model it has shipped.
Comments
Loading...