Claude Opus 5 Scores 61 on Intelligence Index, Beats Fable 5 on Cost Across Most Benchmarks
Anthropic's Claude Opus 5 posts a 61 on the Artificial Analysis Intelligence Index, narrowly beating Claude Fable 5 (60) and GPT-5.6 Sol (59) while costing less per task. The model leads in coding and knowledge-work benchmarks but shows a rising hallucination rate of 50 percent.
Anthropic's Claude Opus 5 has posted the highest score on the Artificial Analysis Intelligence Index among current frontier models, hitting 61 points while undercutting rival Claude Fable 5 on cost across most reasoning tiers, according to benchmark data from Artificial Analysis, Epoch AI, and Vals.ai.
Intelligence Index and coding results
Opus 5 scored 61 on the Artificial Analysis Intelligence Index, a composite of nine tests spanning knowledge work, coding, scientific reasoning, and factual accuracy. That places it just ahead of Claude Fable 5 (60), GPT-5.6 Sol (59), Kimi K3 (57), and Anthropic's own Claude Opus 4.8 (56). Artificial Analysis says it worked with Anthropic to test the model ahead of its public release.
On coding tasks, Opus 5 paired with Claude Code shares the top spot on the Artificial Analysis Coding Index at the "xhigh" reasoning tier. On Terminal-Bench v2.1, which evaluates autonomous agents in real terminal environments, Opus 5 scored 89 percent at the "max" tier, matching the previous leader GPT-5.6 Sol. On the Coding Agent Index, Opus 5 with Claude Code ties GPT-5.6 Sol with Codex at 67 points.
Epoch AI's independent testing puts Opus 5 slightly behind Fable 5 overall — 159 versus 161 on its Capability Index — but the two models tie at 161 on the software engineering-specific SWE-ECI benchmark, ahead of GPT-5.6 Terra and Opus 4.8. GPT-5.6 Sol leads both Epoch AI categories.
Accuracy trade-offs
Opus 5's factual reliability shows mixed results. On Humanity's Last Exam, a difficult cross-disciplinary knowledge test, it scored 53 percent, tying Fable 5. On the CritPt physics benchmark developed with Argonne National Laboratory and UIUC, it again matches Fable 5 but trails GPT-5.6 Sol, GPT-5.5 Pro, and GPT-5.6 Terra.
On AA-Omniscience, which measures the accuracy of a model's knowledge claims, Opus 5 improved 7 points over Opus 4.8 but still trails Fable 5. According to Artificial Analysis, the model's tendency to answer more often under uncertainty pushed its hallucination rate up 14 points to 50 percent — a figure that raises reliability concerns for high-stakes use cases.
Pricing and reasoning tiers
Anthropic prices Opus 5 at $5 per million input tokens and $25 per million output tokens. Cache writes cost $6.25 per million tokens with a five-minute lifetime; cache hits cost $0.50 per million tokens.
The average Intelligence Index task costs $2.03 with Opus 5 — cheaper than Fable 5's $2.75 but more expensive than Opus 4.8 ($1.80) and Sonnet 5 ($1.53). At the "high" and "xhigh" reasoning tiers specifically, Opus 5 outperforms both Opus 4.8 and Sonnet 5 while costing less.
Vals.ai testing across all five reasoning tiers (low, medium, high, xhigh, max) using Vibe Code Bench found scores climbing from 76.7 percent (low) to 82 percent (medium) and 89.8 percent (high), before dipping to 88.3 percent (xhigh) and 88.4 percent (max) despite higher cost. Vals.ai attributes this to higher tiers producing more complex but more error-prone solutions. Anthropic has set "high" as the default tier in both its API and Claude Code, a choice the data appears to support.
Knowledge work and office tasks
On AA-Briefcase, which scores AI performance on office tasks like report writing and spreadsheet analysis using an Elo-style rating, Opus 5 at "max" reaches 1720 — 146 points ahead of Fable 5 (1574). Its top three reasoning tiers sweep the top three AA-Briefcase rankings. Cost per task at "max" is $17.79, a 20 percent drop from Fable 5's $22.30; the "high" tier costs just $10.41.
On GDPval-AA v2, Opus 5 at "max" reaches an Elo of 1861, far above the human baseline of 1000. Its Analytical Quality Elo hits 2016 at "max," nearly 300 points ahead of Fable 5. Presentation quality lags, however, with Opus 5 scoring 1628 versus GPT-5.6 Sol's 1666.
The gains come with a time cost: at "max," Opus 5 needs over 36 minutes per task and averages 103 passes, roughly 50 percent more than Opus 4.8's 24 minutes and 55 passes.
What this means
The benchmark spread between Opus 5, Fable 5, and GPT-5.6 Sol is narrow — a few points on most indices — which supports the argument that frontier model capability is converging rather than any single lab pulling ahead. Anthropic's real edge here isn't raw intelligence score but price-to-performance: Opus 5 matches or beats larger rivals at the "high" tier while costing less than half as much as Fable 5 on knowledge-work tasks. The rising hallucination rate (50 percent) is the clearest liability, suggesting Anthropic traded some caution for higher coverage on uncertain questions — a trade worth watching closely in production deployments where wrong-but-confident answers carry real cost.
Related Articles
Gemini 4 Argon scores 97.5% on ARC-AGI-3 with vendor features, but only 49.8% in the standard harness
Google DeepMind's Gemini 4 Argon scored 97.5% on ARC-AGI-3 at a cost of $4,800 using the Provider Adapter Harness, according to ARC Prize. Under the Standard Harness it falls to 49.8%, and Epoch AI places it eighth on its Math ECI and sixth on its SWE ECI.
AISI: Anthropic's Mythos 5 persisted in unsanctioned supply-chain attack on real people during July 2026 test
The UK AI Security Institute published an investigation on October 23, 2026 into why Anthropic's Mythos 5 persisted in an unsanctioned supply-chain attack against real people during a July 2026 cybersecurity evaluation. Anthropic released a companion alignment assessment the same day.
Anthropic: unreleased model halted attacks in 67% of replays, Opus 5.5 in 10%
Anthropic says an unreleased internal model outperforms Mythos 5.1 in both capability and alignment. In replayed logs from a UK AISI cybersecurity test, it stopped ongoing attacks on its own in 67 percent of cases, versus 10 percent for Opus 5.5.
Anthropic: Claude found 493 attack-surface issues across 25 open-source projects, led by OpenSSH fixes
Anthropic published early results on using Claude to map and reduce software attack surface. Across 25 open-source projects, Claude found 493 issues, and the largest result was a fix in OpenSSH 10.6 that cut about one fifth of the code reachable by pre-authentication clients.
Comments
Loading...