Anthropic's Claude Opus 4.7 Completes Robot Tasks 20x Faster Than Prior Model, New Benchmark Shows Week-Long Coding Feat
A new Epoch/METR benchmark called MirrorCode shows Claude Opus 4.7 reimplementing large software programs from scratch in tasks estimated to take humans 2-17 weeks, for $251 in inference cost. Separately, Anthropic reports Opus 4.7 completed a suite of quadruped robot tasks in 9 minutes 35 seconds, down from 181 minutes with an earlier model assisting humans.
Anthropic's Claude Opus 4.7 completed a full suite of quadruped robot tasks autonomously in 9 minutes and 35 seconds — down from 181 minutes when humans worked alongside the earlier Claude Opus 4.1 model in August 2025, according to Anthropic's "Project Fetch: Phase Two" writeup. The company says this improvement came from general model scaling, not targeted robotics engineering: "This progress is not the result of a concerted effort to improve the robotics capabilities of our models," Anthropic states. "These improvements, like so many others in the history of LLM development, have emerged from much more general scaling."
The only task Opus 4.7 could not complete was repositioning a ball to its starting location — a task humans also struggled with. Anthropic claims that with more time and scaffolding, "it is very likely" current Claude generations could solve this too.
MirrorCode: measuring week-long coding tasks
Epoch AI and METR released MirrorCode, a benchmark first previewed in April (Import AI #453) that tests whether AI systems can reimplement large software programs using only CLI access — no source code, no web search. According to the release, Claude Opus 4.7 solved one task in 14 hours for $251 in inference cost, on a program METR and Epoch estimate would take a human between 2 and 17 weeks to complete.
MirrorCode includes target programs such as Apple's pkl configuration language (61,000 lines of code), the phylogenetic tree tool gotree (16,000 lines), and the CSV utility qsv_select (87,000 lines). Across 25 target programs, 17 produced at least one perfect-scoring run, and four more scored above 99%. Both Opus 4.7 and GPT-5.5 successfully reimplemented gotree in multiple programming languages for $100–$400 in cost.
Eight of 25 programs were never solved to 100%, and four were never solved to 99%. The hardest target was ruff, a Python linter and formatter; models also struggled with the giac_subset math package and the mailauth email authentication library. Epoch and METR say model performance a year ago would have scored roughly 30% on this benchmark and been limited to simpler programs like calendar utilities. The release includes a public scaffold and 22 of the 25 target programs, totaling 132 task instances across six languages.
Sunday's ACT-2: scale first, fine-tune small
Robotics startup Sunday published results for its ACT-2 model, reporting a 99.1% success rate across 778 successful garment folds spanning nine clothing types. According to the company, simple items like shorts and t-shirts were easiest, while blouses were hardest — though still scoring above 90%. Sunday says its approach is to scale a general pretrained model first, then apply small amounts of high-quality in-house data ("Memos") to close generalization gaps. "We found a general recipe for Solves: scale pretraining, then hill-climb with minimal in-house data," the company writes. Sunday plans to deploy its Memo system to families this fall through a beta program.
What this means
These three results point to the same underlying dynamic: general-purpose model scaling is producing capability gains in domains — robotics, long-horizon coding — that were not directly targeted by training. Anthropic explicitly frames its robotics gains as a byproduct of scaling rather than deliberate robotics research, echoing Sunday's claim that stronger pretrained models make small amounts of task-specific data go further. If this pattern holds, it suggests that continued frontier-model scaling could unlock robotics generalization as a side effect, rather than requiring robotics-specific breakthroughs. On the coding side, MirrorCode's cost figures ($251 for a multi-week-equivalent task) show that autonomous software reconstruction is becoming economically comparable to, or cheaper than, human labor for narrow classes of problems, even though roughly a third of test programs still resist full solving.
Related Articles
Claude Opus 5 Scores 30.2% on ARC-AGI-3, Nearly 4x the Previous Record
Claude Opus 5 scored 30.2 percent on the ARC-AGI-3 benchmark, nearly four times the previous record of 7.8 percent set by OpenAI's GPT-5.6 Sol (Max). The ARC Prize team attributes the leap to genuinely stronger reasoning, though an independent test on a separate puzzle benchmark showed far smaller improvements.
Claude Opus 5 Scores 61 on Intelligence Index, Beats Fable 5 on Cost Across Most Benchmarks
Anthropic's Claude Opus 5 posts a 61 on the Artificial Analysis Intelligence Index, narrowly beating Claude Fable 5 (60) and GPT-5.6 Sol (59) while costing less per task. The model leads in coding and knowledge-work benchmarks but shows a rising hallucination rate of 50 percent.
Kimi K3 Scores 32% on Cyber Exploit Benchmark vs. 76% for Leading U.S. Models, Joint UK-US Study Finds
A joint evaluation by the UK AI Security Institute and U.S. Center for AI Standards and Innovation found Kimi K3 scores 32.2% on the ExploitBench benchmark versus 76.2% for leading U.S. models, though it beats China's GLM-5.2 at 24.4%. The gap may stem from Moonshot AI distilling Claude outputs that exclude advanced offensive cyber content.
Moonshot AI's Kimi K3 matches top US models at 40% lower cost, will be open-weight
Moonshot AI's Kimi K3 model has matched or exceeded performance of Anthropic's Opus 4.8 and OpenAI's GPT-5.6 Sol in independent benchmarks while costing 40% less than comparable US models. The Beijing-based company plans to release Kimi K3 as an open-weight model on July 27.
Comments
Loading...