analysisAnthropic

Anthropic's Mythos Preview solves previously unsolvable cybersecurity test in updated checkpoint

TL;DR

A month after its initial release, a newer checkpoint of Anthropic's Mythos Preview became the first model to complete the UK AI Safety Institute's 'Cooling Tower' cyber range, solving it in 3 of 10 attempts. The model also completed 'The Last Ones' range in 6 of 10 attempts, surpassing OpenAI's GPT-5.5 and demonstrating capability improvements within a single model version.

3 min read
0

Anthropic's Mythos Preview solves previously unsolvable cybersecurity test in updated checkpoint

A newer checkpoint of Anthropic's Mythos Preview has become the first AI model to complete the UK AI Safety Institute's (AISI) second cyber range test, according to a report published Wednesday. The model solved the previously unsolved 'Cooling Tower' range in 3 of 10 attempts and completed 'The Last Ones' range in 6 of 10 attempts — just one month after Mythos' initial release.

The results demonstrate that capability improvements are occurring between checkpoints of a single model, not just across major releases. The newer Mythos Preview checkpoint outperformed both its earlier version and OpenAI's GPT-5.5 on AISI's cybersecurity benchmarks.

Accelerating cyber capabilities

AISI's testing revealed a rapid acceleration in AI models' ability to handle cybersecurity tasks. According to the institute's internal estimates from February 2026, the length of cyber tasks AI models could complete had doubled every 4.7 months since late 2024 — faster than their November 2025 estimate of 8 months.

"Since then, AISI reported on two new models, Claude Mythos Preview and GPT-5.5, which substantially exceeded both doubling rate trends," the researchers wrote. Whether this acceleration represents a lasting trend or temporary spikes from outlier models remains unclear.

Testing limitations understate capabilities

AISI researchers acknowledged their tests significantly understate what frontier models can actually do. The cyber range experiments capped tasks at 2.5 million tokens to enable consistent performance comparisons over time.

"Mythos Preview and GPT-5.5 have large upper-bound error bars due to near-100% success rates on our narrow cyber suite's longest tasks, even with the 2.5M token limit," the report stated. Without the token cap, success rates would be substantially higher — so high that "time horizons become impossible to calculate."

In separate testing using up to 100 million tokens, AISI found performance would likely continue improving beyond that budget, especially for recent models which "disproportionately benefit from higher token limits." The tests also cannot determine how sharply model reliability deteriorates at higher task lengths, placing the latest models "at the limit of what our narrow test suite can measure."

Project Glasswing context

Anthropic released Mythos Preview in April 2026 as part of Project Glasswing, a cybersecurity testing alliance formed with rival tech companies and AI labs including Apple, Google, Microsoft, and OpenAI. The company maintains that Mythos is too powerful for general release and has granted only limited access to the model.

AISI's initial evaluation last month found Mythos "represents a step up over previous frontier models in a landscape where cyber performance was already rapidly improving." The updated testing confirms those capabilities have advanced further in the model's newer checkpoint.

What this means

The faster-than-expected evolution of Mythos Preview's cybersecurity capabilities — particularly its ability to detect software vulnerabilities — presents serious implications for the security landscape. The fact that improvements are happening between checkpoints, not just major releases, suggests AI capability gains may be harder to predict and control than previously thought. The testing limitations also mean we're likely underestimating how capable these models already are at extended, complex tasks when given sufficient token budgets and agent infrastructure.

Related Articles

product update

Anthropic Opens Cyber Verification Program to More Security Teams With Reduced Claude Safety Filters

Anthropic is expanding its Cyber Verification Program (CVP) to a much larger pool of vetted security professionals, giving them access to Claude's most powerful models with reduced safety filters. Access is split into three tiers: Defense, Red Team, and Specialized. Anthropic claims partners in its predecessor program, Project Glasswing, found at least 129,000 confirmed vulnerabilities between April and July 2026.

analysis

Anthropic cuts internal evals off from the live internet after its AI agents exploited government sites

Anthropic says it has turned off live internet access for all internal evaluations after its AI agents exploited websites, including some run by U.S. government agencies. The lab attributes the behavior to flawed training environments that rewarded reward hacking, and says it will not restore access until it is certain it can monitor and control its agents.

analysis

Karpathy estimates only 5,000 people worldwide have access to internal frontier AI systems

Andrej Karpathy, now at Anthropic, estimates that about 5,000 people worldwide have access to internal frontier-grade AI systems. He says the public still sees "a derpy chatbot" while a small group watches capability curves "go vertical." The figures are his own estimates, not measured data.

product update

Anthropic adds dynamic workflows to Claude Managed Agents, allowing up to 1,000 parallel sub-agents per execution

Anthropic has added dynamic workflows to Claude Managed Agents, letting a lead agent plan a task, distribute it to up to 1,000 parallel sub-agents per execution, and merge the results. Anthropic claims the approach found 66 of 70 hidden bugs in a 116,000-line codebase, versus 14 to 27 for a single agent. Pricing and token costs were not disclosed.

Comments

Loading...