benchmarkAnthropic

Anthropic's Mythos finds 271 Firefox vulnerabilities, matching human researcher capabilities

TL;DR

Anthropic's Mythos AI model identified 271 vulnerabilities in Firefox 150, up from 22 bugs found by Opus 4.6 in Firefox 148. Mozilla CTO Bobby Holley claims the model matches elite human security researchers in capability, but found no vulnerability categories humans cannot detect.

2 min read
0

Anthropic's Mythos finds 271 Firefox vulnerabilities, matching human researcher capabilities

Anthropic's Mythos AI model identified 271 vulnerabilities in Firefox 150, according to Mozilla, marking a significant increase from the 22 bugs found by Anthropic's Opus 4.6 in Firefox 148.

Mozilla CTO Bobby Holley stated the results gave the Firefox team "vertigo" while acknowledging the finding represents a potential turning point for software security. "For a hardened target, just one such bug would have been red-alert in 2025, and so many at once makes you stop to wonder whether it's even possible to keep up," Holley wrote.

Model capabilities match human experts

According to Mozilla's assessment, Mythos matches the capabilities of elite security researchers. "We have many years of experience picking apart the work of the world's best security researchers, and Mythos Preview is every bit as capable," Holley wrote. "So far we've found no category or complexity of vulnerability that humans can find that this model can't."

Crucially, Holley emphasized that the model found no vulnerabilities beyond human detection capabilities: "We also haven't seen any bugs that couldn't have been found by an elite human researcher."

Implications for security economics

Holley argues the model shifts the security landscape by closing the gap between machine-discoverable and human-discoverable vulnerabilities. "Elite security researchers find bugs that fuzzers can't largely by reasoning through the source code," he explained. "This is effective, but time-consuming and bottlenecked on scarce human expertise."

The CTO disputed speculation that future AI models will discover entirely new vulnerability classes. "Software like Firefox is designed in a modular way for humans to be able to reason about its correctness. It is complex, but not arbitrarily complex," he stated. "The defects are finite, and we are entering a world where we can finally find them all."

Mozilla previously acknowledged using automated fuzzing tools for vulnerability detection, with Mythos representing an advancement in reasoning-based bug discovery that previously required human expertise.

What this means

Mythos demonstrates AI models can now perform vulnerability discovery at the level of expert security researchers, potentially democratizing access to elite-level code auditing. However, Mozilla's finding that the model discovered no bugs beyond human capability suggests current AI security tools amplify existing human methods rather than introduce fundamentally new approaches. The economic implications are significant: if vulnerability discovery becomes computationally cheap rather than requiring scarce human expertise, the attacker advantage of concentrated effort diminishes.

Related Articles

product update

Anthropic launches Reflect dashboard for Claude with usage tracking and break reminders

Anthropic released Reflect, a new dashboard inside Claude's settings that tracks usage patterns and helps users set limits on their chatbot interactions. The tool offers break reminders at 15, 30, or 45-minute intervals and allows users to block access during custom quiet hours on specific days.

changelog

Anthropic reverses course, makes Claude Fable 5 permanent on subscription plans

Anthropic announced July 18 that Claude Fable 5 will remain available on subscription plans, reversing its previous decision to make the model API-only. Max and Team Premium subscribers will receive access at 50% of standard limits starting July 20, while Pro and Team Standard users get a one-time $100 credit.

benchmark

Moonshot AI's Kimi K3 matches top US models at 40% lower cost, will be open-weight

Moonshot AI's Kimi K3 model has matched or exceeded performance of Anthropic's Opus 4.8 and OpenAI's GPT-5.6 Sol in independent benchmarks while costing 40% less than comparable US models. The Beijing-based company plans to release Kimi K3 as an open-weight model on July 27.

product update

Anthropic offers K-12 teachers free year of Claude Pro with educational tools through June 2027

Anthropic launched Claude for Teachers, offering K-12 educators in the United States free access to premium Claude features for one year. The program includes Claude Cowork, Claude Code, and education-focused skills developed with Learning Commons, with applications open until June 30, 2027.

Comments

Loading...