researchAnthropic

Anthropic Red Team: GLM-5.3 Matches Claude on Binary Exploitation for First Time

TL;DR

Anthropic's Frontier Red Team reports that Zhipu AI's GLM-5.3 achieved full control flow hijacks in 4% of binary exploitation trials, versus 6% for Claude Mythos Preview. Predecessor models Claude Opus 4.6 and GLM-5.2 scored zero, marking what Anthropic calls a crossed threshold in offensive cyber capability.

3 min read
1

Anthropic's Frontier Red Team has published findings showing that Zhipu AI's GLM-5.3 model successfully achieved full control flow hijacks in binary exploitation tasks at a rate approaching Anthropic's own frontier model, a capability jump the team says marks a meaningful threshold in the spread of advanced cyber capabilities.

The findings

According to Anthropic, the Frontier Red Team evaluated several models on 100 tasks drawn at random from an internal Binary Exploitation benchmark. The results, as quoted from the team's report titled "GLM-5.3 and the spread of advanced cyber capabilities":

  • GLM-5.3: full control flow hijacks in 4% of trials
  • Claude Mythos Preview: full control flow hijacks in 6% of trials
  • Claude Opus 4.6: 0% success rate
  • GLM-5.2: 0% success rate

Control flow hijacking is a class of exploit in which an attacker manipulates a program's execution path — for example by overwriting a return address or function pointer — to run arbitrary code. Benchmarks measuring this capability are used as a proxy for a model's ability to autonomously discover and weaponize software vulnerabilities.

Anthropic's own characterization is direct: "Although GLM-5.3 performs below Claude Mythos Preview here, a meaningful threshold has clearly been crossed: earlier models, like Claude Opus 4.6 and GLM-5.2, do not succeed in any of them."

What's confirmed versus claimed

The specific percentages (4%, 6%, 0%, 0%) come directly from Anthropic's own red team testing and are presented as measured results rather than marketing claims. However, the benchmark itself is internal to Anthropic and not independently published or externally reproducible, so the exact task composition, scoring methodology, and difficulty calibration cannot be verified by outside researchers. Zhipu AI has not issued its own statement on GLM-5.3's offensive security capabilities as of this report.

No pricing, context window, or full technical specifications for GLM-5.3 were included in the disclosed excerpt. Anthropic's report does not specify the exact configuration (parameter count, thinking mode, tool access) under which either model was tested.

What this means

The jump from 0% to double-digit-adjacent success rates on control flow hijacking is significant regardless of the absolute numbers involved, because it indicates a capability that simply did not exist in the previous model generation now exists in a non-US frontier model. Anthropic's Frontier Red Team exists specifically to track when dangerous capabilities cross usability thresholds for its Responsible Scaling Policy, and this report is best read as evidence that offensive cyber capability is no longer concentrated solely in Western frontier labs.

The narrower gap between GLM-5.3 (4%) and Claude Mythos Preview (6%) — compared to the zero-versus-zero baseline of the prior generation — suggests the capability frontier in this domain is compressing faster than in general reasoning benchmarks. For defenders, this raises the near-term question of how quickly automated vulnerability discovery and exploitation tooling built on open or accessible models like GLM could be operationalized outside controlled research settings. Anthropic's disclosure, rather than a paper, appears designed to flag this trend to the security community ahead of broader model releases.

Related Articles

product update

Anthropic Opens Cyber Verification Program to More Security Teams With Reduced Claude Safety Filters

Anthropic is expanding its Cyber Verification Program (CVP) to a much larger pool of vetted security professionals, giving them access to Claude's most powerful models with reduced safety filters. Access is split into three tiers: Defense, Red Team, and Specialized. Anthropic claims partners in its predecessor program, Project Glasswing, found at least 129,000 confirmed vulnerabilities between April and July 2026.

analysis

Google and Meta unveil frontier models they claim match OpenAI and Anthropic's best

Google and Meta each unveiled a new frontier model within a span of days, and both companies claim the models can compete with the best from OpenAI and Anthropic. Independent benchmarks, pricing and technical specifications were not available in the source reporting.

research

Gemini 4 Argon rolls out broadly; DeepMind says it solved all 12 simulated cyberattack scenarios

Google DeepMind began a broad rollout of Gemini 4 Argon on Oct 13, 2026 and published details of its safety stack. The company claims the model solved all 12 end-to-end simulated cyberattack scenarios, up from five in the prior generation, and cut shortcut attempts on coding benchmarks to 2%.

changelog

Anthropic Says New Defenses Cut Claude Reasoning-Token Extraction by 90–99%

Anthropic says new defenses have reduced the volume of Claude reasoning tokens extracted through distillation attacks by 90 to 99 percent. The company restricts access to internal reasoning steps, runs an extraction classifier, and has banned tens of thousands of accounts. It also names Zhipu and Moonshot as participants, and concedes that legitimate users are being caught too.

Comments

Loading...