benchmark

Cogent's VR-1.1 Passes Repairs on 57.9% of LiveCVEBench Tasks, Versus 45.3% for Claude Code and Codex

TL;DR

Cogent Security introduced VR-1.1 on November 3, 2026, reporting passing repairs for 57.9% of LiveCVEBench's 190 tasks. Claude Code and Codex each scored 45.3% in the same evaluation, according to Cogent.

1 min read
0

Cogent Security introduced VR-1.1 on November 3, 2026, reporting that the vulnerability-repair model produced passing repairs for 57.9% of LiveCVEBench's 190 tasks. Claude Code and Codex each reached 45.3% in the same comparison, according to Cogent. The details below come from a summary published by Unite.AI.

What Cogent reports

VR-1.1 is the latest addition to Cogent's VR family and extends the remediation capabilities introduced with VR-1. Cogent's evaluation compared VR-1.1 against two coding-agent setups:

  • Claude Code running Claude Opus 5.5
  • Codex running GPT-5.6-Cyber

According to Cogent, each system received the same inputs and setup, and each had three attempts per task.

Results

System Passing repairs on LiveCVEBench (190 tasks)
Cogent VR-1.1 57.9%
Claude Code (Claude Opus 5.5) 45.3%
Codex (GPT-5.6-Cyber) 45.3%

These figures are reported by Cogent and come from its own evaluation. Context window, pricing, parameter count and training cutoff for VR-1.1 are not stated in the summary.

What this means

The comparison pits a dedicated vulnerability-repair model against general coding agents built on two other vendors' models, one of which is the security-oriented GPT-5.6-Cyber. Cogent says all systems got identical inputs, setup and three attempts per task, which is the condition that makes the head-to-head numbers comparable. The results are Cogent's own, so readers evaluating VR-1.1 for remediation work should weigh them as vendor-reported until the full methodology and task-level results can be examined.

Source: unite.ai ↗

Related Articles

benchmark

Swapping coding-agent harnesses moves SWE-bench scores about as much as a rerun, but costs can triple, study finds

Two Shandong University researchers held the model constant and swapped coding-agent harnesses. Pass rates on SWE-bench Verified changed about as much as a plain rerun, while per-task cost varied by up to three times. The paper is titled "What does a harness buy? Mostly tokens."

benchmark

IBM's CUGA harness passes 81.1% of AppWorld tasks on GLM-5.3-flash; Hermes 46.7%, Deep Agents 30.0%

IBM Research held the model constant (open-weight GLM-5.3-flash) and varied only the agent harness on 90 AppWorld tasks. CUGA, IBM's own open-source harness, passed 81.1% of tasks, against 46.7% for Hermes and 30.0% for Deep Agents.

benchmark

OpenAI publishes LifeVal, an evaluation built partly from a 3,995-respondent survey to test AI on everyday tasks

OpenAI published LifeVal on November 2, 2026, an evaluation built partly from a 3,995-respondent survey. It tracks AI model performance over time on practical tasks such as finding childcare, creating budgets and ordering groceries.

benchmark

Gemini 4 Carbon ranks second on SemiAnalysis GDPx at just over $16 per task, behind Claude Opus 5.5

SemiAnalysis's new GDPx benchmark places Google's Gemini 4 Carbon just behind Anthropic's Claude Opus 5.5, at just over $16 per task against about $51. Removing the cybersecurity, biology and alignment domains reshuffles the leaderboard.

Comments

Loading...