Cogent's VR-1.1 Passes Repairs on 57.9% of LiveCVEBench Tasks, Versus 45.3% for Claude Code and Codex
Cogent Security introduced VR-1.1 on November 3, 2026, reporting passing repairs for 57.9% of LiveCVEBench's 190 tasks. Claude Code and Codex each scored 45.3% in the same evaluation, according to Cogent.
Cogent Security introduced VR-1.1 on November 3, 2026, reporting that the vulnerability-repair model produced passing repairs for 57.9% of LiveCVEBench's 190 tasks. Claude Code and Codex each reached 45.3% in the same comparison, according to Cogent. The details below come from a summary published by Unite.AI.
What Cogent reports
VR-1.1 is the latest addition to Cogent's VR family and extends the remediation capabilities introduced with VR-1. Cogent's evaluation compared VR-1.1 against two coding-agent setups:
- Claude Code running Claude Opus 5.5
- Codex running GPT-5.6-Cyber
According to Cogent, each system received the same inputs and setup, and each had three attempts per task.
Results
| System | Passing repairs on LiveCVEBench (190 tasks) |
|---|---|
| Cogent VR-1.1 | 57.9% |
| Claude Code (Claude Opus 5.5) | 45.3% |
| Codex (GPT-5.6-Cyber) | 45.3% |
These figures are reported by Cogent and come from its own evaluation. Context window, pricing, parameter count and training cutoff for VR-1.1 are not stated in the summary.
What this means
The comparison pits a dedicated vulnerability-repair model against general coding agents built on two other vendors' models, one of which is the security-oriented GPT-5.6-Cyber. Cogent says all systems got identical inputs, setup and three attempts per task, which is the condition that makes the head-to-head numbers comparable. The results are Cogent's own, so readers evaluating VR-1.1 for remediation work should weigh them as vendor-reported until the full methodology and task-level results can be examined.
Related Articles
Swapping coding-agent harnesses moves SWE-bench scores about as much as a rerun, but costs can triple, study finds
Two Shandong University researchers held the model constant and swapped coding-agent harnesses. Pass rates on SWE-bench Verified changed about as much as a plain rerun, while per-task cost varied by up to three times. The paper is titled "What does a harness buy? Mostly tokens."
IBM's CUGA harness passes 81.1% of AppWorld tasks on GLM-5.3-flash; Hermes 46.7%, Deep Agents 30.0%
IBM Research held the model constant (open-weight GLM-5.3-flash) and varied only the agent harness on 90 AppWorld tasks. CUGA, IBM's own open-source harness, passed 81.1% of tasks, against 46.7% for Hermes and 30.0% for Deep Agents.
OpenAI publishes LifeVal, an evaluation built partly from a 3,995-respondent survey to test AI on everyday tasks
OpenAI published LifeVal on November 2, 2026, an evaluation built partly from a 3,995-respondent survey. It tracks AI model performance over time on practical tasks such as finding childcare, creating budgets and ordering groceries.
Gemini 4 Carbon ranks second on SemiAnalysis GDPx at just over $16 per task, behind Claude Opus 5.5
SemiAnalysis's new GDPx benchmark places Google's Gemini 4 Carbon just behind Anthropic's Claude Opus 5.5, at just over $16 per task against about $51. Removing the cybersecurity, biology and alignment domains reshuffles the leaderboard.
Comments
Loading...