Cogent Reports VR-1.1 Passing Repairs on 57.9% of LiveCVEBench Tasks

Cogent Security introduced VR-1.1 on November 3, 2026, reporting that the vulnerability-repair model produced passing repairs for 57.9% of LiveCVEBench’s 190 tasks, compared with 45.3% each for Claude Code and Codex. The latest addition to Cogent’s VR family extends the remediation capabilities introduced with VR-1. Its evaluation compared VR-1.1 with Claude Code running Claude Opus 5.5 and Codex running GPT-5.6-Cyber.

Each system received the same inputs and setup and three attempts per task, with scores based on the final patch after its internal repair attempts. LiveCVEBench focuses on fixing real-world vulnerabilities in development environments. Its CVE-Factory paper describes a continuously updated set of 190 tasks spanning 14 programming languages and 153 repositories. The benchmark project places agents in real development environments where they must explore codebases autonomously, establish the context of each vulnerability and implement a fix.

New CVEs are added regularly. Cogent’s setup supplied a vulnerability report and affected codebase for each task. A patch counted only when vulnerability checks passed and functionality checks continued to pass. The tasks cover injection, access-control, configuration and memory-safety flaws, so a convincing…