SII
1 article tagged with SII
October 28, 2026
benchmarkReplit
Replit's ViBench 2.0: Top models pass every test plan in only 49-65% of full software builds
Replit released ViBench 2.0, a benchmark in which an agent builds a full software product feature by feature from an empty project. GPT-6.1 Sol leads with a 65% pass@1, followed by GPT-6 Astra at 60% and Opus 5.5 at 49%. No open-weight model passes a full build.