ARC-AGI-3

6 articles tagged with ARC-AGI-3

October 16, 2026

Gemini 4 Argon scores 97.5% on ARC-AGI-3 with vendor features, but only 49.8% in the standard harness

Google DeepMind's Gemini 4 Argon scored 97.5% on ARC-AGI-3 at a cost of $4,800 using the Provider Adapter Harness, according to ARC Prize. Under the Standard Harness it falls to 49.8%, and Epoch AI places it eighth on its Math ECI and sixth on its SWE ECI.

September 17, 2026
model releaseOpenAI

OpenAI's GPT-6 Astra Beats Pokémon in 18 Hours, Scores 62.7% on ARC-AGI-3

GPT-6 Astra completed Pokémon FireRed in 18 hours 12 minutes, five times faster than its predecessor, and scored 62.7% on ARC-AGI-3 versus 7.78% for GPT-5.6 Sol. The model also ran a 141-hour Minecraft session and finished Fallout 3 in roughly 59 hours, according to independent testers.

September 3, 2026
model releaseOpenAI

OpenAI's GPT-6 Astra Reportedly Automates AI Engineering Tasks at Under $6 an Hour, According to Latent Space Testing

A Latent Space report describes GPT-6 Astra, a new OpenAI model the blog says can autonomously handle AI engineering tasks—training models, labeling data, deploying systems—at an estimated cost of under $6 per hour. The claims, including 97.6% on FrontierMath and 99.9% on ARC-AGI-3, come from independent blog testing rather than an official OpenAI announcement.

August 21, 2026
researchNVIDIA

Nvidia Research: Custom Harness Pushes Claude Opus 5 from 30% to 100% on ARC-AGI-3

Nvidia researchers report that a custom agent harness with a supervisory component drove Claude Opus 5 from a 30% baseline score to a perfect 100% on the ARC-AGI-3 benchmark. The findings add to mounting evidence that scaffolding, not the underlying model, is the dominant factor in long-horizon agentic performance.

July 30, 2026
benchmarkOpenAI+1

OpenAI Says GPT-5.6 Sol Scores 38.3% on ARC-AGI-3, Beating Claude Opus 5 — But Only With a Custom Harness

OpenAI says GPT-5.6 Sol scores 38.3 percent on ARC-AGI-3 using a custom Responses API configuration, edging out Claude Opus 5's 30.2 percent. Under the official benchmark harness, GPT-5.6 Sol's score drops to 7.8 percent, raising questions about what the comparison actually measures.

July 26, 2026
benchmarkAnthropic

Claude Opus 5 Scores 30.2% on ARC-AGI-3, Nearly 4x the Previous Record

Claude Opus 5 scored 30.2 percent on the ARC-AGI-3 benchmark, nearly four times the previous record of 7.8 percent set by OpenAI's GPT-5.6 Sol (Max). The ARC Prize team attributes the leap to genuinely stronger reasoning, though an independent test on a separate puzzle benchmark showed far smaller improvements.