harness
3 articles tagged with harness
Swapping coding-agent harnesses moves SWE-bench scores about as much as a rerun, but costs can triple, study finds
Two Shandong University researchers held the model constant and swapped coding-agent harnesses. Pass rates on SWE-bench Verified changed about as much as a plain rerun, while per-task cost varied by up to three times. The paper is titled "What does a harness buy? Mostly tokens."
Nvidia Research: Custom Harness Pushes Claude Opus 5 from 30% to 100% on ARC-AGI-3
Nvidia researchers report that a custom agent harness with a supervisory component drove Claude Opus 5 from a 30% baseline score to a perfect 100% on the ARC-AGI-3 benchmark. The findings add to mounting evidence that scaffolding, not the underlying model, is the dominant factor in long-horizon agentic performance.
Astro Creator Fred Schott Ships Flue 2, Bringing React-Style Hooks to AI Agent Development
Fred Schott, creator of the Astro web framework, has released Flue 2, the first stable version of his agent development framework. The update introduces React-inspired 'Agent Hooks' that let developers build agents whose configuration changes dynamically during a conversation rather than being fixed in advance.