mini-SWE-agent
1 article tagged with mini-SWE-agent
October 24, 2026
benchmarkAnthropic
Swapping coding-agent harnesses moves SWE-bench scores about as much as a rerun, but costs can triple, study finds
Two Shandong University researchers held the model constant and swapped coding-agent harnesses. Pass rates on SWE-bench Verified changed about as much as a plain rerun, while per-task cost varied by up to three times. The paper is titled "What does a harness buy? Mostly tokens."