CUGA
1 article tagged with CUGA
November 3, 2026
benchmarkIBM
IBM's CUGA harness passes 81.1% of AppWorld tasks on GLM-5.3-flash; Hermes 46.7%, Deep Agents 30.0%
IBM Research held the model constant (open-weight GLM-5.3-flash) and varied only the agent harness on 90 AppWorld tasks. CUGA, IBM's own open-source harness, passed 81.1% of tasks, against 46.7% for Hermes and 30.0% for Deep Agents.