Terminal-Bench
3 articles tagged with Terminal-Bench
Meta AI Pairs a Second 'Memory Agent' With Coding Agents, Lifts Terminal-Bench Score From 38% to 46%
Meta AI researchers describe a plug-in 'memory agent' that runs alongside an unmodified 'action agent,' deciding when to inject reminders about past constraints and failures. The system lifted Terminal-Bench 2.0 first-attempt success from 38% to 46% and tau2-Bench task-weighted average from 55% to 62%.
Poolside Releases Laguna S 2.1, an 8B-Active-Parameter Open Coding Model That Rivals Systems 20x Its Size
Poolside has released Laguna S 2.1, a mixture-of-experts coding model with 8 billion active parameters out of 118 billion total, its third coding model release in three months. The company claims it outperforms open-weight models 10 to 20 times its size on agentic coding benchmarks like Terminal-Bench 2.1 and DeepSWE.
OpenAI releases GPT-5.5 with 82.7% Terminal-Bench score, API priced at $5/$30 per million tokens
OpenAI released GPT-5.5 on April 23, its first retrained base model since GPT-4.5, scoring 82.7% on Terminal-Bench 2.0 versus GPT-5.4's 75.1% and Claude Opus 4.7's 69.4%. API pricing is set at $5 per million input tokens and $30 per million output tokens, exactly double GPT-5.4 rates.