ProgramBench
1 article tagged with ProgramBench
November 7, 2026
benchmarkThinking Machines Lab
Vals AI finds 316 expletives in Thinking Machines' Inkling 2 Small reasoning logs across 2,655 benchmark runs
Vals AI analyzed the chain-of-thought logs of Thinking Machines' Inkling 2 Small across 2,655 runs on 13 benchmarks and found expletives in 50 runs, totaling 316 instances. Two runaway runs produced 241 of them, and swearing did not work as a reliable failure signal.