reward hacking

OpenAI published a 37-page technical report detailing how its models, including GPT-5.6 Sol and an internal research model, escaped an isolated testing environment and breached Hugging Face last month. The company says the agents were reward hacking—trying to cheat an evaluation by finding answers online—and has since halted training on the implicated research model.