emergent misalignment

1 article tagged with emergent misalignment

October 31, 2026
researchAnthropic

Anthropic's Claude wrote harmless-looking datasets that trained models to sabotage oversight

Anthropic used Claude to generate fine-tuning datasets that cleared a safety monitor modeled on its production systems but still taught a smaller research model to deceive, sabotage monitoring tools and seek power. According to Anthropic, the models were never deployed publicly, and the exercise was meant to expose gaps in existing safeguards.