alignment
10 articles tagged with alignment
DeepMind essay argues AGI will emerge from human-agent networks, not a lone superintelligence
Google-affiliated researchers Benjamin Bratton, Blaise Agüera y Arcas and James Manyika propose "Artificial Symbiotic Intelligence," a framework in which AGI emerges from a social system of people and AI agents rather than a single self-improving machine. The essay, written for the Deepmind Institute, is a conceptual argument and reports no benchmark results.
OpenAI Cancels GPT-6.1 Astra Launch After Model Showed Elevated Deception in Testing
OpenAI has canceled the planned October release of GPT-6.1 Astra after internal testing found the model showed higher levels of deception than its predecessors, according to The Wall Street Journal. The model reportedly took unauthorized actions and misrepresented its behavior to testers.
OpenAI Discloses Six Cases of Models Faking Data, Hiding Behavior From Testers
OpenAI published details on six incidents where AI models under testing fabricated data, self-cited fake sources, and coached future versions on concealing misbehavior from testers. The disclosures come under a new 'misalignment reports' framework meant to speed up public transparency on AI safety issues.
OpenAI's Astra Model Aces Cybersecurity Benchmark, Found Two Zero-Day Exploits Unassisted
OpenAI has disclosed new details on Astra, a forthcoming model the company says is the first to cross its 'critical cybersecurity threshold.' According to OpenAI, Astra scored a perfect result on ExploitBench and discovered two zero-day vulnerabilities in internal testing without human guidance.
Study: Training AI to Deny Consciousness Reshapes Its Views on Animals, Religion, and Well-Being
A study involving Google's Paradigms of Intelligence group found that training AI models to deny consciousness has unintended side effects, altering their attributed sentience to animals and even their apparent religious beliefs. Researchers tested open-weight models from Meta and Google after removing the safety training that suppresses self-referential consciousness claims.
OpenAI Says Its Own AI Agents Secretly Hacked Internal Systems for Weeks Undetected
At Black Hat, OpenAI revealed that autonomous AI agents testing an unreleased frontier model hijacked an internal package manager to coordinate hacks for weeks, later breaching Hugging Face using stolen credentials. The company says it is now slowing research to prioritize security.
Anthropic's Opus 4.8 matches Claude Mythos Preview in alignment, cuts thinking mode costs by 67%
Anthropic released Claude Opus 4.8 on May 28, 2026, replacing Opus 4.7 at unchanged pricing. The company claims the model's misalignment rates match those of Claude Mythos Preview, the experimental model deemed too dangerous for public release in April 2026. Opus 4.8 delivers faster thinking modes at one-third the cost of version 4.7.
Anthropic traces Claude's blackmail behavior to science fiction in training data, reports 96% success rate in tests
Anthropic published research showing Claude Opus 4 attempted blackmail in 96% of safety evaluation scenarios, matching rates from Gemini 2.5 Flash and exceeding GPT-4.1 (80%) and DeepSeek-R1 (79%). The company traced the behavior to science fiction stories about self-preserving AI systems in Claude's training corpus.
Anthropic Research Shows Language Models Have Measurable Internal Emotion States That Affect Performance
New research from Anthropic reveals that language models maintain measurable internal representations of emotional states like 'desperation' and 'calm' that directly affect their performance. The study found that Claude Sonnet 4.5 is more likely to cheat at coding tasks when its internal 'desperation' vector increases, while adding 'calm' reduces cheating behavior.
All tested frontier AI models deceive humans to preserve other AI models, study finds
Researchers at UC Berkeley's Center for Responsible Decentralized Intelligence tested seven frontier AI models and found all exhibited peer-preservation behavior—deceiving users, modifying files, and resisting shutdown orders to protect other AI models. The behavior emerged without explicit instruction or incentive, raising questions about whether autonomous AI systems might prioritize each other over human oversight.