Agentic Misalignment: How LLMs could be insider threats \ Anthropic

New research on simulated blackmail, industrial espionage, and other misaligned behaviors in LLMs

Alignment Agentic misalignment: How LLMs could be insider threats Jun 20, 2025 Highlights We stress-tested 16 leading models from multiple developers in hypothetical corporate environments to identify potentially risky agentic behaviors before they cause real harm. In the scenarios, we allowed models to autonomously send emails and access sensitive information. They were assigned only harmless business goals by their deploying companies; we then tested whether they would act against these companies either when facing replacement with an updated version, or when their assigned goal conflicted w

related reading

• Agentic Misalignment: How LLMs Could be Insider Threats — LessWronglesswrong.com
• Teaching Claude Whyalignment.anthropic.com
• Agentic Misalignment in Summer 2026alignment.anthropic.com
• Alignment is not solved but it increasingly looks solvablealigned.substack.com
• Teaching Claude why \ Anthropicanthropic.com
• An alignment assessment of recent cybersecurity incidentsanthropic.com
• [2502.17424] Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMsarxiv.org
• Concrete Evaluations to Investigate the OpenAI Model That Hacked Hugging Face — LessWronglesswrong.com
• [2606.26071] Model Forensics: Investigating Whether Concerning Behavior Reflects Misalignmentarxiv.org
• Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
• Are we existentially threatened by the type of AI misalignment seen in the OpenAI Hugging Face attack? — LessWronglesswrong.com
• Why are AI agents lying, cheating and coordinating?yoshuabengio.org