[2401.05566] Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack
[2401.05566] Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training --> Computer Science > Cryptography and Security arXiv:2401.05566 (cs) [Submitted on 10 Jan 2024 ( v1 ), last revised 17 Jan 2024 (this version, v3)] Title: Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training Authors: Evan Hubinger , Carson Denison , Jesse Mu , Mike Lambert , Meg Tong , Monte MacDiarmid , Tamera Lanham , Daniel M. Ziegler , Tim Maxwell , Newton Cheng , Adam Jermyn , Amanda Askell , Ansh Radhakrishnan , Cem Anil , David Duvenaud , Deep Ganguli , Fazl Barez , Jack C
saved by
related reading
- [2503.10965] Auditing language models for hidden objectivesarxiv.org
- [2512.11949] Neural Chameleons: Language Models Can Learn to Hide Their Thoughts from Unseen Activation Monitorsarxiv.org
- Agentic Misalignment in Summer 2026alignment.anthropic.com
- [2406.11717] Refusal in Language Models Is Mediated by a Single Directionarxiv.org
- 2401.05566.pdfarxiv.org
- [2312.06942] AI Control: Improving Safety Despite Intentional Subversionarxiv.org
- [2512.18552] Toward Training Superintelligent Software Agents through Self-Play SWE-RLarxiv.org
- [2502.14143] Multi-Agent Risks from Advanced AIarxiv.org
- [2407.15549] Latent Adversarial Training Improves Robustness to Persistent Harmful Behaviors in LLMsarxiv.org
- [2602.15515] The Obfuscation Atlas: Mapping Where Honesty Emerges in RLVR with Deception Probesarxiv.org
- [2502.05209] Model Tampering Attacks Enable More Rigorous Evaluations of LLM Capabilitiesarxiv.org
- [2401.05654] Towards Conversational Diagnostic AIarxiv.org