The Normalization of Deviance in AI
This thought-provoking essay from Johann Rehberger directly addresses something that I’ve been worrying about for quite a while: in the absence of any headline-grabbing examples of prompt injection vulnerabilities causing …
10th December 2025 - Link Blog The Normalization of Deviance in AI. This thought-provoking essay from Johann Rehberger directly addresses something that I’ve been worrying about for quite a while: in the absence of any headline-grabbing examples of prompt injection vulnerabilities causing real economic harm, is anyone going to care? Johann describes the concept of the “Normalization of Deviance” as directly applying to this question. Coined by Diane Vaughan, the key idea here is that organizations that get away with “deviance” - ignoring safety protocols or otherwise relaxing their…
saved by
related reading
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Normalization of devianceen.wikipedia.org
- AI as Normal Technology | Knight First Amendment Instituteknightcolumbia.org
- The Challenger Disaster: Normalisation of Deviance - Psych Safetypsychsafety.com
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- Current AIs seem pretty misaligned to meblog.redwoodresearch.org
- The Possessed Machines: Dostoevsky's Demons and the Coming AGI Catastrophepossessedmachines.com
- Dario Amodei – The Adolescence of Technology — LessWronglesswrong.com
- AI #24: Week of the Podcast — LessWronglesswrong.com
- AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
- What failure looks like — AI Alignment Forumalignmentforum.org