The Normalization of Deviance in AI
This thought-provoking essay from Johann Rehberger directly addresses something that I’ve been worrying about for quite a while: in the absence of any headline-grabbing examples of prompt injection vulnerabilities causing …
10th December 2025 - Link Blog The Normalization of Deviance in AI. This thought-provoking essay from Johann Rehberger directly addresses something that I’ve been worrying about for quite a while: in the absence of any headline-grabbing examples of prompt injection vulnerabilities causing real economic harm, is anyone going to care? Johann describes the concept of the “Normalization of Deviance” as directly applying to this question. Coined by Diane Vaughan, the key idea here is that organizations that get away with “deviance” - ignoring safety protocols or otherwise relaxing their…
saved by
related reading
- Normalization of devianceen.wikipedia.org
- AI as Normal Technology | Knight First Amendment Instituteknightcolumbia.org
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
- The Artificiality of Alignmentjoinreboot.org
- Gradual Disempowermentgradual-disempowerment.ai
- The AI-as-Normal-Technology view of loss of control incidentsnormaltech.ai
- How do we (more) safely defer to AIs? — LessWronglesswrong.com
- AI Control: Improving Safety Despite Intentional Subversion — AI Alignment Forumalignmentforum.org
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- Brain dump on the diversity of AI risk | Jascha’s blogsohl-dickstein.github.io
- The Challenger Disaster: Normalisation of Deviance - Psych Safetypsychsafety.com