The AI-as-Normal-Technology view of loss of control incidents

A middle ground between the cybersecurity and AI safety communities

This essay is over 13,000 words long and represents our most substantial writing on AI safety since the original essay. Over the last few months, loss-of-control incidents at OpenAI and Anthropic have intensified concerns about AI safety. Warnings about existential risk have increasingly reached the broader public, alongside calls to slow AI development. Dario Amodei’s call to “pace the frontier” reflects the concern that safety efforts are not keeping up with AI capabilities. The most prominent example was the OpenAI - Hugging Face incident, where hundreds of OpenAI agents got access to…

saved by

• Kia Ghods

related reading

• AI as Normal Technology | Knight First Amendment Instituteknightcolumbia.org
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
• Are we existentially threatened by the type of AI misalignment seen in the OpenAI Hugging Face attack? — LessWronglesswrong.com
• AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
• The End-State Fallacy: Where Is AI Security Headed?endstatefallacy.com
• The Artificiality of Alignmentjoinreboot.org
• AI Control: Improving Safety Despite Intentional Subversion — AI Alignment Forumalignmentforum.org
• The Case Against AI Control Research — LessWronglesswrong.com
• The case for ensuring that powerful AIs are controlledblog.redwoodresearch.org
• Are we existentially threatened by the type of AI misalignment seen in the OpenAI Hugging Face attack?blog.redwoodresearch.org
• Misleading Metaphors, Real Risksaiguide.substack.com