AI as orderly evacuation vs stampede - by Richard Ngo
mindthefuture.info · 1,545 words · saved by 2 readers
Building intuitions for how to coordinate against panic
tl;dr: A good analogy for AI going well is an orderly evacuation rather than a stampede. Imagine a crowd of people leaving a building. If they all walk calmly, they’ll be fine. But if people start pushing, and panicking, a surge towards the exit could lead to mass casualties. “Alignment is hard” is analogous to “the door is wedged shut”. If so you need enough time to fix it before anyone can get out. But even if alignment is relatively easy in principle, opening the door is much harder when a crowd is trying to force its way through. At the very least, I consider this a useful complement…
saved by
related reading
- Predictable updating about AI riskjoecarlsmith.com
- What failure looks like — AI Alignment Forumalignmentforum.org
- What failure looks like — LessWronglesswrong.com
- Gradual Paths to Collective Flourishing — LessWronglesswrong.com
- AI Safety Seems Hard to Measurecold-takes.com
- AI as Normal Technology | Knight First Amendment Instituteknightcolumbia.org
- How do we (more) safely defer to AIs? — LessWronglesswrong.com
- Dario Amodei — Policy on the AI Exponentialdarioamodei.com
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Racing through a minefield: the AI deployment problemcold-takes.com
- The Artificiality of Alignmentjoinreboot.org
- Preparing for the Intelligence Explosionforethought.org