What Multipolar Failure Looks Like, and Robust Agent-Agnostic Processes (RAAPs) - LessWrong

This post tells a few different stories in which humanity dies out as a result of AI technology, but where no single source of human or automated age…

x What Multipolar Failure Looks Like, and Robust Agent-Agnostic Processes (RAAPs) — LessWrong Best of LessWrong 2021 Multipolar Scenarios Threat Models (AI) Moloch Coordination / Cooperation Existential risk AI Risk Concrete Stories High Reliability Organizations AI Curated 299 What Multipolar Failure Looks Like, and Robust Agent-Agnostic Processes (RAAPs) by Andrew_Critch 31st Mar 2021 AI Alignment Forum 26 min read 65 299 Ω 96 With: Thomas Krendl Gilbert, who provided comments, interdisciplinary feedback, and input on the RAAP concept. Thanks also for comments from Ramana Kumar. Target audie

related reading

• What failure looks like — LessWronglesswrong.com
• What failure looks like — AI Alignment Forumalignmentforum.org
• Gradual Disempowermentgradual-disempowerment.ai
• Another (outer) alignment failure story — AI Alignment Forumalignmentforum.org
• A History of the Future, 2025-2040 — LessWronglesswrong.com
• Why multi-agent safety is important — LessWronglesswrong.com
• Gradual Paths to Collective Flourishing — LessWronglesswrong.com
• The Case Against AI Control Research — LessWronglesswrong.com
• ⿻ Symbiogenesis vs. Convergent Consequentialism — LessWronglesswrong.com
• The Problem — LessWronglesswrong.com
• What Failure Looks Like: Distilling the Discussion — LessWronglesswrong.com
• Plans A, B, C, and D for misalignment risk — LessWronglesswrong.com