What failure looks like - LessWrong
Paul Christiano paints a vivid and disturbing picture of how AI could go wrong, not with sudden violent takeover, but through a gradual loss of human…
x What failure looks like — LessWrong Best of LessWrong 2019 AI Risk Threat Models (AI) AI Takeoff More Dakka AI World Modeling World Optimization Curated 466 What failure looks like by paulfchristiano 17th Mar 2019 AI Alignment Forum 10 min read 56 466 Ω 111 The stereotyped image of AI catastrophe is a powerful, malicious AI system that takes its creators by surprise and quickly achieves a decisive advantage over the rest of humanity. I think this is probably not what failure will look like, and I want to try to paint a more realistic picture. I’ll tell the story in two parts: Part I : machin
saved by
- Elizabeth Qiu
- Hangyul Lyna Kim
- Sarah Pan
- Samuel Ratnam
- Callistus
- Lydia Nottingham
- Timothy Kostolansky
- Raphael Mu
- Will Anderson
- Carolanne Jiang
- Mari M
- Dillon Nguyen
related reading
- What failure looks like — AI Alignment Forumalignmentforum.org
- Without specific countermeasures, the easiest path to transformative AI likely leads to AI takeover — LessWronglesswrong.com
- What Failure Looks Like: Distilling the Discussion — LessWronglesswrong.com
- Another (outer) alignment failure story — AI Alignment Forumalignmentforum.org
- The Case Against AI Control Research — LessWronglesswrong.com
- Where I agree and disagree with Eliezer — LessWronglesswrong.com
- AI Could Defeat All Of Us Combined — LessWronglesswrong.com
- The Artificial Intelligence Revolution: Part 2 - Wait But Whywaitbutwhy.com
- You will be OK — LessWronglesswrong.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- AI Safety Seems Hard to Measurecold-takes.com
- Alignment & Succession: The Two Bars of Alignmentnosetgauge.com