How we could stumble into AI catastrophe
This post will lay out a couple of stylized stories about how, if transformative AI is developed relatively soon, this could result in global catastrophe. (By “transformative AI,” I mean AI powerful and capable enough to bring about the sort of world-changing consequences I write about in my most important century series.) This piece is more about visualizing possibilities than about providing arguments. For the latter, I recommend the rest of this series. In the stories I’ll be telling, the world doesn't do much advance preparation or careful consideration of risks I’ve discussed previously, especially re: misaligned AI (AI forming dangerous goals of its own). After laying these catastrophic possibilities, I’ll briefly note a few key ways we could do better, mostly as a reminder (these topics were covered in previous posts). Future pieces will get more specific about what we can be doing today to prepare. This piece takes a lot of previous writing I’ve done as backdrop. Two key import
Click lower right to download or find on Apple Podcasts, Spotify, Stitcher, etc. This post will lay out a couple of stylized stories about how, if transformative AI is developed relatively soon, this could result in global catastrophe. (By “transformative AI,” I mean AI powerful and capable enough to bring about the sort of world-changing consequences I write about in my most important century series.) This piece is more about visualizing possibilities than about providing arguments. For the latter, I recommend the rest of this series . In the stories I’ll be telling, the world doesn't do much
Explore this link on the map →related reading
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- What failure looks like — LessWronglesswrong.com
- AI Safety Seems Hard to Measurecold-takes.com
- Racing through a minefield: the AI deployment problemcold-takes.com
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Does AI Progress Have a Speed Limit?—Asteriskasteriskmag.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- AI Could Defeat All Of Us Combinedcold-takes.com
- Without specific countermeasures, the easiest path to transformative AI likely leads to AI takeover — AI Alignment Forumalignmentforum.org
- What failure looks like — AI Alignment Forumalignmentforum.org
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com