flâneur — a map of the web's best reading

How we could stumble into AI catastrophe

cold-takes.com · 9,447 words · saved by 1 readers

This post will lay out a couple of stylized stories about how, if transformative AI is developed relatively soon, this could result in global catastrophe. (By “transformative AI,” I mean AI powerful and capable enough to bring about the sort of world-changing consequences I write about in my most important century series.) This piece is more about visualizing possibilities than about providing arguments. For the latter, I recommend the rest of this series. In the stories I’ll be telling, the world doesn't do much advance preparation or careful consideration of risks I’ve discussed previously, especially re: misaligned AI (AI forming dangerous goals of its own). After laying these catastrophic possibilities, I’ll briefly note a few key ways we could do better, mostly as a reminder (these topics were covered in previous posts). Future pieces will get more specific about what we can be doing today to prepare. This piece takes a lot of previous writing I’ve done as backdrop. Two key import

Click lower right to download or find on Apple Podcasts, Spotify, Stitcher, etc. This post will lay out a couple of stylized stories about how, if transformative AI is developed relatively soon, this could result in global catastrophe. (By “transformative AI,” I mean AI powerful and capable enough to bring about the sort of world-changing consequences I write about in my most important century series.) This piece is more about visualizing possibilities than about providing arguments. For the latter, I recommend the rest of this series . In the stories I’ll be telling, the world doesn't do much

Explore this link on the map →

related reading