✳flâneur — a map of the web's best reading

Shtetl-Optimized » Blog Archive » “If Anyone Builds It, Everyone Dies”

scottaaronson.blog · 15,441 words · saved by 1 readers

Eliezer Yudkowsky and Nate Soares are publishing a mass-market book, the rather self-explanatorily-titled If Anyone Builds It, Everyone Dies. (Yes, the “it” means “sufficiently powerful AI.”) The book is now available for preorder from Amazon: (If you plan to buy the book at all, Eliezer and Nate ask that you do preorder it, as this will apparently increase the chance of it making the bestseller lists and becoming part of The Discourse.) I was graciously offered a chance to read a draft and offer, not a “review,” but some preliminary thoughts. So here they are: For decades, Eliezer has been warning the world that an AI might soon exceed human abilities, and proceed to kill everyone on earth, in pursuit of whatever strange goal it ended up with.  It would, Eliezer said, be something like what humans did to the earlier hominids.  Back around 2008, I followed the lead of most of my computer science colleagues, who considered these worries, even if possible in theory, comically premature g

Shtetl-Optimized >> Blog Archive >> &#8220;If Anyone Builds It, Everyone Dies&#8221; Shtetl-Optimized The Blog of Scott Aaronson If you take nothing else from this blog: quantum computers won't solve hard problems instantly by just trying all solutions in parallel. Also, please read Zvi Mowshowitz's masterpiece on how to fix K-12 education! --> << Cracking the Top Fifty! Guess I&#8217;m A Rationalist Now >> &#8220;If Anyone Builds It, Everyone Dies&#8221; Eliezer Yudkowsky and Nate Soares are publishing a mass-market book, the rather self-explanatorily-titled If Anyone Builds It, Everyone Dies

Explore this link on the map →

saved by

related reading