The Alignment Problem — LessWrong
Last month Eliezer Yudkowsky wrote "a poorly organized list of individual rants" about how AI is going to kill us all. In this post, I attempt to summarize the rants in my own words. These are not my personal opinions. This post is not the place for my personal opinions. Instead, this post is my attempt to write my understanding of Yudkowsky's opinions. I am much more optimistic about our future than Yudkowsky is. But that is not the topic of this post. Humanity is probably going to build an AGI, and soon. But if an AGI is going to kill us all can't we choose to just not build an AGI? Nope! If humanity had the coordination ability to "just not build an AGI because an AGI is an existential threat" then we wouldn't have built doomsday weapons whose intended purpose is to be an existential threat. The first nuclear weapon was a proof of concept. The second and third nuclear bombs were detonated on civilian targets. "Choosing not to build an AGI" is much, much harder than choosing not to b
x The Alignment Problem — LessWrong AI Risk AI Frontpage 47 The Alignment Problem by lsusr 11th Jul 2022 4 min read 18 47 Last month Eliezer Yudkowsky wrote "a poorly organized list of individual rants" about how AI is going to kill us all. In this post, I attempt to summarize the rants in my own words. These are not my personal opinions. This post is not the place for my personal opinions. Instead, this post is my attempt to write my understanding of Yudkowsky's opinions. I am much more optimistic about our future than Yudkowsky is. But that is not the topic of this post. Humanity is going to
Explore this link on the map →saved by
related reading
- AGI Ruin: A List of Lethalities — LessWronglesswrong.com
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Where I agree and disagree with Eliezer — LessWronglesswrong.com
- Ngo and Yudkowsky on alignment difficulty — LessWronglesswrong.com
- Yudkowsky on AGI risk on the Bankless podcast - Machine Intelligence Research Instituteintelligence.org
- Critical review of Christiano's disagreements with Yudkowsky — LessWronglesswrong.com
- Unfalsifiable stories of doom | Mechanize, Inc.mechanize.work
- The case against AI alignment — LessWronglesswrong.com
- AGI safety from first principles: Introduction — LessWronglesswrong.com
- Shah and Yudkowsky on alignment failures — LessWronglesswrong.com
- A positive case for how we might succeed at prosaic AI alignment — AI Alignment Forumalignmentforum.org