Machine intelligence, part 1 - Sam Altman
This is going to be a two-part post—one on why machine intelligence is something we should be afraid of, and one on what we should do about it. If you’re already afraid of machine intelligence, you can skip this one and read the second post tomorrow—I was planning to only write part 2, but when I asked a few people to read drafts it became clear I needed part 1. WHY YOU SHOULD FEAR MACHINE INTELLIGENCE Development of superhuman machine intelligence (SMI) [1] is probably the greatest threat to the continued existence of humanity. There are other threats that I think are more certain to happen (for example, an engineered virus with a long incubation period and a high mortality rate) but are unlikely to destroy every human in the universe in the way that SMI could. Also, most of these other big threats are already widely feared. It is extremely hard to put a timeframe on when this will happen (more on this later), and it certainly feels to most people working in the field that it’s sti
This is going to be a two-part post—one on why machine intelligence is something we should be afraid of, and one on what we should do about it. If you’re already afraid of machine intelligence, you can skip this one and read the second post tomorrow—I was planning to only write part 2, but when I asked a few people to read drafts it became clear I needed part 1. WHY YOU SHOULD FEAR MACHINE INTELLIGENCE Development of superhuman machine intelligence (SMI) [1] is probably the greatest threat to the continued existence of humanity. There are other threats that I think are more certain to happen (
Explore this link on the map →related reading
- The Artificial Intelligence Revolution: Part 1 - Wait But Whywaitbutwhy.com
- The Artificial Intelligence Revolution: Part 2 - Wait But Whywaitbutwhy.com
- Four Background Claims - Machine Intelligence Research Instituteintelligence.org
- The Gentle Singularity - Sam Altmanblog.samaltman.com
- Superintelligence: The Idea That Eats Smart Peopleidlewords.com
- The Coming Technological Singularityedoras.sdsu.edu
- Unfalsifiable stories of doom | Mechanize, Inc.mechanize.work
- What is artificial intelligence? Your AI questions, answered. | Voxvox.com
- dreamofmachin.es/machine_prophecy.htmldreamofmachin.es
- Notes on Existential Risk from Artificial Superintelligencemichaelnotebook.com
- Edge.orgedge.org
- Don't Fear the Terminator | Scientific Americanblogs.scientificamerican.com