Y'all are over-complicating these AI-risk arguments
Say an alien spaceship is headed for Earth. It has 30 aliens on it. The aliens are weak and small. They have no weapons and carry no diseases. They breed at rates similar to humans. They are bringing no new technology. No other ships are coming. There’s no trick—except that they each have an IQ of 300. Would you find that concerning? Of course, the aliens might be great. They might cure cancer and help us reach world peace and higher consciousness. But would you be sure they’d be great? Suppose you were worried about the aliens but I scoffed, “Tell me specifically how the aliens would hurt us. They’re small and weak! They can’t do anything unless we let them.” Would you find that counter-argument convincing? I claim that most people would be concerned about the arrival of the aliens, would not be sure that their arrival would be good, and would not find that counter-argument convincing. I bring this up because most AI-risk arguments I see go something like this: These arguments have al
dynomight · Oct 2025 · AI Say an alien spaceship is headed for Earth. It has 30 aliens on it. The aliens are weak and small. They have no weapons and carry no diseases. They breed at rates similar to humans. They are bringing no new technology. No other ships are coming. There’s no trick—except that they each have an IQ of 300. Would you find that concerning? Of course, the aliens might be great. They might cure cancer and help us reach world peace and higher consciousness. But would you be sure they’d be great? Suppose you were worried about the aliens but I scoffed, “Tell me specifically how
Explore this link on the map →related reading
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- You will be OK — LessWronglesswrong.com
- Where I agree and disagree with Eliezer — LessWronglesswrong.com
- Notes on Existential Risk from Artificial Superintelligencemichaelnotebook.com
- Superintelligence: The Idea That Eats Smart Peopleidlewords.com
- Notes on Existential Risk from Artificial Superintelligencemichaelnotebook.com
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Artificial General Intelligence and how (much) to worry about itstrangeloopcanon.com
- Unfalsifiable stories of doom | Mechanize, Inc.mechanize.work
- On Overconfidence | Slate Star Codexslatestarcodex.com
- Shtetl-Optimized >> Blog Archive >> Why am I not terrified of AI?scottaaronson.blog
- AI Safety for Fleshy Humans: a whirlwind touraisafety.dance