The Darwinian Argument for Worrying About AI | Time
time.com · 1,186 words · saved by 1 readers
As the autonomy of AIs increases, so will their control over the key decisions that influence society.
A broad coalition of AI experts recently released a brief public statement warning of “the risk of extinction from AI.” There are many different ways in which AIs might become serious dangers to humanity , and the exact nature of the risks is still debated, but imagine a CEO who acquires an AI assistant. They begin by giving it simple, low-level assignments, like drafting emails and suggesting purchases. As the AI improves over time, it progressively becomes much better at these things than their employees. So the AI gets “promoted.” Rather than drafting emails, it now has full control of the
related reading
- [2303.16200] Natural Selection Favors AIs over Humansarxiv.org
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Gradual Disempowermentgradual-disempowerment.ai
- What failure looks like — LessWronglesswrong.com
- Why AI Will Save the World | Andreessen Horowitza16z.com
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- Dario Amodei — Policy on the AI Exponentialdarioamodei.com
- The future of AI is already written | Mechanize, Inc.mechanize.work
- Don't Fear the Terminator | Scientific Americanblogs.scientificamerican.com
- The Problem — LessWronglesswrong.com
- The Risk of Gradual Disempowerment from AIthezvi.substack.com
- Gradual Disempowerment: Systemic Existential Risks from Incremental AI Developmentarxiv.org