Gradual disempowerment - 80,000 Hours
The proliferation of advanced AI systems may lead to the gradual disempowerment of humanity, even if efforts to prevent them from becoming power-seeking or scheming are successful. Humanity may be incentivised to hand over increasing amounts of control to AIs, giving them power over the economy, politics, culture, and more. Over time, humanity’s interests may be sidelined and our control over the future undermined, potentially constituting an existential catastrophe. There’s disagreement over how serious a problem this is and how it relates to other concerns about AI alignment. It’s also unclear, if this is a genuine risk, what we could do about it. But we think it’s potentially very important, and more people should work on clarifying the issue and perhaps figuring out how to address it. Exploratory This is one of many profiles we've written to help people find the most pressing problems they can solve with their careers. Learn more about how we compare different problems and see how
Gradual disempowerment | 80,000 Hours Search for: On this page: Introduction 1 Why might gradual disempowerment be an especially pressing problem? 2 How pressing is this issue? 3 What are the arguments against this being a pressing problem? 4 What can you do to help? 4.1 Key organisations in this space 5 Learn more By Eran Raznik CC BY-SA 4.0 Summary The proliferation of advanced AI systems may lead to the gradual disempowerment of humanity, even if efforts to prevent them from becoming power-seeking or scheming are successful. Humanity may be incentivised to hand over increasing amounts of co
Explore this link on the map →saved by
related reading
- Gradual Disempowermentgradual-disempowerment.ai
- The Risk of Gradual Disempowerment from AIthezvi.substack.com
- Gradual Disempowermentgradual-disempowerment.ai
- Gradual Empowerment? - Marginal REVOLUTIONmarginalrevolution.com
- Gradual Disempowermentgradual-disempowerment.ai
- What failure looks like — LessWronglesswrong.com
- Gradual Disempowermentgradual-disempowerment.ai
- Gradual Disempowermentgradual-disempowerment.ai
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- [Literature Review] Gradual Disempowerment: Systemic Existential Risks from Incremental AI Developmentthemoonlight.io
- Gradual Disempowermentgradual-disempowerment.ai
- Why You Don’t Believe in Xhosa Prophecies — LessWronglesswrong.com