flâneur — a map of the web's best reading

Gradual disempowerment - 80,000 Hours

80000hours.org · 2,061 words · saved by 1 readers

The proliferation of advanced AI systems may lead to the gradual disempowerment of humanity, even if efforts to prevent them from becoming power-seeking or scheming are successful. Humanity may be incentivised to hand over increasing amounts of control to AIs, giving them power over the economy, politics, culture, and more. Over time, humanity’s interests may be sidelined and our control over the future undermined, potentially constituting an existential catastrophe. There’s disagreement over how serious a problem this is and how it relates to other concerns about AI alignment. It’s also unclear, if this is a genuine risk, what we could do about it. But we think it’s potentially very important, and more people should work on clarifying the issue and perhaps figuring out how to address it. Exploratory This is one of many profiles we've written to help people find the most pressing problems they can solve with their careers. Learn more about how we compare different problems and see how

Gradual disempowerment | 80,000 Hours Search for: On this page: Introduction 1 Why might gradual disempowerment be an especially pressing problem? 2 How pressing is this issue? 3 What are the arguments against this being a pressing problem? 4 What can you do to help? 4.1 Key organisations in this space 5 Learn more By Eran Raznik CC BY-SA 4.0 Summary The proliferation of advanced AI systems may lead to the gradual disempowerment of humanity, even if efforts to prevent them from becoming power-seeking or scheming are successful. Humanity may be incentivised to hand over increasing amounts of co

Explore this link on the map →

saved by

related reading