Gradual Disempowerment

Gradual Disempowerment

Systemic Existential Risks from Incremental AI Development Jan Kulveit * , Raymond Douglas * , Nora Ammann , Deger Turan , David Krueger , David Duvenaud † Full version on arXiv AI risk scenarios usually portray a relatively sudden loss of human control to AIs, outmaneuvering individual humans and human institutions, due to a sudden increase in AI capabilities, or a coordinated betrayal. However, we argue that even an incremental increase in AI capabilities, without any coordinated power-seeking, poses a substantial risk of eventual human disempowerment. This loss of human influence will be ce

saved by

• Elizabeth Qiu
• Ratan Kaliani
• Yixiong Hao
• Uzay Girit
• Lydia Nottingham
• Jirat C
• Kenneth Sun
• Sidhant Chaliha
• Jess D
• Bhagyesh Kumar
• Seth Lifland

related reading

• Gradual Disempowerment: Systemic Existential Risks from Incremental AI Developmentarxiv.org
• Gradual disempowerment | 80,000 Hours80000hours.org
• The Risk of Gradual Disempowerment from AIthezvi.substack.com
• Gradual Empowerment? - Marginal REVOLUTIONmarginalrevolution.com
• Gradual Disempowermentgradual-disempowerment.ai
• Gradual Disempowermentgradual-disempowerment.ai
• What failure looks like — LessWronglesswrong.com
• The Risk of Gradual Disempowerment from AIthezvi.substack.com
• Gradual Disempowermentgradual-disempowerment.ai
• [Literature Review] Gradual Disempowerment: Systemic Existential Risks from Incremental AI Developmentthemoonlight.io
• Gradual Disempowermentgradual-disempowerment.ai
• Gradual Disempowermentgradual-disempowerment.ai