Sense-making about extreme power concentration — LessWrong

Various people are worried about AI causing extreme power concentration of some form, for example via: …

x Sense-making about extreme power concentration — LessWrong AI Frontpage 72 Sense-making about extreme power concentration by rosehadshar 11th Sep 2025 4 min read 25 72 Various people are worried about AI causing extreme power concentration of some form, for example via: Powergrabs The intelligence curse Gradual disempowerment I have been talking to some of these people and trying to sense-make about ‘power concentration’. These are some notes on that, mostly prompted by some comment exchanges with Nora Ammann (in the below I’m riffing on her ideas but not representing her views). Sharing bec

saved by

• Andy Wang

related reading

• Why AIs aren't power-seeking yet — LessWronglesswrong.com
• Gradual Disempowermentgradual-disempowerment.ai
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• What failure looks like — LessWronglesswrong.com
• The Case Against AI Control Research — LessWronglesswrong.com
• The Risk of Gradual Disempowerment from AIthezvi.substack.com
• Some thoughts on risks from narrow, non-agentic AI — LessWronglesswrong.com
• Without specific countermeasures, the easiest path to transformative AI likely leads to AI takeover — LessWronglesswrong.com
• Brain dump on the diversity of AI risk | Jascha’s blogsohl-dickstein.github.io
• [2206.13353] Is Power-Seeking AI an Existential Risk?arxiv.org
• The Intelligence Curse — LessWronglesswrong.com
• Breaking the Intelligence Curse - The Intelligence Curseintelligence-curse.ai