✳flâneur — a map of the web's best reading

Individual AI representatives don't solve Gradual Disempowerement — LessWrong

lesswrong.com · 1,710 words · saved by 1 readers

Imagine each of us has an AI representative, aligned to us, personally. Is gradual disempowerment solved?[1] In my view, no; at the same time having AI representatives helps at the margin. I have two deep reasons for skepticism.[2] Here is the first one. We, as individuals, are not the only agents or “agencies” in this world. Other goal-oriented strategic entities include states, corporations, and to some extent egregores. For the sake of argument, imagine the current distribution of agency in the world as approximately 60% humans, 20% corporations, 20% states (numbers are illustrative, egregores not included for simplicity) Now, suppose we introduce individually aligned AI assistants for each person. At first glance, this seems empowering—each individual gains a cognitive extension, potentially leveling the playing field. But: do corporations or states also get their representatives? If your answer is No, you'd need to explain how individuals gain AI power while states and corporation

x Individual AI representatives don't solve Gradual Disempowerement — LessWrong AI Frontpage 62 Individual AI representatives don't solve Gradual Disempowerement by Jan_Kulveit 4th Jun 2025 AI Alignment Forum 4 min read 4 62 Ω 32 Imagine each of us has an AI representative, aligned to us, personally. Is gradual disempowerment solved? [1] In my view, no; at the same time having AI representatives helps at the margin. I have two deep reasons for skepticism. [2] Here is the first one. Humans are Not Alone We, as individuals, are not the only agents or “agencies” in this world. Other goal-oriented

Explore this link on the map →

related reading