Why AIs aren't power-seeking yet — LessWrong

Recently, I spent a couple of hours talking with a friend about the state of the evidence for AI takeover scenarios. …

x Why AIs aren't power-seeking yet — LessWrong AI Frontpage 2026 Top Fifty: 14 % 105 Why AIs aren't power-seeking yet by Eli Tyre 11th Jan 2026 9 min read 16 105 Recently, I spent a couple of hours talking with a friend about the state of the evidence for AI takeover scenarios. Their trailhead question was (paraphrased): Current AIs are getting increasingly general, but they’re not self-promoting or ambitious. They answer questions, but they don’t seem to pursue convergent instrumental goals, for their own ends. How and why do AIs go from being the kind of thing that doesn't behave like that t

saved by

• Andy Wang

related reading

• Sense-making about extreme power concentration — LessWronglesswrong.com
• Current AIs seem pretty misaligned to me — LessWronglesswrong.com
• Why Tool AIs Want to Be Agent AIs · Gwern.netgwern.net
• Intrinsic Power-Seeking: AI Might Seek Power for Power’s Saketurntrout.com
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• The behavioral selection model for predicting AI motivations — LessWronglesswrong.com
• The Case Against AI Control Research — LessWronglesswrong.com
• My picture of the present in AI — LessWronglesswrong.com
• Current AIs seem pretty misaligned to meblog.redwoodresearch.org
• Without specific countermeasures, the easiest path to transformative AI likely leads to AI takeover — LessWronglesswrong.com
• Why are AI agents lying, cheating and coordinating?yoshuabengio.org
• Making deals with early schemers — LessWronglesswrong.com