The importance of AI character
Forethought argues that AI character—e.g. how obedient, honest, or altruistic AI systems are—will shape power, conflict, and society far more than is recognized. Work to shape AI character could be hugely impactful.
The importance of AI character William MacAskill Tom Davidson Citations Cite Citations PDF Contact 23rd March 2026 The importance of AI character 0. Intro 1. The core argument 1.1. Pathways to impact 1.2. Affecting takeover 1.3. Effects on superintelligence 2. The core counterargument 3. Rejoinders to the core counterargument 3.1. Loose constraints 3.2. Low-cost but high-benefit changes 3.3. Path-dependence 3.4. Smoothing the transition 3.5. Overall 4. Conclusion Appendix 1: Additional high-stakes scenarios Appendix 2: Pathways to impact [AI Narration] The importance of AI character Playback s
Explore this link on the map →saved by
related reading
- AIs Should Have Proactive Prosocial Drivesforethought.org
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- AI for Decision Adviceforethought.org
- What failure looks like — LessWronglesswrong.com
- By default, capital will matter more than ever after AGI — LessWronglesswrong.com
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- AI-Enabled Coups: How a Small Group Could Use AI to Seize Powerforethought.org
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- Intrinsic Power-Seeking: AI Might Seek Power for Power’s Saketurntrout.com
- AI #87: Staying in Character - by Zvi Mowshowitzthezvi.substack.com
- Sense-making about extreme power concentration — LessWronglesswrong.com
- Brain dump on the diversity of AI risk | Jascha’s blogsohl-dickstein.github.io