Towards a scale-free theory of intelligent agency — AI Alignment Forum
alignmentforum.org · 9,248 words · saved by 2 readers
I recently left OpenAI to pursue independent research. I’m working on a number of different research directions, but the most fundamental is my pursu…
x Towards a scale-free theory of intelligent agency — AI Alignment Forum Understanding systematization AI Frontpage 2025 Top Fifty: 14 % 39 Towards a scale-free theory of intelligent agency by Richard_Ngo 21st Mar 2025 Linkpost for www.mindthefuture.info 16 min read 51 39 I recently left OpenAI to pursue independent research. I’m working on a number of different research directions, but the most fundamental is my pursuit of a scale-free theory of intelligent agency. In this post I give a rough sketch of how I’m thinking about that. I’m erring on the side of sharing half-formed ideas, so there
saved by
related reading
- Towards a scale-free theory of intelligent agencymindthefuture.info
- Coasean Bargaining at Scaleblog.cosmos-institute.org
- The Case Against AI Control Research — LessWronglesswrong.com
- Embedded Agency (full-text version) — LessWronglesswrong.com
- Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
- Approval-directed agency and the decision theory of Newcomb-like problemslink.springer.com
- The Planlesswrong.com
- How Can Interpretability Researchers Help AGI Go Well? — AI Alignment Forumalignmentforum.org
- After Orthogonality: Virtue-Ethical Agency and AI Alignmentthegradient.pub
- Open-minded updatelessness — LessWronglesswrong.com
- The Universe from an Intentional Stancecasparoesterheld.com
- TechnicalAgenda.pdfintelligence.org