Towards a scale-free theory of intelligent agency — AI Alignment Forum
alignmentforum.org · 9,248 words · saved by 2 readers
I recently left OpenAI to pursue independent research. I’m working on a number of different research directions, but the most fundamental is my pursu…
x Towards a scale-free theory of intelligent agency — AI Alignment Forum Understanding systematization AI Frontpage 2025 Top Fifty: 14 % 39 Towards a scale-free theory of intelligent agency by Richard_Ngo 21st Mar 2025 Linkpost for www.mindthefuture.info 16 min read 51 39 I recently left OpenAI to pursue independent research. I’m working on a number of different research directions, but the most fundamental is my pursuit of a scale-free theory of intelligent agency. In this post I give a rough sketch of how I’m thinking about that. I’m erring on the side of sharing half-formed ideas, so there
saved by
related reading
- Towards a scale-free theory of intelligent agencymindthefuture.info
- Coasean Bargaining at Scaleblog.cosmos-institute.org
- The hot mess theory of AI misalignment: More intelligent agents behave less coherently | Jascha’s blogsohl-dickstein.github.io
- Embedded Agency (full-text version) — LessWronglesswrong.com
- Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
- [1902.09469] Embedded Agencyarxiv.org
- Patterns and problems in multiagent systemsanthropic.com
- Of Swarms and Sand Godsblog.cosmos-institute.org
- Optimality is the tiger, and agents are its teeth — LessWronglesswrong.com
- [2608.03958] A game theory for foundation models shows new paths to rational cooperation through similarity inferencearxiv.org
- TechnicalAgenda.pdfintelligence.org
- US presidents rate AI alignment agendasyoutube.com