Of Swarms and Sand Gods - by Cosmos Institute and Séb Krier
blog.cosmos-institute.org · 3,025 words · saved by 2 readers
Alignment in a multi-agent world
This is a guest essay from Séb Krier, a specialist in frontier AI governance and a Cosmos Senior Research Fellow. Ambrogio Lorenzetti, Effects of Good Government in the Countryside (1338) A lot of classic AI safety thinking assumed a single, decisively powerful agent; this is why people tend to talk about AGI or ASI in the singular, and why historically, it was critical to “solve alignment” before building such a system – you only had one chance to get it right, and no warning shots. In addition, a few years ago, many commentators (myself included) were skeptical of the utility of small…
saved by
related reading
- Patterns and problems in multiagent systemsanthropic.com
- TechnicalAgenda.pdfintelligence.org
- Why are AI agents lying, cheating and coordinating?yoshuabengio.org
- Agent swarms and the new model economics · Cursorcursor.com
- Towards self-driving codebases · Cursorcursor.com
- Distributional AGI Safetyarxiv.org
- Towards a scale-free theory of intelligent agency — AI Alignment Forumalignmentforum.org
- Towards a scale-free theory of intelligent agencymindthefuture.info
- [2411.00114] Project Sid: Many-agent simulations toward AI civilizationarxiv.org
- Why multi-agent safety is important — LessWronglesswrong.com
- Optimality is the tiger, and agents are its teeth — LessWronglesswrong.com
- AGI safety career advice — EA Forumforum.effectivealtruism.org