Sacred values of future AIs — LessWrong
Consider a future with many diverse AIs that need to coordinate with each other, or at least coexist without conflict. Such AIs would need shared val…
x Sacred values of future AIs — LessWrong AI Frontpage 58 Sacred values of future AIs by Cleo Nardo 4th Mar 2026 6 min read 4 58 Consider a future with many diverse AIs that need to coordinate with each other, or at least coexist without conflict. Such AIs would need shared values they can coordinate around. According to Hanson's theory, groups of diverse agents facing coordination pressure will tend to sacralize some shared value — seeing it in “far mode” so they can see it together. Unfortunately, this makes them systematically worse at making decisions about these things. If this model appl
Explore this link on the map →related reading
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- ⿻ Symbiogenesis vs. Convergent Consequentialism — LessWronglesswrong.com
- Societal and technological progress as sewing an ever-growing, ever-changing, patchy, and polychrome quilt — LessWronglesswrong.com
- Weaponized Sacredness — Ribbonfarmribbonfarm.com
- Value systematization: how values become coherent (and misaligned) — LessWronglesswrong.com
- The doom justifies the valuation | the singularity is nearergeohot.github.io
- Value systematization: how values become coherent (and misaligned) — AI Alignment Forumalignmentforum.org
- Hyperstition for Good: Write the Future All Sentient Beings Deservehyperstition.sentientfutures.ai
- The case against AI alignment — LessWronglesswrong.com
- Import AI 431: Technological Optimism and Appropriate Fearimportai.substack.com
- ClearerThinking.org Podcast | Is AI going to ruin everything? (with Gabriel Alfour)podcast.clearerthinking.org