Should We Lock in Post-AGI Agreements Under Uncertainty?
Some mutually beneficial agreements, between major powers or individuals, depend on shared uncertainty about post-AGI outcomes. We consider which deals are worth enabling before an intelligence explosion.
13th March 2026 [AI Narration] Should We Lock in Post-AGI Agreements Under Uncertainty? Playback speed Volume 0:00 of 1:06:58 Abstract It’s a widely-held view that we should delay locking-in consequential or long-lasting agreements until we know much more about the world after a possible intelligence explosion, and until we can engage in extensive reflection on our beliefs and values. But some mutually-beneficial deals depend on shared uncertainty about the future. If we prevent those deals, we’re potentially leaving a lot of expected value off the table. So we need to make those deals…
saved by
related reading
- Persistent Path-Dependence: Why Our Actions Matter Long-Termforethought.org
- Preparing for the Intelligence Explosionforethought.org
- Coasean Bargaining at Scaleblog.cosmos-institute.org
- Radical Optionality — Governing Transformative AI Under Uncertaintyradical-optionality.ai
- Making deals with early schemers — LessWronglesswrong.com
- The AI Arms Race Isn’t Inevitablepalladiummag.com
- Optimal Timing for Superintelligencenickbostrom.com
- Commitment ability in multipolar AI scenarios — Center on Long-Term Risklongtermrisk.org
- Notes on Existential Risk from Artificial Superintelligencemichaelnotebook.com
- Shaping the Social Contract - The Intelligence Curseintelligence-curse.ai
- Convergence and Compromise: Will Society Aim for Good Futures?forethought.org
- Short AI Timelines Aren’t Always Higher-Leverageforethought.org