Should We Lock in Post-AGI Agreements Under Uncertainty?
Some mutually beneficial agreements, between major powers or individuals, depend on shared uncertainty about post-AGI outcomes. We consider which deals are worth enabling before an intelligence explosion.
13th March 2026 [AI Narration] Should We Lock in Post-AGI Agreements Under Uncertainty? Playback speed Volume 0:00 of 1:06:58 Abstract It’s a widely-held view that we should delay locking-in consequential or long-lasting agreements until we know much more about the world after a possible intelligence explosion, and until we can engage in extensive reflection on our beliefs and values. But some mutually-beneficial deals depend on shared uncertainty about the future. If we prevent those deals, we’re potentially leaving a lot of expected value off the table. So we need to make those deals…
saved by
related reading
- Persistent Path-Dependence: Why Our Actions Matter Long-Termforethought.org
- Risk-Averse AIsforethought.org
- Making deals with early schemers — LessWronglesswrong.com
- You will be OK — LessWronglesswrong.com
- Plans A, B, C, and D for misalignment risk — LessWronglesswrong.com
- AGI Tradesdanielgross.com
- Coasean Bargaining at Scaleblog.cosmos-institute.org
- AI 2040: Plan A — LessWronglesswrong.com
- OpenAI's "Planning For AGI And Beyond"astralcodexten.substack.com
- Concrete Projects in AGI Preparednessforethought.org
- Short AI Timelines Aren’t Always Higher-Leverageforethought.org
- AI Pause Will Likely Backfire — EA Forumforum.effectivealtruism.org