Commitment ability in multipolar AI scenarios – Center on Long-Term Risk
Abstract The ability to make credible commitments is a key factor in many bargaining situations ranging from trade to international conflict. This post builds a taxonomy of the commitment mechanisms that transformative AI (TAI) systems could use in future multipolar scenarios, describes various issues they have in practice, and draws some tentative conclusions about the landscape of commitments we might expect in the future. Introduction A better understanding of the commitments that future AI systems can make is helpful for predicting and influencing the dynamics of multipolar scenarios. The option to credibly bind oneself to certain actions or strategies fundamentally changes the game theory behind bargaining, cooperation, and conflict. Credible commitments can work to stabilize positive-sum agreements, and to increase […]
Abstract The ability to make credible commitments is a key factor in many bargaining situations ranging from trade to international conflict. This post builds a taxonomy of the commitment mechanisms that transformative AI (TAI) systems could use in future multipolar scenarios, describes various issues they have in practice, and draws some tentative conclusions about the landscape of commitments we might expect in the future. Introduction A better understanding of the commitments that future AI systems can make is helpful for predicting and influencing the dynamics of multipolar scenarios.…
saved by
related reading
- Cooperation, Conflict, and Transformative Artificial Intelligence: A Research Agenda — Center on Long-Term Risklongtermrisk.org
- Making deals with early schemers — LessWronglesswrong.com
- AI Deterrence by Betrayalaibetrayal.com
- How do we (more) safely defer to AIs? — LessWronglesswrong.com
- Coasean Bargaining at Scaleblog.cosmos-institute.org
- [2605.10310] Positive Alignment: Artificial Intelligence for Human Flourishingarxiv.org
- Should We Lock in Post-AGI Agreements Under Uncertainty?forethought.org
- Solipsistic Superintelligence is Unlikely to be Cooperativearxiv.org
- [2502.14143] Multi-Agent Risks from Advanced AIarxiv.org
- The Universe from an Intentional Stancecasparoesterheld.com
- Intelligent AI Delegationarxiv.org
- A Long Sequence of Small, Correct Decisionscalebwatney.substack.com