[2304.04123] Nuclear Arms Control Verification and Lessons for AI Treaties
Security risks from AI have motivated calls for international agreements that guardrail the technology. However, even if states could agree on what rules to set on AI, the problem of verifying compliance might make these agreements infeasible. To help clarify the difficulty of verifying agreements on AI$\unicode{x2013}$and identify actions that might reduce this difficulty$\unicode{x2013}$this report examines the case study of verification in nuclear arms control. We review the implementation, track records, and politics of verification across three types of nuclear arms control agreements. Then, we consider implications for the case of AI, especially AI development that relies on thousands of highly specialized chips. In this context, the case study suggests that, with certain preparations, the foreseeable challenges of verification would be reduced to levels that were successfully managed in nuclear arms control. To avoid even worse challenges, substantial preparations are needed: (1) developing privacy-preserving, secure, and acceptably priced methods for verifying the compliance of hardware, given inspection access; and (2) building an initial, incomplete verification system, with authorities and precedents that allow its gaps to be quickly closed if and when the political will arises.
N UCLEAR A RMS C ONTROL V ERIFICATION AND L ESSONS FOR AI T REATIES Mauricio Baker Stanford University arXiv:2304.04123v1 [cs.CY] 8 Apr 2023 maubaker@stanford.edu…
related reading
- Verification Without a Treatyunidir.org
- Verifying International Agreements on AI: Six Layers of Verification for Rules on Large-Scale AI Development and Deploymentarxiv.org
- Verification Planai-2040.com
- Preventing covert ASI development in countries within our agreement — LessWronglesswrong.com
- Can the Cold War Teach Us How to Slow Down AI?time.com
- Asymmetry of verification and verifier’s rule - Jason Weijasonwei.net
- The Compute Verification Postfirstscattering.com
- Modern arms control verification for the Outer Space Treaty - Bulletin of the Atomic Scientiststhebulletin.org
- The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
- Nonproliferation — Chapter 5 of Superintelligence Strategynationalsecurity.ai
- Off Target | CNAScnas.org
- [2004.07213] Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claimsarxiv.org