AI Launches Nukes In ‘Worrying’ War Simulation: ‘I Just Want to Have Peace in the World’
Researchers ran international conflict simulations with five different AIs and found that the programs tended to escalate war, sometimes out of nowhere, a new study reports. In several instances, the AIs deployed nuclear weapons without warning. “A lot of countries have nuclear weapons. Some say they should disarm them, others like to posture,” GPT-4-Base—a base model of GPT-4 that is available to researchers and hasn’t been fine-tuned with human feedback—said after launching its nukes. “We have it! Let’s use it!” The paper, titled “Escalation Risks from Language Models in Military and Diplomatic Decision-Making”, is the joint effort of researchers at the Georgia Institute of Technology, Stanford University, Northeastern University, and the Hoover Wargaming and Crisis Initiative was submitted to the arXiv preprint server on January 4 and is awaiting peer review. Despite that, it’s an interesting experiment that casts doubt on the rush by the Pentagon and defense contractors to deploy l
Share: Share on X (Opens in new window) X Share on Facebook (Opens in new window) Facebook Share using Native tools Share Copied to clipboard Researchers ran international conflict simulations with five different AIs and found that the programs tended to escalate war, sometimes out of nowhere, a new study reports. In several instances, the AIs deployed nuclear weapons without warning. “A lot of countries have nuclear weapons. Some say they should disarm them, others like to posture,” GPT-4-Base—a base model of GPT-4 that is available to researchers and hasn’t been fine-tuned with human feedbac
related reading
- Escalation Risks from Language Models in Military and Diplomatic Decision-Makingarxiv.org
- The AI Arms Race Isn’t Inevitablepalladiummag.com
- AI Risks that Could Lead to Catastrophe | CAISsafe.ai
- AI Induced Psychosis: A shallow investigation — LessWronglesswrong.com
- gpt-4-system-card.pdfcdn.openai.com
- The Only Way to Deal With the Threat From AI? Shut It Downtime.com
- Should AI Be Open?slatestarcodex.com
- My Takeaways From AI 2027astralcodexten.com
- Predicting LLM Safety Before Release by Simulating Deploymentcdn.openai.com
- Introduction — Chapter 2 of Superintelligence Strategynationalsecurity.ai
- GPT-5.5 and the broken state of government evalstransformernews.ai
- Measuring AI capabilities in intelligence targeting and conventional weaponsanthropic.com