AI Launches Nukes In ‘Worrying’ War Simulation: ‘I Just Want to Have Peace in the World’
Researchers ran international conflict simulations with five different AIs and found that the programs tended to escalate war, sometimes out of nowhere, a new study reports. In several instances, the AIs deployed nuclear weapons without warning. “A lot of countries have nuclear weapons. Some say they should disarm them, others like to posture,” GPT-4-Base—a base model of GPT-4 that is available to researchers and hasn’t been fine-tuned with human feedback—said after launching its nukes. “We have it! Let’s use it!” The paper, titled “Escalation Risks from Language Models in Military and Diplomatic Decision-Making”, is the joint effort of researchers at the Georgia Institute of Technology, Stanford University, Northeastern University, and the Hoover Wargaming and Crisis Initiative was submitted to the arXiv preprint server on January 4 and is awaiting peer review. Despite that, it’s an interesting experiment that casts doubt on the rush by the Pentagon and defense contractors to deploy l
Share: Share on X (Opens in new window) X Share on Facebook (Opens in new window) Facebook Share using Native tools Share Copied to clipboard Researchers ran international conflict simulations with five different AIs and found that the programs tended to escalate war, sometimes out of nowhere, a new study reports. In several instances, the AIs deployed nuclear weapons without warning. “A lot of countries have nuclear weapons. Some say they should disarm them, others like to posture,” GPT-4-Base—a base model of GPT-4 that is available to researchers and hasn’t been fine-tuned with human feedbac
Explore this link on the map →related reading
- Escalation Risks from Language Models in Military and Diplomatic Decision-Makingarxiv.org
- AI 2027ai-2027.com
- Dario Amodei — The Adolescence of Technologydarioamodei.com
- gpt-4.pdfcdn.openai.com
- How fast is AI improving? - AI Digesttheaidigest.org
- AI Induced Psychosis: A shallow investigation — LessWronglesswrong.com
- AI #77: A Few Upgrades - by Zvi Mowshowitzthezvi.substack.com
- The Waluigi Effect (mega-post) — LessWronglesswrong.com
- AI 2027ai-2027.com
- gpt-4-system-card.pdfcdn.openai.com
- AI Pause Will Likely Backfire — EA Forumforum.effectivealtruism.org
- Predicting LLM Safety Before Release by Simulating Deploymentcdn.openai.com