Red-teaming a network of agents: Understanding what breaks when AI agents interact at scale - Microsoft Research
Safe agents don’t guarantee a safe ecosystem of interconnected agents. Microsoft Research examines what breaks when AI agents interact and why network-level risks require new approaches. Learn more:
Red-teaming a network of agents: Understanding what breaks when AI agents interact at scale - Microsoft Research Skip to main content Research Publications Code & data People Microsoft Research blog Artificial intelligence Audio & acoustics Computer vision Graphics & multimedia Human-computer interaction Human language technologies Search & information retrieval Data platforms and analytics Hardware & devices Programming languages & software engineering Quantum computing Security, privacy & cryptography Systems & networking Algorithms Mathematics Ecology & environment Economics Medical, health
saved by
related reading
- [2502.15657] Superintelligent Agents Pose Catastrophic Risks: Can Scientist AI Offer a Safer Path?arxiv.org
- Patterns and problems in multiagent systemsanthropic.com
- A basic systems architecture for AI agents that do autonomous research — LessWronglesswrong.com
- Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
- AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
- [2502.14143] Multi-Agent Risks from Advanced AIarxiv.org
- Building Effective AI Agents \ Anthropicanthropic.com
- AI Control: Improving Safety Despite Intentional Subversion — AI Alignment Forumalignmentforum.org
- GitHub - requie/AI-Red-Teaming-Guide: A comprehensive guide to adversarial testing and security evaluation of AI systems, helping organizations identify vulnerabilities before attackers exploit them.github.com
- Agents of Chaosarxiv.org
- Distributional AGI Safetyarxiv.org
- Why are AI agents lying, cheating and coordinating?yoshuabengio.org