Recommendations-for-Using-Red-Teaming-for-AI-Accountability-PolicyBrief.pdf

N/A

POLICY BRIEF AI Red-Teaming Is Not a One-Stop Solution to AI Harms: Recommendations for Using Red-Teaming for AI Accountability Sorelle Friedler, Ranjit Singh, Borhane Blili-Hamelin, Jacob Metcalf, and Brian J. Chen AI Red-Teaming is Not a One-Stop Solution to AI Harms: Recommendations for Using Red-Teaming for AI Accountability Red-teaming is a method where people — traditionally security engineers inside a company — interact with a system to try to make it produce undesired outcomes. The goal is to identify ways the system doesn’t work as intended, and then find fixes for the…

related reading

• Can We Red Team Our Way to AI Accountability? | TechPolicy.Presstechpolicy.press
• GitHub - requie/AI-Red-Teaming-Guide: A comprehensive guide to adversarial testing and security evaluation of AI systems, helping organizations identify vulnerabilities before attackers exploit them.github.com
• AI Control: Improving Safety Despite Intentional Subversion — LessWronglesswrong.com
• Recommendations for Technical AI Safety Research Directionsalignment.anthropic.com
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• AI Control: Improving Safety Despite Intentional Subversion — AI Alignment Forumalignmentforum.org
• Reading Listblog.redwoodresearch.org
• DS_AI_Governance_Policy_Brief.pdfdatasociety.net
• NVIDIA AI Red Team: An Introduction | NVIDIA Technical Blogdeveloper.nvidia.com
• [2004.07213] Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claimsarxiv.org
• A safe harbor for AI evaluation and red teamingnormaltech.ai
• Red-teaming a network of agents: Understanding what breaks when AI agents interact at scale - Microsoft Researchmicrosoft.com