Petri: An open-source auditing tool to accelerate AI safety research \ Anthropic
anthropic.com · 1,371 words · saved by 1 readers
A new automated auditing tool for AI safety research
Alignment Petri: An open-source auditing tool to accelerate AI safety research Oct 6, 2025 Read the technical report Petri (Parallel Exploration Tool for Risky Interactions) is our new open-source tool that enables researchers to explore hypotheses about model behavior with ease. Petri deploys an automated agent to test a target AI system through diverse multi-turn conversations involving simulated users and tools; Petri then scores and summarizes the target’s behavior. This automation handles a significant part of the work that one needs to do to build a broad understanding of a new model, an
related reading
- Petri: An open-source auditing tool to accelerate AI safety researchalignment.anthropic.com
- Petri 2.0: New Scenarios, New Model Comparisons, and Improved Eval-Awareness Mitigationsalignment.anthropic.com
- A “diff” tool for AI: Finding behavioral differences in new models \ Anthropicanthropic.com
- Alignment is not solved but it increasingly looks solvablealigned.substack.com
- Auditing language models for hidden objectives \ Anthropicanthropic.com
- Pre-deployment auditing can catch an overt saboteuralignment.anthropic.com
- Introducing Bloom: an open source tool for automated behavioral evaluations \ Anthropicanthropic.com
- Building and evaluating alignment auditing agents — AI Alignment Forumalignmentforum.org
- Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
- Teaching Claude Whyalignment.anthropic.com
- Oversight Assistants: Turning Compute into Understandingbounded-regret.ghost.io
- [2605.24229] How Well Do Models Follow Their Constitutions?arxiv.org