What makes a good monitoring prompt? – Apollo Research
We want to understand which principles work well for high-quality monitoring prompts. We use a 1-10 severity scale and full-trajectory scoring (e.g. opposed to real-time binary prompts).
What makes a good monitoring prompt? – Apollo Research July 23, 2026 What makes a good monitoring prompt? Contents Summary We want to understand which principles work well for high-quality monitoring prompts. We use a 1-10 severity scale and full-trajectory scoring (e.g. opposed to real-time binary prompts). Setup: We start with a canonical prompt (~281 lines long) that we split into 15 different components, e.g. definition, reasoning structure, example, etc. We then do various ablations and compressions across five failure modes, ~211–231 trajectories each (1,094 total), spanning the fu
saved by
related reading
- We need 3rd party Training-Run Assessments — LessWronglesswrong.com
- Demystifying evals for AI agents \ Anthropicanthropic.com
- Early work on monitorability evaluations - METRmetr.org
- Surfacing Pathological Behaviors in Language Models | Transluce AItransluce.org
- [2512.18311] Monitoring Monitorabilityarxiv.org
- Prompting best practicesdocs.anthropic.com
- [2507.11473] Chain of Thought Monitorability: A New and Fragile Opportunity for AI Safetyarxiv.org
- How well do models follow their constitutions? — LessWronglesswrong.com
- When Chain of Thought is Necessary, Language Models Struggle to Evade Monitorsarxiv.org
- GPT-6 Astra System Carddeploymentsafety.openai.com
- Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscationarxiv.org
- Agent Evaluation: A Detailed Guidecameronrwolfe.substack.com