The Case for Model Forensics — LessWrong

If we had a misalignment warning shot, would we be able to tell? …

x The Case for Model Forensics — LessWrong AI Frontpage 47 The Case for Model Forensics by aditya singh , gersonkroiz , Senthooran Rajamanoharan , Neel Nanda 26th Jun 2026 AI Alignment Forum 12 min read 0 47 Ω 17 If we had a misalignment warning shot, would we be able to tell? Suppose an AI company catches their model taking an egregious action, like deleting oversight code that monitors its actions. Should they sound the alarm? A key piece of evidence to determine what to do next – such as what mitigations to take – is to understand why the model took the action. If the model was just confuse

saved by

• Kaustubh Kislay

related reading

• To be legible, evidence of misalignment probably has to be behavioralblog.redwoodresearch.org
• How independent researchers could investigate AI propensities after misalignment incidents - METRmetr.org
• Not a Paper: "Frontier Lab CEOs are Capable of In-Context Scheming" — LessWronglesswrong.com
• Are we existentially threatened by the type of AI misalignment seen in the OpenAI Hugging Face attack? — LessWronglesswrong.com
• From personas to intentions: towards a science of motivations for AI models — LessWronglesswrong.com
• [2606.26071] Model Forensics: Investigating Whether Concerning Behavior Reflects Misalignmentarxiv.org
• Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
• “Alignment Engineering” vs. “Misalignment Science”lesswrong.com
• Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• Current AIs seem pretty misaligned to me — LessWronglesswrong.com
• Teaching Claude Whyalignment.anthropic.com