To be legible, evidence of misalignment probably has to be behavioral

Evidence from just model internals (e.g. interpretability) is unlikely to be broadly convincing.

To be legible, evidence of misalignment probably has to be behavioral Evidence from just model internals (e.g. interpretability) is unlikely to be broadly convincing. Ryan Greenblatt Apr 15, 2025 9 3 1 Share One key hope for mitigating risk from misalignment is inspecting the AI's behavior, noticing that it did something egregiously bad , converting this into legible evidence the AI is seriously misaligned, and then this triggering some strong and useful response (like spending relatively more resources on safety or undeploying this misaligned AI). You might hope that (fancy) internals-based t

saved by

• Kaustubh Kislay

related reading

• The Case for Model Forensics — LessWronglesswrong.com
• From personas to intentions: towards a science of motivations for AI models — LessWronglesswrong.com
• The behavioral selection model for predicting AI motivations — LessWronglesswrong.com
• Alignment remains a hard, unsolved problem — LessWronglesswrong.com
• Alignment is not solved but it increasingly looks solvablealigned.substack.com
• Current AIs seem pretty misaligned to me — LessWronglesswrong.com
• Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
• Interpretability Will Not Reliably Find Deceptive AI — LessWronglesswrong.com
• Incriminating misaligned AI models via distillation — LessWronglesswrong.com
• Deep Deceptiveness — LessWronglesswrong.com
• Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
• Current AIs seem pretty misaligned to meblog.redwoodresearch.org