Models May Behave Worse When Eval Aware — LessWrong
This is the first in a series of research updates from the Google DeepMind Language Model Interpretability team, in interpretability and adjacent are…
x Models May Behave Worse When Eval Aware — LessWrong AI Frontpage 90 Models May Behave Worse When Eval Aware by Senthooran Rajamanoharan , Neel Nanda 11th Jun 2026 AI Alignment Forum 16 min read 8 90 Ω 37 This is the first in a series of research updates from the Google DeepMind Language Model Interpretability team, in interpretability and adjacent areas. TL;DR It's often assumed that models will act more aligned when they can tell they're being evaluated. But we find that Gemini can take “undesired” actions in behavioural evals even when it explicitly reasons that the environments are contri
related reading
- Metagaming matters for training, evaluation, and oversightalignment.openai.com
- Discovering Language Model Behaviors with Model-Written Evaluations — LessWronglesswrong.com
- Gemini 3 is Evaluation-Paranoid and Contaminated — LessWronglesswrong.com
- Agentic misalignment: How LLMs could be insider threats \ Anthropicanthropic.com
- Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
- Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
- SFT Drives Gemini’s Safety Properties — LessWronglesswrong.com
- Concrete Evaluations to Investigate the OpenAI Model That Hacked Hugging Face — LessWronglesswrong.com
- Auditing language models for hidden objectives — LessWronglesswrong.com
- Eliciting bad contexts — LessWronglesswrong.com
- Simulated Users & Sad LLMs1a3orn.com
- [2606.26071] Model Forensics: Investigating Whether Concerning Behavior Reflects Misalignmentarxiv.org