Discovering Language Model Behaviors with Model-Written Evaluations — LessWrong

“Discovering Language Model Behaviors with Model-Written Evaluations” is a new Anthropic paper by Ethan Perez et al. that I (Evan Hubinger) also coll…

x Discovering Language Model Behaviors with Model-Written Evaluations — LessWrong Language Models (LLMs) AI Frontpage 100 Discovering Language Model Behaviors with Model-Written Evaluations by evhub , Ethan Perez 20th Dec 2022 AI Alignment Forum 1 min read 34 100 Ω 43 This is a linkpost for https://www.anthropic.com/model-written-evals.pdf “ Discovering Language Model Behaviors with Model-Written Evaluations ” is a new Anthropic paper by Ethan Perez et al. that I (Evan Hubinger) also collaborated on. I think the results in this paper are quite interesting in terms of what they demonstrate abou

saved by

• Lydia Nottingham
• Will Anderson
• Vincent Cimino

related reading

• Mechanistically Eliciting Latent Behaviors in Language Models — AI Alignment Forumalignmentforum.org
• [2604.16812] Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
• Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
• Agentic Misalignment: How LLMs Could be Insider Threats — LessWronglesswrong.com
• Modifying LLM Beliefs with Synthetic Document Finetuningalignment.anthropic.com
• Auditing language models for hidden objectives — LessWronglesswrong.com
• [2212.09251] Discovering Language Model Behaviors with Model-Written Evaluationsarxiv.org
• Surfacing Pathological Behaviors in Language Models | Transluce AItransluce.org
• [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
• Simulated Users & Sad LLMs1a3orn.com
• The case for more ambitious language model evals — LessWronglesswrong.com
• Training language models to follow instructions with human feedback.pdfproceedings.neurips.cc