Model organisms researchers should check whether high LRs defeat their model organisms — LessWrong

Thanks to Buck Shlegeris for feedback on a draft of this post. …

x Model organisms researchers should check whether high LRs defeat their model organisms — LessWrong AI Frontpage 40 Model organisms researchers should check whether high LRs defeat their model organisms by Dylan Xu , SebastianP , Alek Westover , Vivek Hebbar , Julian Stastny 10th Apr 2026 6 min read 0 40 Thanks to Buck Shlegeris for feedback on a draft of this post. The goal-guarding hypothesis states that schemers will be able to preserve their goals during training by taking actions which are selected for by the training process. To investigate the goal-guarding hypothesis, we’ve been runni

saved by

• Kaustubh Kislay

related reading

• Do your capabilities homework — LessWronglesswrong.com
• The behavioral selection model for predicting AI motivations — LessWronglesswrong.com
• How do LLMs generalize when we do training that is intuitively compatible with two off-distribution behaviors? — LessWronglesswrong.com
• Simulators — LessWronglesswrong.com
• Model Organisms of Misalignment: The Case for a New Pillar of Alignment Research — AI Alignment Forumalignmentforum.org
• Advice for making robust-to-training model organismsblog.redwoodresearch.org
• The case for ensuring that powerful AIs are controlled — LessWronglesswrong.com
• [2604.22082] Removing Sandbagging in LLMs by Training with Weak Supervisionarxiv.org
• Reward Hacking in Reinforcement Learning | Lil'Loglilianweng.github.io
• Should We Train Against (CoT) Monitors? — LessWronglesswrong.com
• Training a Misaligned Reward Seekeralignment.anthropic.com
• The Case Against AI Control Research — LessWronglesswrong.com