Why study alignment interventions on pre-RL checkpoints? — LessWrong
This is a dual post that lays out our current research project where we compare pre-RL-training methods on their ability to prevent models from ‘prot…
x Why study alignment interventions on pre-RL checkpoints? — LessWrong AI Frontpage 64 Why study alignment interventions on pre-RL checkpoints? by Edward James Young , Puria , Cam 8th Jul 2026 7 min read 1 64 This is a dual post that lays out our current research project where we compare pre-RL-training methods on their ability to prevent models from ‘ proto-training gaming ,’ which we predict is selected for over the course of production RL post-training. In this post, we outline what we mean by pre-RL ‘alignment checkpoints’, give our reasons for focussing on these stages of training, and su
related reading
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Alignment is not solved but it increasingly looks solvablealigned.substack.com
- Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignment — LessWronglesswrong.com
- How far does alignment midtraining generalize?alignment.openai.com
- Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignmentalignmentpretraining.ai
- Should We Train Against (CoT) Monitors? — LessWronglesswrong.com
- Alignment Faking Mitigationsalignment.anthropic.com
- Reinforcement learning towards broadly and persistently beneficial modelsalignment.openai.com
- (Some) Natural Emergent Misalignment from Reward Hacking in Non-Production RL — LessWronglesswrong.com
- The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
- [2601.10160] Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignmentarxiv.org
- Alignment pretraining could backfire — LessWronglesswrong.com