How to Post-Train · RL Fundamentals Mini-Series
A no-BS series on what actually goes wrong in RL post-training - trajectory eyeballing, rubrics and verifiers, task design, environment quality - and how to fix it.
A running series of tutorials, opinionated pieces, and guides around what actually goes wrong in post-training. Everything from trajectory eyeballing, rubrics and verifiers, task design, to RL environment quality. Written from years in the trenches :). By Auriel · 5 posts RL Fundamentals Mini-Series 01 How to Eye Ball Trajectories: You’ve Never Spent Real Time with Your Model and We Can ALL Tell A no-BS guide for startups post-training their own models Live 02 RL Environment Harness Quality: Stop Shipping Low-Quality Harnesses and Calling It an “Environment” Flaky harnesses quietly…
saved by
related reading
- RL Pet Peeves Part 1 · Aurielaurielws.github.io
- Debugging Reinforcement Learning Systemsandyljones.com
- RLHF & Post-Training Course by Nathan Lambertrlhfbook.com
- Reward Hacking in Reinforcement Learning | Lil'Loglilianweng.github.io
- A Taxonomy of RL Environments for LLM Agentsleehanchung.github.io
- Training a Misaligned Reward Seekeralignment.anthropic.com
- Part 1: Key Concepts in RL - Spinning Up documentationspinningup.openai.com
- Is Frontier Asynchronous RL Solved? — Luke J. Huangluk-huang.github.io
- What if RL Environments Aren't Mispriced?benanderson.work
- aiesi_post-training_public.pdfkawine.github.io
- SFT, RL, and On-Policy Distillation Through a Distributional Lens | whnrehiew.github.io
- Good QC for RL Dataseancai.com