aiesi_post-training_public.pdf
kawine.github.io · 3,477 words · saved by 1 readers
N/A
POST-TRAINING LLMs Kawin Ethayarajh Assistant Professor of Applied AI - University of Chicago, Booth AI AND ECONOMICS SUMMER INSTITUTE 2026 August 6–11, 2026 • Chicago 1 The model you use is not the model that was pretrained. 2 A pretrained model continues text. USER MODEL How do I estimate the causal effect of a How do I estimate the causal effect of a minimum-wage increase?…
saved by
related reading
- SFT, RL, and On-Policy Distillation Through a Distributional Lens | whnrehiew.github.io
- On-Policy Distillation - Thinking Machines Labthinkingmachines.ai
- RLHF & Post-Training Course by Nathan Lambertrlhfbook.com
- pdfopenreview.net
- [2606.07527] Post-training is (Massive) Supervised Learningarxiv.org
- rlhfbook.com/book.pdfrlhfbook.com
- State of RL for reasoning LLMs | A. Weersaweers.de
- A Guide to Reinforcement Learning Post-Training for LLMs: PPO, DPO, GRPO, and Beyondhuggingface.co
- You can’t imitation-learn how to continual-learn — LessWronglesswrong.com
- LLM Post-Training: A Deep Dive into Reasoning Large Language Modelsarxiv.org
- Training language models to follow instructions with human feedback.pdfproceedings.neurips.cc
- [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org