Pre, Mid, Post-Training Way of Life - by Tina He

Clarity has very little to do with the engine of the intellect.

Pre, Mid, Post-Training Way of Life Clarity has very little to do with the engine of the intellect. Tina He Dec 26, 2025 66 15 Share "For here there is no place / that does not see you. You must change your life." — Rilke’s Archaic Torso of Apollo Building a large language model happens in three main stages . Pre-training processes trillions of tokens scraped from everywhere, taken in with little discrimination. The model learns to predict the next word from the last, and the deceptively simple task demands massive compute. Tens of thousands of GPUs for months, tolerating messy, uncurated data

saved by

• Anish Thite
• Samuel Lo
• Menelaos Mazarakis
• alana goyal
• Christina Lee

related reading

• Dario Amodei — "We are near the end of the exponential"dwarkesh.com
• Andrej Karpathy — AGI is still a decade awaydwarkesh.com
• A Workaphile’s Apologymoalquraishi.wordpress.com
• aiesi_post-training_public.pdfkawine.github.io
• Ilya Sutskever — We're moving from the age of scaling to the age of researchdwarkesh.com
• Elicitation, the simplest way to understand post-traininginterconnects.ai
• The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
• [2606.07527] Post-training is (Massive) Supervised Learningarxiv.org
• llm assistant personas seem increasingly incoherent (some subjective observations) — LessWronglesswrong.com
• [2606.12360] Anatomy of Post-Training: Using Interpretability to Characterize Data and Shape the Learning Signalarxiv.org
• MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
• Reflections on 2025samuelalbanie.substack.com