Pre, Mid, Post-Training Way of Life - by Tina He
fakepixels.substack.com · 3,070 words · saved by 5 readers
Clarity has very little to do with the engine of the intellect.
Pre, Mid, Post-Training Way of Life Clarity has very little to do with the engine of the intellect. Tina He Dec 26, 2025 66 15 Share "For here there is no place / that does not see you. You must change your life." — Rilke’s Archaic Torso of Apollo Building a large language model happens in three main stages . Pre-training processes trillions of tokens scraped from everywhere, taken in with little discrimination. The model learns to predict the next word from the last, and the deceptively simple task demands massive compute. Tens of thousands of GPUs for months, tolerating messy, uncurated data
saved by
related reading
- On-Policy Distillation - Thinking Machines Labthinkingmachines.ai
- The machines are fine. I'm worried about us.ergosphere.blog
- trees are harlequins, words are harlequins - the voidnostalgebraist.tumblr.com
- Internet as Practicedanhunt.substack.com
- Training great LLMs entirely from ground up in the wilderness as a startup - Yi Tayyitay.net
- A Workaphile’s Apologymoalquraishi.wordpress.com
- Training Imperativesdan.io
- Reflections on 2025samuelalbanie.substack.com
- aiesi_post-training_public.pdfkawine.github.io
- ALIGNMENT - by vincent huang - a slice of my mindmindslice.substack.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- A New Kind Of Creative Povertynoemamag.com