How GPT-5, Claude, and Gemini are actually trained and served – Reiner Pope - YouTube

Follow along using the transcript.

Did a very different format with Reiner Pope – a blackboard lecture where he walks through how frontier LLMs are trained and served. It's shocking how much you can deduce about what the labs are doing from a handful of equations, public API prices, and some chalk. It’s a bit technical, but I encourage you to hang in there - it’s really worth it. There are less than a handful of people who understand the full stack of AI, from chip design to model architecture, as well as Reiner. It was a real delight to learn from him. Reiner is CEO of MatX, a new chip startup (full disclosure - I’m an…

saved by

• Ishaan Panigrahi
• Arya G

related reading

• Reiner Pope – The math behind how LLMs are trained and serveddwarkesh.com
• Why Inference Matters 12x More Than Training | YC Paper Clubyoutube.com
• Chip design from the bottom up – Reiner Popeyoutube.com
• Stanford CS25: Transformers United V6 I Serving Transformers: Lessons from the Trenchesyoutube.com
• Recursive Language Models — Alex Zhang, MIT PhDyoutube.com
• How trillion-parameter AI models work and how to serve themyoutube.com
• Why Sam Altman is against a single superintelligenceyoutube.com
• How to Parallelize a Transformer for Training — an explorable explanationezyang.github.io
• Big Boss (@0xBADB01E) on Xx.com
• AI researchers debate how close we are to recursive self-improvementyoutube.com
• RLMs are Compositional Generalizers with Alex Zhang from MITyoutube.com
• Reiner Pope of MatX on accelerating AI with transformer-optimized chipscheekypint.substack.com