Stanford CS25: Transformers United V6 I Serving Transformers: Lessons from the Trenches - YouTube

Follow along using the transcript.

For more information about Stanford’s graduate programs, visit: https://online.stanford.edu/graduate-education May 28, 2026 Serving Transformers: Lessons from the Trenches of Production Inference This seminar covers insights, lessons, and gnarly scars from serving transformer model inferences at the scale of thousands of GPUs. Follow along with the seminar schedule. Visit: https://web.stanford.edu/class/cs25/ Guest Speaker: Charles Frye (Modal) Instructors: • Steven Feng, Stanford Computer Science PhD student and NSERC PGS-D scholar • Karan P. Singh, Electrical Engineering PhD student…

saved by

• Ishaan Panigrahi

related reading

• Why Inference Matters 12x More Than Training | YC Paper Clubyoutube.com
• Stanford CS25: Transformers United V6 I Overview of Transformersyoutube.com
• Stanford CS25: Transformers United V6 I From Representation Learning to World Modelingyoutube.com
• Why Sam Altman is against a single superintelligenceyoutube.com
• Recursive Language Models — Alex Zhang, MIT PhDyoutube.com
• How GPT, Claude, and Gemini are actually trained and served – Reiner Popeyoutube.com
• How trillion-parameter AI models work and how to serve themyoutube.com
• Next-Latent Prediction Transformers Learn World Models feat. Jayden Teoh from MITyoutube.com
• How to Parallelize a Transformer for Training — an explorable explanationezyang.github.io
• Stanford CS336 | Language Modeling from Scratchcs336.stanford.edu
• How To Scale Your Modeljax-ml.github.io
• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub