flâneur — a map of the web's best reading

What I learned this week - Pretraining parallelisms, Can distillation be stopped, Mythos and the cybersecurity equilibrium, Pipeline RL, On why pretraining runs fails

dwarkesh.com · 1,305 words · saved by 3 readers

April 15, 2025

Blog What I learned this week - Can distillation be stopped, Mythos and the cybersecurity equilibrium, Pipeline RL April 15, 2025 Dwarkesh Patel Apr 15, 2026 133 16 6 Share At the end of my conversation with Michael Nielsen , we talked about how to actually retain what you learn. Michael’s advice was to make some kind of demanding artifact. Write something up. Try to explain it. So in that spirit, here are notes on some topics I’ve learned about over the last week or two. These notes are extremely rough, and have many mistakes. Can distillation be stopped? Can the frontier labs stop distillati

Explore this link on the map →

saved by

related reading