✳flâneur — a map of the web's best reading
What I learned this week - Pretraining parallelisms, Can distillation be stopped, Mythos and the cybersecurity equilibrium, Pipeline RL, On why pretraining runs fails
dwarkesh.com · 1,305 words · saved by 3 readers
April 15, 2025
Blog What I learned this week - Can distillation be stopped, Mythos and the cybersecurity equilibrium, Pipeline RL April 15, 2025 Dwarkesh Patel Apr 15, 2026 133 16 6 Share At the end of my conversation with Michael Nielsen , we talked about how to actually retain what you learn. Michael’s advice was to make some kind of demanding artifact. Write something up. Try to explain it. So in that spirit, here are notes on some topics I’ve learned about over the last week or two. These notes are extremely rough, and have many mistakes. Can distillation be stopped? Can the frontier labs stop distillati
Explore this link on the map →saved by
related reading
- AI in 2025: gestalt — LessWronglesswrong.com
- RL Environments and RL for Science: Data Foundries and Multi-Agent Architecturesnewsletter.semianalysis.com
- AI 2027ai-2027.com
- My picture of the present in AI — LessWronglesswrong.com
- Composer2.pdfcursor.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Thoughts on Claude Mythosberen.io
- AI 2027ai-2027.com
- 2025: The year in LLMssimonwillison.net
- AINews | AINewsnews.smol.ai
- Questions about the Future of AI - by Dwarkesh Pateldwarkesh.com
- Security incident disclosure — July 2026huggingface.co