A Proof of Learning Rate Transfer under $\mu$P

N/A

A Proof of Learning Rate Transfer under µP Soufiane Hayou Department of Applied Mathematics and Statistics Johns Hopkins University arXiv:2511.01734v3 [stat.ML] 24 Feb 2026 Abstract understand training dynamics of large-width neural…

saved by

• Nathan Chen
• Ali Ahmad

related reading

• The Practitioner’s Guide to the Maximal Update Parameterization - Cerebrascerebras.ai
• NL.pdfabehrouz.github.io
• The Practitioner's Guide to the Maximal Update Parameterization | EleutherAI Blogblog.eleuther.ai
• Some Math behind Neural Tangent Kernel | Lil'Loglilianweng.github.io
• Infinite Limits of Neural Networks - Kempner Institutekempnerinstitute.harvard.edu
• nn-notes.pdfboris-hanin.github.io
• Understanding the Neural Tangent Kernel – EigenTaleseigentales.com
• [2605.01172] A Theory of Generalization in Deep Learningarxiv.org
• [2007.12826] The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Trainingarxiv.org
• [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
• Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com
• [2608.13335] Neural Quadratic Forms: A Unified Minimal Model for Sudden Learning and Scaling Lawsarxiv.org