Learning Mechanics
learningmechanics.pub · 102 words · saved by 1 readers
The mathematical science of neural network training
Apr 23, 2026 Deep linear networks are a surprisingly useful toy model of weight-space dynamics Deep linear networks are simple enough to study analytically but rich enough to exhibit key phenomena of neural network training. Apr 23, 2026 On neural scaling and the quanta hypothesis Eric J. Michaud What is the origin of neural scaling laws? What do they tell us about the structure of data? What are the limits of interpretability? Apr 23, 2026 Perspectives on the science of deep learning Three essays on building theory that matters. Coming soon... A visual guide to progressive…
saved by
related reading
- There Will Be a Scientific Theory of Deep Learningarxiv.org
- A scientific theory of deep learning is emerging, slowly but surely.learningmechanics.pub
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- Eric Jangevjang.com
- Ilya 30u30arc.net
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- nn-notes.pdfboris-hanin.github.io
- On neural scaling and the quanta hypothesisericjmichaud.com
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- Homemrkdh16.github.io
- Natural Intelligencegreydanus.github.io