A Theory of Deep Learning | Elements of a Vector Space
elonlit.com · 1,837 words · saved by 8 readers
We finally know why deep learning works.
Borges wrote a story about a man named Funes who, after a horseback accident, acquires the ability to perceive and remember everything. Every leaf on every tree. Every ripple on every stream at every moment. He is the perfect empiricist. Infinite data, infinite recall, infinite resolution. And he cannot think. Because thinking, as Borges understood, requires forgetting. Funes could reconstruct entire days from memory but could not understand why the dog at 3:14, seen from the side, should be called the same thing as the dog at 3:15, seen from the front. I suspect [that Funes] was not very good
saved by
related reading
- Elon Litman | Elements of a Vector Spaceelonlit.com
- [2605.01172] A Theory of Generalization in Deep Learningarxiv.org
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- The Little Book of Deep Learningfleuret.org
- Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugesarxiv.org
- [2608.13335] Neural Quadratic Forms: A Unified Minimal Model for Sudden Learning and Scaling Lawsarxiv.org
- Your Transformer is Secretly an EOT Solver | Elements of a Vector Spaceelonlit.com
- There Will Be a Scientific Theory of Deep Learningarxiv.org
- [2410.21265] Modular Duality in Deep Learningarxiv.org
- Just Ask for Generalization | Eric Jangevjang.com
- Neural Networks, Types, and Functional Programming -- colah's blogcolah.github.io