nn-notes.pdf

N/A

Neural Networks: a Primer for Mathematicians Boris Hanin Princeton ORFE bhanin@princeton.edu March 28, 2026 2 Contents 1 Neural Networks: An Overview 5 1.1 What is a NN? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.2 How are NNs used? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.3 Big Questions, Small Intuitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . .…

saved by

• Yudhister Joel Kumar
• Didier Lampard
• Evie Hu
• Lucas Chen

related reading

• Some Math behind Neural Tangent Kernel | Lil'Loglilianweng.github.io
• Understanding the Neural Tangent Kernel – EigenTaleseigentales.com
• [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
• [2007.12826] The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Trainingarxiv.org
• A Spectral Condition for Feature Learningarxiv.org
• Neural networks: from the perceptron to deep netsarxiv.org
• Infinite Limits of Neural Networks - Kempner Institutekempnerinstitute.harvard.edu
• Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com
• Bayesian Neural Networkscs.toronto.edu
• 1412.0233arxiv.org
• Understanding deep learning requires rethinking generalizationarxiv.org
• arxiv.org/pdf/1805.08522arxiv.org