nn-notes.pdf

N/A

Neural Networks: a Primer for Mathematicians Boris Hanin Princeton ORFE bhanin@princeton.edu March 28, 2026 2 Contents 1 Neural Networks: An Overview 5 1.1 What is a NN? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.2 How are NNs used? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7 1.3 Big Questions, Small Intuitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . .…

saved by

• Yudhister Joel Kumar
• Didier Lampard
• Evie Hu
• Lucas Chen

related reading

• Bayesian Neural Networkscs.toronto.edu
• Neural networks and deep learningneuralnetworksanddeeplearning.com
• [2007.12826] The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Trainingarxiv.org
• Understanding the Neural Tangent Kernel – EigenTaleseigentales.com
• Neural networks: from the perceptron to deep netsarxiv.org
• Some Math behind Neural Tangent Kernel | Lil'Loglilianweng.github.io
• 1412.0233arxiv.org
• Understanding deep learning requires rethinking generalizationarxiv.org
• Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
• arxiv.org/pdf/1805.08522arxiv.org
• The Little Book of Deep Learningfleuret.org
• [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org