[2403.04807] Mathematics of Neural Networks (Lecture Notes Graduate Course)
Abstract:These are the lecture notes that accompanied the course of the same name that I taught at the Eindhoven University of Technology from 2021 to 2023. The course is intended as an introduction to neural networks for mathematics students at the graduate level and aims to make mathematics students interested in further researching neural networks. It consists of two parts: first a general introduction to deep learning that focuses on introducing the field in a formal mathematical way. The second part provides an introduction to the theory of Lie groups and homogeneous spaces and how it can be applied to design neural networks with desirable geometric equivariances. The lecture notes were made to be as self-contained as possible so as to accessible for any student with a moderate mathematics background. The course also included coding tutorials and assignments in the form of a set of Jupyter notebooks that are publicly available at this https URL.
arXiv:2403.04807v1 [cs.LG] 6 Mar 2024 Mathematics of Neural Networks Bart M.N. Smets November 12, 2022 “You insist that there is something a machine cannot do. If you tell me precisely what it is a machine cannot do, then I can always make a machine which will do just that.” – John von Neumann “As a technical discussion grows longer, the probability…
saved by
related reading
- [2608.13335] Neural Quadratic Forms: A Unified Minimal Model for Sudden Learning and Scaling Lawsarxiv.org
- Homemrkdh16.github.io
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugesarxiv.org
- Understanding Deep Learningudlbook.github.io
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- The Decade of Deep Learning | Leo Gaobmk.sh
- nn-notes.pdfboris-hanin.github.io
- Zoom In: An Introduction to Circuitsdistill.pub
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- Neural Networks, Types, and Functional Programming -- colah's blogcolah.github.io
- Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io