✳flâneur — a map of the web's best reading
Deep Neural Nets: 33 years ago and 33 years from now
karpathy.github.io · 2,589 words · saved by 1 readers
Musings of a Computer Scientist.
The Yann LeCun et al. (1989) paper Backpropagation Applied to Handwritten Zip Code Recognition is I believe of some historical significance because it is, to my knowledge, the earliest real-world application of a neural net trained end-to-end with backpropagation. Except for the tiny dataset (7291 16x16 grayscale images of digits) and the tiny neural network used (only 1,000 neurons), this paper reads remarkably modern today, 33 years later - it lays out a dataset, describes the neural net architecture, loss function, optimization, and reports the experimental classification error rates over t
Explore this link on the map →related reading
- Deep Neural Nets: 33 years ago and 33 years from nowkarpathy.github.io
- A Recipe for Training Neural Networkskarpathy.github.io
- The Decade of Deep Learning | Leo Gaobmk.sh
- Andrej Karpathy blogkarpathy.github.io
- A Recipe for Training Neural Networkskarpathy.github.io
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- The Little Book of Deep Learningfleuret.org
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- The Scaling Hypothesis · Gwern.netgwern.net
- GitHub - adam-maj/deep-learning: A deep-dive on the entire history of deep-learning · GitHubgithub.com
- The Unreasonable Effectiveness of Recurrent Neural Networkskarpathy.github.io
- GitHub - adam-maj/deep-learning: A deep-dive on the entire history of deep-learning · GitHubgithub.com