✳flâneur — a map of the web's best reading
Yes you should understand backprop | by Andrej Karpathy | Medium
karpathy.medium.com · 1,627 words · saved by 12 readers
When we offered CS231n (Deep Learning class) at Stanford, we intentionally designed the programming assignments to include explicit…
Yes you should understand backprop Andrej Karpathy 7 min read · Dec 19, 2016 -- 49 Listen Share When we offered CS231n (Deep Learning class) at Stanford, we intentionally designed the programming assignments to include explicit calculations involved in backpropagation on the lowest level. The students had to implement the forward and the backward pass of each layer in raw numpy. Inevitably, some students complained on the class message boards: “Why do we have to write the backward pass when frameworks in the real world, such as TensorFlow, compute them for you automatically?” This is seemingly
Explore this link on the map →saved by
- Linda
- Aryan Naik
- Adithya V
- Saeejith Nair
- Ivy Zhang
- Sherry Xie
- Marley Xiong
- Vincent Cheng
- CLL
- Liam Hinzman
- Kevin Xu
- Jacqline Geng
related reading
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- A Recipe for Training Neural Networkskarpathy.github.io
- CS231n Deep Learning for Computer Visioncs231n.github.io
- A Recipe for Training Neural Networkskarpathy.github.io
- Calculus on Computational Graphs: Backpropagation -- colah's blogcolah.github.io
- Backpropagation - Wikipediaen.wikipedia.org
- The Little Book of Deep Learningfleuret.org
- Backpropagation | Brilliant Math & Science Wikibrilliant.org
- What is backpropagation really doing? | 3Blue1Brown3blue1brown.com
- Vanishing gradient problem - Wikipediaen.wikipedia.org
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- Tiny TPUtinytpu.com