neurobio and vanishing gradients

N/A

102 Jonathan Richard Shewchuk 18 Neurobiology; Faster Neural Network Training NEUROBIOLOGY (cont’d) neurons.pdf – Neuron: A cell in brain/nervous system for thinking/communication – Action potential or spike: An electrochemical impulse fired by a neuron to communicate w/other neurons – Axon: The limb(s) along which the action potential propagates; “output” [Most axons branch out eventually, sometimes profusely near their ends.] [It turns out that…

related reading

• Neural networks and deep learningneuralnetworksanddeeplearning.com
• Zoom In: An Introduction to Circuitsdistill.pub
• Neurotechnology Numbers Worth Knowingmilan.cvitkovic.net
• Neuralink and the Brain's Magical Future — Wait But Whywaitbutwhy.com
• Neural networks and deep learningneuralnetworksanddeeplearning.com
• https://io0.github.ioio0.github.io
• Neural networks and deep learningneuralnetworksanddeeplearning.com
• neural netspeople.eecs.berkeley.edu
• The Unbearable Slowness of Beingarxiv.org
• Analogies between Biology and Deep Learning [rough note] -- colah's blogcolah.github.io
• So how does learning work?cs.mcgill.ca
• The Brain vs. Deep Learning vs. Singularitytimdettmers.com