Inferring neural activity before plasticity as a foundation for learning beyond backpropagation.
This paper proposes that the brain learns in a fundamentally different way than current artificial intelligence systems. It demonstrates that this biological learning mechanism enables faster and more effective learning in many tasks faced by animals and humans in nature. For both humans and machines, the essence of learning is to pinpoint which components in its information processing pipeline are responsible for an error in its output, a challenge that is known as 'credit assignment'. It has long been assumed that credit assignment is best solved by backpropagation, which is also the foundation of modern machine learning. Here, we set out a fundamentally different principle on credit assignment called 'prospective configuration'. In prospective configuration, the network first infers the pattern of neural activity that should result from learning, and then the synaptic weights are modified to consolidate the change in neural activity. We demonstrate that this distinct mechanism, in c
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation. Skip to main content Papers Inferring neural activity before plasticity as a foundation for learning beyond backpropagation. Inferring neural activity before plasticity as a foundation for learning beyond backpropagation. Song Y Millidge B Salvatori T Lukasiewicz T Xu Z Bogacz R This paper proposes that the brain learns in a fundamentally different way than current artificial intelligence systems. It demonstrates that this biological learning mechanism enables faster and more effective learning in
related reading
- So how does learning work?cs.mcgill.ca
- Artificial Neural Nets Finally Yield Clues to How Brains Learn | Quanta Magazinequantamagazine.org
- Backpropagation and the brain | Nature Reviews Neurosciencenature.com
- Zoom In: An Introduction to Circuitsdistill.pub
- A critique of pure learning and what artificial neural networks can learn from animal brains | Nature Communicationsnature.com
- Don't Mess with Backprop: Doubts about Biologically Plausible Deep Learningevjang.com
- A deep learning framework for neuroscience - PMCncbi.nlm.nih.gov
- Volitional control of individual neurons in the human brainpmc.ncbi.nlm.nih.gov
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- https://io0.github.ioio0.github.io
- Eric Jang: Don't Mess with Backprop: Doubts about Biologically Plausible Deep Learningblog.evjang.com
- Towards deep learning with segregated dendrites | eLifeelifesciences.org