Inferring neural activity before plasticity as a foundation for learning beyond backpropagation.
This paper proposes that the brain learns in a fundamentally different way than current artificial intelligence systems. It demonstrates that this biological learning mechanism enables faster and more effective learning in many tasks faced by animals and humans in nature. For both humans and machines, the essence of learning is to pinpoint which components in its information processing pipeline are responsible for an error in its output, a challenge that is known as 'credit assignment'. It has long been assumed that credit assignment is best solved by backpropagation, which is also the foundation of modern machine learning. Here, we set out a fundamentally different principle on credit assignment called 'prospective configuration'. In prospective configuration, the network first infers the pattern of neural activity that should result from learning, and then the synaptic weights are modified to consolidate the change in neural activity. We demonstrate that this distinct mechanism, in c
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation. Skip to main content Papers Inferring neural activity before plasticity as a foundation for learning beyond backpropagation. Inferring neural activity before plasticity as a foundation for learning beyond backpropagation. Song Y Millidge B Salvatori T Lukasiewicz T Xu Z Bogacz R This paper proposes that the brain learns in a fundamentally different way than current artificial intelligence systems. It demonstrates that this biological learning mechanism enables faster and more effective learning in
related reading
- So how does learning work?cs.mcgill.ca
- Backpropagation and the brain | Nature Reviews Neurosciencenature.com
- Neuroscience is pre-paradigmatic. Consciousness is whytheintrinsicperspective.com
- A critique of pure learning and what artificial neural networks can learn from animal brains | Nature Communicationsnature.com
- NL.pdfabehrouz.github.io
- Don't Mess with Backprop: Doubts about Biologically Plausible Deep Learningevjang.com
- Artificial Neural Nets Finally Yield Clues to How Brains Learn | Quanta Magazinequantamagazine.org
- A deep learning framework for neuroscience - PMCncbi.nlm.nih.gov
- Building machines that learn and think like people | Behavioral and Brain Sciences | Cambridge Corecambridge.org
- Volitional control of individual neurons in the human brainpmc.ncbi.nlm.nih.gov
- Loss of plasticity in deep continual learning | Naturenature.com
- Trading places: What happens when neuroscience turns into machine learning, and machine learning turns into neuroscience?thetransmitter.org