A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex
The prefrontal cortex encodes and stores numerous, often disparate, schemas and flexibly switches between them. Recent research on artificial neural networks trained by reinforcement learning has made it possible to model fundamental processes underlying schema encoding and storage. Yet how the brain is able to create new schemas while preserving and utilizing old schemas remains unclear. Here we propose a simple neural network framework based on a modification of the mixture of experts architecture to model the prefrontal cortex’s ability to flexibly encode and use multiple disparate schemas. We show how incorporation of gating naturally leads to transfer learning and robust memory savings. We then show how phenotypic impairments observed in patients with prefrontal damage are mimicked by lesions of our network. Our architecture, which we call DynaMoE, provides a fundamental framework for how the prefrontal cortex may handle the abundance of schemas necessary to navigate the real world.
A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex | bioRxiv Skip to main content New Results A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex Ben Tsuda , Kay M. Tye , Hava T. Siegelmann , Terrence J. Sejnowski doi: https://doi.org/10.1101/2020.03.11.984757 Ben Tsuda 1 Computational Neurobiology Laboratory, The Salk Institute for Biological Studies , La Jolla, CA 92037, USA 2 Neurosciences Graduate Program, University of California San Diego , La Jolla, CA 920
Explore this link on the map →related reading
- NL.pdfabehrouz.github.io
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- pdfopenreview.net
- The Continual Learning Problemjessylin.com
- Animals vs Ghosts – karpathykarpathy.bearblog.dev
- My computational framework for the brain — LessWronglesswrong.com
- So how does learning work?cs.mcgill.ca
- A critique of pure learning and what artificial neural networks can learn from animal brains | Nature Communicationsnature.com
- Continuous Thought Machinespub.sakana.ai
- Towards a “universal translator” for neural dynamics at single-cell, single-spike resolutionarxiv.org
- Neuronpedianeuronpedia.org