Loss of plasticity in deep continual learning | Nature
Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript. Advertisement Nature volume 632, pages 768–774 (2024)Cite this article 34k Accesses 182 Altmetric Metrics details Artificial neural networks, deep-learning methods and the backpropagation algorithm1 form the foundation of modern machine learning and artificial intelligence. These methods are almost always used in two phases, one in which the weights of the network are updated and one in which the weights are held constant while the network is used or evaluated. This contrasts with natural learning and many applications, which require continual learning. It has been unclear whether or not deep learning methods work in co
Download PDF Subjects Computer science Human behaviour Abstract Artificial neural networks, deep-learning methods and the backpropagation algorithm 1 form the foundation of modern machine learning and artificial intelligence. These methods are almost always used in two phases, one in which the weights of the network are updated and one in which the weights are held constant while the network is used or evaluated. This contrasts with natural learning and many applications, which require continual learning. It has been unclear whether or not deep learning methods work in continual learning setti
Explore this link on the map →saved by
related reading
- NL.pdfabehrouz.github.io
- The Decade of Deep Learning | Leo Gaobmk.sh
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- The Little Book of Deep Learningfleuret.org
- Clare Lyle | The state of plasticity in 2025clarelyle.com
- The Continual Learning Problemjessylin.com
- A Theory of Deep Learning | Elements of a Vector Spaceelonlit.com
- Keynote & Tutorial – Continual Learning and Catastrophic Forgetting2024.ccneuro.org
- What are the real problems of continual learning?infinitefaculty.substack.com
- [2302.00487] A Comprehensive Survey of Continual Learning: Theory, Method and Applicationarxiv.org
- Statistical Mechanics of Deep Learningganguli-gang.stanford.edu