✳flâneur — a map of the web's best reading
What are the real problems of continual learning?
infinitefaculty.substack.com · 2,353 words · saved by 1 readers
Reflections on catastrophic interference, plasticity, and learning for the future in the era of large language models
What are the real problems of continual learning? Reflections on catastrophic interference, plasticity, and learning for the future in the era of large language models Andrew Lampinen May 29, 2026 61 8 4 Share Lately, there’s been a surge of interest in continual learning . In particular, there’s been an increasing sense that continual learning is one of the areas where the gap between humans and AI is largest. 1 In this post, I want to explain what continual learning is, and some of the past perspectives on it — including how I think the field focused on what in retrospect turned out to be th
Explore this link on the map →saved by
related reading
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- The Continual Learning Problemjessylin.com
- augustus odena on X: "I have a bunch of thoughts about continual learning and nothing to do with them (I'm working on something else) so I figured I'd just turn them into a post: First: I think people use "continual learning" to point at a cluster of issues that are related but distinct. I'll list" / Xx.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- What's so hard about continuous learning?seangoedecke.com
- NL.pdfabehrouz.github.io
- Continual Learning in Token Space | Lettaletta.com
- [2302.00487] A Comprehensive Survey of Continual Learning: Theory, Method and Applicationarxiv.org
- Loss of plasticity in deep continual learning | Naturenature.com
- You can’t imitation-learn how to continual-learn — LessWronglesswrong.com
- Understanding Memorization via Loss Curvaturegoodfire.ai
- Keynote & Tutorial – Continual Learning and Catastrophic Forgetting2024.ccneuro.org