✳flâneur — a map of the web's best reading
Energy-Based Models for Continual Learning
energy-based-model.github.io · 730 words · saved by 1 readers
Energy-Based Models for Continual Learning
Energy-Based Models for Continual Learning --> Energy-Based Models for Continual Learning ICML 2021 --> Shuang Li 1 , Yilun Du 1 , Gido M. van de Ven 2 , Igor Mordatch 3 1 MIT CSAIL 2 Baylor College of Medicine 3 Google Brain Paper Code We motivate Energy-Based Models (EBMs) as a promising model class for continual learning problems. Instead of tackling continual learning via the use of external memory, growing models, or regularization, EBMs change the underlying training objective to causes less interference with previously learned information. Our proposed version of EBMs for continual lear
Explore this link on the map →related reading
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- Energy-Based Modelsenergy-based-model.github.io
- The Continual Learning Problemjessylin.com
- pdfopenreview.net
- What are the real problems of continual learning?infinitefaculty.substack.com
- What are Diffusion Models? | Lil'Loglilianweng.github.io
- NL.pdfabehrouz.github.io
- Loss of plasticity in deep continual learning | Naturenature.com
- Yang Songyang-song.net
- Self-Distillation Enables Continual Learningarxiv.org
- [2302.00487] A Comprehensive Survey of Continual Learning: Theory, Method and Applicationarxiv.org
- augustus odena on X: "I have a bunch of thoughts about continual learning and nothing to do with them (I'm working on something else) so I figured I'd just turn them into a post: First: I think people use "continual learning" to point at a cluster of issues that are related but distinct. I'll list" / Xx.com