The paper that killed deep learning theory — LessWrong
Around 10 years ago, a paper came out that arguably killed classical deep learning theory: Zhang et al.'s aptly titled Understanding deep learning re…
x The paper that killed deep learning theory — LessWrong Academic Papers History & Philosophy of Science Postmortems & Retrospectives AI Frontpage 2026 Top Fifty: 16 % 193 The paper that killed deep learning theory by LawrenceC 26th Apr 2026 AI Alignment Forum 7 min read 10 193 Ω 68 Around 10 years ago, a paper came out that arguably killed classical deep learning theory: Zhang et al.'s aptly titled Understanding deep learning requires rethinking generalization . Of course, this is a bit of an exaggeration. No single paper ever kills a field of research on its own, and deep learning theory was
Explore this link on the map →saved by
related reading
- Deep learning as program synthesis — LessWronglesswrong.com
- [2503.02113] Deep Learning is Not So Mysterious or Differentarxiv.org
- Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- A Theory of Deep Learning | Elements of a Vector Spaceelonlit.com
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- The Scaling Hypothesis · Gwern.netgwern.net
- arxiv.org/pdf/1805.08522arxiv.org
- [2605.01172] A Theory of Generalization in Deep Learningarxiv.org
- The Decade of Deep Learning | Leo Gaobmk.sh
- Elon Litman | Elements of a Vector Spaceelonlit.com
- Clare Lyle | What's grokking good for?clarelyle.com