Theoretical Motivations for Deep Learning | Rinu Boney

This post is based on the lecture “Deep Learning: Theoretical Motivations” given by Dr. Yoshua Bengio at Deep Learning Summer School, Montreal 2015. I highly recommend the lecture for a deeper understanding of the topic.

This post is based on the lecture “ Deep Learning: Theoretical Motivations ” given by Dr. Yoshua Bengio at Deep Learning Summer School, Montreal 2015 . I highly recommend the lecture for a deeper understanding of the topic. Deep learning is a branch of machine learning algorithms based on learning multiple levels of representation. The multiple levels of representation corresponds to multiple levels of abstraction. This post explores the idea that if we can successfully learn multiple levels of representation then we can generalize well. The below flow charts illustrate how the different parts

saved by

• Philip KAO

related reading

• Why Deep Learning Works – Key Insights and Saddle Points - KDnuggetskdnuggets.com
• A Theory of Deep Learning | Elements of a Vector Spaceelonlit.com
• [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
• Understanding deep learning requires rethinking generalizationarxiv.org
• Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
• Just Ask for Generalization | Eric Jangevjang.com
• The Little Book of Deep Learningfleuret.org
• Deep Learning is Not So Mysterious or Differentarxiv.org
• There Will Be a Scientific Theory of Deep Learningarxiv.org
• Neural Networks, Types, and Functional Programming -- colah's blogcolah.github.io
• [2503.02113] Deep Learning is Not So Mysterious or Differentarxiv.org
• Maybe I was too harsh on deep learning theory (three days ago) — LessWronglesswrong.com