adam-maj/deep-learning: A deep-dive on the entire history of deep-learning

github.com · 8,775 words · saved by 1 readers

A deep-dive on the entire history of deep learning, highlighting the series of innovations that got us from simple feed-forward networks to GPT-4o. For each key milestone, I've included the critical papers in this repository, along with my notes, my explanation of important intuitions & math, and a toy implementation in pytorch when relevant. The rest of this page is my breakdown of everything we can learn from this history, and what it tells us about the future of deep learning, inspired by The Lessons of History by Will & Ariel Durant. Important This project is designed so everyone can get most of the value by just reading my overview on the rest of this page. Then, people curious to learn about the technical details of each innovation can explore the rest of the repository via the links in the resources section. Note For more context, checkout the original twitter thread Note Thanks to Pavan Jayasinha and Anand Majmudar for their constant feedback while I made this 😄 The most inter

deep-learning A deep-dive on the entire history of deep learning, highlighting the series of innovations that got us from simple feed-forward networks to GPT-4o. For each key milestone, I've included the critical papers in this repository, along with my notes, my explanation of important intuitions & math, and a toy implementation in pytorch when relevant. The rest of this page is my breakdown of everything we can learn from this history, and what it tells us about the future of deep learning, inspired by The Lessons of History by Will & Ariel Durant. Important This project is designed so ever

adam-maj/deep-learning: A deep-dive on the entire history of deep-learning

related reading