flâneur — a map of the web's best reading

adam-maj/deep-learning: A deep-dive on the entire history of deep-learning

github.com · 8,775 words · saved by 1 readers

A deep-dive on the entire history of deep-learning - adam-maj/deep-learning

deep-learning A deep-dive on the entire history of deep learning, highlighting the series of innovations that got us from simple feed-forward networks to GPT-4o. For each key milestone, I've included the critical papers in this repository, along with my notes, my explanation of important intuitions & math, and a toy implementation in pytorch when relevant. The rest of this page is my breakdown of everything we can learn from this history, and what it tells us about the future of deep learning, inspired by The Lessons of History by Will & Ariel Durant. Important This project is designed so ever

Explore this link on the map →

related reading