adam-maj/deep-learning: A deep-dive on the entire history of deep-learning

A deep-dive on the entire history of deep-learning - adam-maj/deep-learning

deep-learning A deep-dive on the entire history of deep learning, highlighting the series of innovations that got us from simple feed-forward networks to GPT-4o. For each key milestone, I've included the critical papers in this repository, along with my notes, my explanation of important intuitions & math, and a toy implementation in pytorch when relevant. The rest of this page is my breakdown of everything we can learn from this history, and what it tells us about the future of deep learning, inspired by The Lessons of History by Will & Ariel Durant. Important This project is designed so ever

related reading

• GitHub - adam-maj/deep-learning: A deep-dive on the entire history of deep-learninggithub.com
• GitHub - adam-maj/deep-learning: A deep-dive on the entire history of deep-learning · GitHubgithub.com
• Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
• GitHub - adam-maj/robotics: A deep dive on the history of robotics and the future of humanoidsgithub.com
• Making Deep Learning go Brrrr From First Principleshorace.io
• The Decade of Deep Learning | Leo Gaobmk.sh
• The Little Book of Deep Learningfleuret.org
• The Only Important Technology Is The Internet - Kevin Lukevinlu.ai
• A History of Large Language Modelsgregorygundersen.com
• Deep Dive into LLMs like ChatGPTyoutube.com
• The Scaling Hypothesis · Gwern.netgwern.net
• GitHub - jacobhilton/deep_learning_curriculum: Language model alignment-focused deep learning curriculumgithub.com