jacobhilton/deep_learning_curriculum: Language model alignment-focused deep learning curriculum

Language model alignment-focused deep learning curriculum

This is an advanced curriculum for getting up to speed with some of the latest developments in deep learning, as of July 2022. It is heavily biased towards my own research interests, especially large language model alignment, but it should be of general interest. It is targeted at people with a strong quantitative background who are familiar with the basics of deep learning, but may otherwise be new to the field. WARNING: this curriculum may be extremely challenging to take on alone. It is highly recommended to find a more experienced mentor, or at the very least a study partner. There are…

saved by

• Freeman Jiang
• Vatty Ananthu
• Malaika Aiyar
• Davis Brown
• Ishaan Panigrahi

related reading

• Practical Deep Learning for Coders - Practical Deep Learningcourse.fast.ai
• Study Guide — LessWronglesswrong.com
• GitHub - adam-maj/deep-learning: A deep-dive on the entire history of deep-learninggithub.com
• Deep Learningdeeplearningbook.org
• The Iliad Intensive Course Materials — LessWronglesswrong.com
• ARENA - AI Safety Curriculumlearn.arena.education
• An Alchemist’s Notes on Deep Learning — An Alchemist's Notes on Deep Learningnotes.kvfrans.com
• Neural Networks: Zero To Herokarpathy.ai
• GitHub - shantanu-ai/deep-learning-resources: Resources needed to start deep learning research. ML/DL/CV/NLP/ML-SYS/RL/Graphs/Maths/Med image lecture videos from professors at esteemed universities.github.com
• RLHF & Post-Training Course by Nathan Lambertrlhfbook.com
• Transformers Laid Outgoyalpramod.github.io
• How to get from high school math to cutting-edge ML/AI: a detailed 4-stage roadmap with links to the best learning resources that I’m aware of.justinmath.com