google-research/tuning_playbook: A playbook for systematically maximizing the performance of deep learning models.

A playbook for systematically maximizing the performance of deep learning models. - google-research/tuning_playbook

Deep Learning Tuning Playbook This is not an officially supported Google product. Varun Godbole † , George E. Dahl † , Justin Gilmer † , Christopher J. Shallue ‡ , Zachary Nado † † Google Research, Brain Team ‡ Harvard University Table of Contents Who is this document for? Why a tuning playbook? Guide for starting a new project Choosing the model architecture Choosing the optimizer Choosing the batch size Choosing the initial configuration A scientific approach to improving model performance The incremental tuning strategy Exploration vs exploitation Choosing the goal for the next round of exp

related reading

• GitHub - google-research/tuning_playbook: A playbook for systematically maximizing the performance of deep learning models.github.com
• Making Deep Learning go Brrrr From First Principleshorace.io
• How To Scale Your Modeljax-ml.github.io
• A Recipe for Training Neural Networkskarpathy.github.io
• The Little Book of Deep Learningfleuret.org
• A Recipe for Training Neural Networkskarpathy.github.io
• Hyperparameter optimization - Wikipediaen.wikipedia.org
• The Annotated Transformernlp.seas.harvard.edu
• GitHub - adam-maj/deep-learning: A deep-dive on the entire history of deep-learninggithub.com
• GitHub - jacobhilton/deep_learning_curriculum: Language model alignment-focused deep learning curriculumgithub.com
• Evaluation and Fine Tuning | Virgiliovirgili0.github.io
• Debugging Reinforcement Learning Systemsandyljones.com