♻️ Auto Microbatching - Composer
Have you ever wanted to choose your batch size without having to stress about CUDA Out-of-Memory (OOM) errors? We sure have. That’s why we built Composer’s automatic microbatching feature. This tut...
Tip This tutorial is available as a Jupyter notebook . ♻️ Auto Microbatching # Have you ever wanted to choose your batch size without having to stress about CUDA Out-of-Memory (OOM) errors? We sure have. That’s why we built Composer’s automatic microbatching feature. This tutorial will demonstrate how to use automatic microbatching to avoid CUDA OOMs, regardless of your batch size choice, GPU type, and number of devices. Note that this demo requires a GPU to demonstrate automatic microbatching. Recommended Background # To follow this tutorial, you should be familiar with the basics of using th
saved by
related reading
- ⏯️ Autoresume Training - Composerdocs.mosaicml.com
- 👨👩👧👦 Distributed Training - Composerdocs.mosaicml.com
- ⏱️ Performance Profiling - Composerdocs.mosaicml.com
- Mosaic ResNet Deep Dive | Databricks Blogmosaicml.com
- ⚡ Migrating from PTL - Composerdocs.mosaicml.com
- 🥽 Analyzing Tracesdocs.mosaicml.com
- A Recipe for Training Neural Networkskarpathy.github.io
- Making Deep Learning go Brrrr From First Principleshorace.io
- microgptkarpathy.github.io
- Training Composer for longer horizons · Cursorcursor.com
- Composer2.pdfcursor.com
- The Annotated Transformernlp.seas.harvard.edu