✳flâneur — a map of the web's best reading

♻️ Auto Microbatching - Composer

docs.mosaicml.com · 1,431 words · saved by 1 readers

Have you ever wanted to choose your batch size without having to stress about CUDA Out-of-Memory (OOM) errors? We sure have. That’s why we built Composer’s automatic microbatching feature. This tut...

Tip This tutorial is available as a Jupyter notebook . ♻️ Auto Microbatching # Have you ever wanted to choose your batch size without having to stress about CUDA Out-of-Memory (OOM) errors? We sure have. That’s why we built Composer’s automatic microbatching feature. This tutorial will demonstrate how to use automatic microbatching to avoid CUDA OOMs, regardless of your batch size choice, GPU type, and number of devices. Note that this demo requires a GPU to demonstrate automatic microbatching. Recommended Background # To follow this tutorial, you should be familiar with the basics of using th

Explore this link on the map →

saved by

related reading