✳flâneur — a map of the web's best reading

⏯️ Autoresume Training - Composer

docs.mosaicml.com · 1,179 words · saved by 1 readers

We all know the pain of having a training run die in the middle of training. Composer’s autoresume feature provides a convenient solution to picking back up automatically from the last checkpoint w...

Tip This tutorial is available as a Jupyter notebook . ⏯️ Autoresume Training # We all know the pain of having a training run die in the middle of training. Composer’s autoresume feature provides a convenient solution to picking back up automatically from the last checkpoint when re-running a previously failed training script. We’ve put together this tutorial to demonstrate this feature in action and how you can activate it through the Composer trainer. 🐕 Autoresume via Watchdog : Composer autoresumption works best when coupled with automated node failure detection and retries on Mosaic AI tr

Explore this link on the map →

saved by

related reading