Composer + FFCV: Faster Together
Composer is pushing the envelope on speed and efficiency in model training. Integrating Composer with FFCV, a fast dataloading library from Aleks Madry’s lab at MIT, unlocks new speedup methods by eliminating the dataloader bottleneck often experienced when using CPU-intensive operations in the training loop. The FFCV dataloader is one of the ingredients of our Mosaic ResNet recipe, which demonstrates how algorithmic efficiency can dramatically speed up model training.
mousedown mouseup touchcancel touchend touchstart auxclick dblclick pointercancel pointerdown pointerup dragend dragstart drop compositionend compositionstart keydown keypress keyup input textInput copy cut paste click change contextmenu reset submit abort auxClick cancel canPlay canPlayThrough click close contextMenu copy cut drag dragEnd dragEnter dragExit dragLeave dragOver dragStart drop durationChange emptied encrypted ended error gotPointerCapture input invalid keyDown keyPress keyUp load loadedData loadedMetadata loadStart lostPointerCapture mouseDown mouseMove mouseOut mouseOver mouseU
related reading
- AI Research | Databricks Blogmosaicml.com
- Making Deep Learning go Brrrr From First Principleshorace.io
- Mosaic ResNet Deep Dive | Databricks Blogmosaicml.com
- Composer2.pdfcursor.com
- Training LLMs with AMD MI250 GPUs and MosaicML | Databricks Blogmosaicml.com
- ♻️ Auto Microbatching - Composerdocs.mosaicml.com
- 1.5x faster MoE training with custom MXFP8 kernels · Cursorcursor.com
- Mosaic LLMs: GPT-3 quality formosaicml.com
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- Improving Composer through real-time RL · Cursorcursor.com
- A friendly introduction to machine learning compilers and optimizershuyenchip.com
- MosaicML StreamingDataset: Fast, Accurate Streaming of Training Data from Cloud Storage | Databricks Blogmosaicml.com