Composer + FFCV: Faster Together
Composer is pushing the envelope on speed and efficiency in model training. Integrating Composer with FFCV, a fast dataloading library from Aleks Madry’s lab at MIT, unlocks new speedup methods by eliminating the dataloader bottleneck often experienced when using CPU-intensive operations in the training loop. The FFCV dataloader is one of the ingredients of our Mosaic ResNet recipe, which demonstrates how algorithmic efficiency can dramatically speed up model training.
mousedown mouseup touchcancel touchend touchstart auxclick dblclick pointercancel pointerdown pointerup dragend dragstart drop compositionend compositionstart keydown keypress keyup input textInput copy cut paste click change contextmenu reset submit abort auxClick cancel canPlay canPlayThrough click close contextMenu copy cut drag dragEnd dragEnter dragExit dragLeave dragOver dragStart drop durationChange emptied encrypted ended error gotPointerCapture input invalid keyDown keyPress keyUp load loadedData loadedMetadata loadStart lostPointerCapture mouseDown mouseMove mouseOut mouseOver mouseU
Explore this link on the map →related reading
- Chloe's Gardenchloeyan.me
- Sorrel Salb | Are.naare.na
- Composer2.pdfcursor.com
- Improving Composer through real-time RL · Cursorcursor.com
- WePresent | Join FKA twigs on her healing journey in Atlantawepresent.wetransfer.com
- Over-Stimulatedover-stimulated.com
- Training Composer for longer horizons · Cursorcursor.com
- GitHub - oughtinc/ice: Interactive Composition Explorer: a debugger for compositional language model programs · GitHubgithub.com
- Zack Reneau-Wedeenzackrw.com
- shen ✸ | Are.naare.na
- AI Research | Databricks Blogmosaicml.com
- ⏯️ Autoresume Training - Composerdocs.mosaicml.com