Composer + FFCV: Faster Together
Composer is pushing the envelope on speed and efficiency in model training. Integrating Composer with FFCV, a fast dataloading library from Aleks Madry’s lab at MIT, unlocks new speedup methods by eliminating the dataloader bottleneck often experienced when using CPU-intensive operations in the training loop. The FFCV dataloader is one of the ingredients of our Mosaic ResNet recipe, which demonstrates how algorithmic efficiency can dramatically speed up model training.
mousedown mouseup touchcancel touchend touchstart auxclick dblclick pointercancel pointerdown pointerup dragend dragstart drop compositionend compositionstart keydown keypress keyup input textInput copy cut paste click change contextmenu reset submit abort auxClick cancel canPlay canPlayThrough click close contextMenu copy cut drag dragEnd dragEnter dragExit dragLeave dragOver dragStart drop durationChange emptied encrypted ended error gotPointerCapture input invalid keyDown keyPress keyUp load loadedData loadedMetadata loadStart lostPointerCapture mouseDown mouseMove mouseOut mouseOver mouseU
related reading
- Chloe's Gardenchloeyan.me
- Sorrel Salb | Are.naare.na
- Composer2.pdfcursor.com
- Zack Reneau-Wedeenzackrw.com
- Improving Composer through real-time RL · Cursorcursor.com
- Over-Stimulatedover-stimulated.com
- Training Composer for longer horizons · Cursorcursor.com
- WePresent | Join FKA twigs on her healing journey in Atlantawepresent.wetransfer.com
- Together AI | The AI Native Cloudtogether.ai
- Coding vs thinking — Paradigm 3paradigm3.org
- Representation Engineering: A Top-Down Approach to AI Transparencyai-transparency.org
- Compare AI Models: Pricing, Context & Benchmarks | OpenRouteropenrouter.ai