⏱️ Performance Profiling - Composer
Introduction: The Composer Profiler enables practitioners to collect, analyze, and visualize performance metrics during training which can be used to diagnose bottlenecks and facilitate model devel...
⏱️ Performance Profiling # Introduction # The Composer Profiler enables practitioners to collect, analyze, and visualize performance metrics during training which can be used to diagnose bottlenecks and facilitate model development. The profiler enables users to capture the following metrics: Duration of each Event, Callback, and Algorithm during training Time taken by the data loader to return a batch Host metrics such as CPU, system memory, disk, and network utilization over time Execution order, latency, and attributes of PyTorch operators and GPU kernels (see torch.profiler ) This tutorial
Explore this link on the map →saved by
related reading
- 👨👩👧👦 Distributed Training - Composerdocs.mosaicml.com
- ⏯️ Autoresume Training - Composerdocs.mosaicml.com
- ⚡ Migrating from PTL - Composerdocs.mosaicml.com
- ♻️ Auto Microbatching - Composerdocs.mosaicml.com
- Efficiently Estimating Pareto Frontiers with Cyclic Learning Rate Schedules | Databricks Blogmosaicml.com
- PyTorch Profiling 101 with Modded-NanoGPTblog.underfit.ai
- What’s New in PyTorch Profiler 1.9? – PyTorchpytorch.org
- Making Deep Learning go Brrrr From First Principleshorace.io
- Composer2.pdfcursor.com
- Estimating training compute of deep learning models | Epoch AIepochai.org
- All my favorite tracing tools: eBPF, QEMU, Perfetto, new ones I built and more - Tristan Humethume.ca
- State of torch.compile for training (August 2025) : ezyang's blogblog.ezyang.com