🥽 Analyzing Traces - Composer
The Composer Profiler relies on PyTorch profiler for model operator profiling and adds additional profiling information for trainer loop events, dataloaders, and system utilization metrics. This do...
Toggle table of contents sidebar The Composer Profiler relies on PyTorch profiler for model operator profiling and adds additional profiling information for trainer loop events, dataloaders, and system utilization metrics. This document highlights additions by the Composer Profiler for augmenting the PyTorch profiling trace with trainer loop events and ways to analyze the collected traces. The profiler records various duration events such as forward (the time for which forward pass of the model ran; event/forward in the images below) and dumps the information in a file using the Chrome…
saved by
related reading
- ⏱️ Performance Profiling - Composerdocs.mosaicml.com
- 👨👩👧👦 Distributed Training - Composerdocs.mosaicml.com
- ⚡ Migrating from PTL - Composerdocs.mosaicml.com
- PyTorch Profiling 101 with Modded-NanoGPTblog.underfit.ai
- What’s New in PyTorch Profiler 1.9? – PyTorchpytorch.org
- Making Deep Learning go Brrrr From First Principleshorace.io
- All my favorite tracing tools: eBPF, QEMU, Perfetto, new ones I built and more - Tristan Humethume.ca
- Composer2.pdfcursor.com
- Counting FLOPS in PyTorch using CPU PMU counters | B. Nikolic Software and Computing Blogbnikolic.co.uk
- Counting FLOPS in PyTorch using CPU PMU counters | B. Nikolic Software and Computing Blogbnikolic.co.uk
- Estimating training compute of deep learning models | Epoch AIepochai.org
- Concetti di profilazionecloud.google.com