What’s New in PyTorch Profiler 1.9? | PyTorch
pytorch.org · 2,312 words · saved by 1 readers
An open source machine learning framework that accelerates the path from research prototyping to production deployment.
PyTorch Profiler v1.9 has been released! The goal of this new release (previous PyTorch Profiler release ) is to provide you with new state-of-the-art tools to help diagnose and fix machine learning performance issues regardless of whether you are working on one or numerous machines. The objective is to target the execution steps that are the most costly in time and/or memory, and visualize the work load distribution between GPUs and CPUs. Here is a summary of the five major features being released: Distributed Training View : This helps you understand how much time and memory is consumed in y
related reading
- PyTorch Profiling 101 with Modded-NanoGPTblog.underfit.ai
- 🥽 Analyzing Tracesdocs.mosaicml.com
- ⏱️ Performance Profiling - Composerdocs.mosaicml.com
- Making Deep Learning go Brrrr From First Principleshorace.io
- How To Scale Your Modeljax-ml.github.io
- PyTorch internals : ezyang's blogblog.ezyang.com
- PiTorch: ML on Baremetal Raspberry Pis | projectsmasonjwang.com
- The Best GPUs for Deep Learning in 2023 — An In-depth Analysistimdettmers.com
- GitHub - wafer-ai/gpu-perf-engineering-resources: A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.github.com
- the bug that taught me more about PyTorch than years of using it | Elana Simonelanapearl.github.io
- Counting FLOPS in PyTorch using CPU PMU counters | B. Nikolic Software and Computing Blogbnikolic.co.uk
- Counting FLOPS in PyTorch using CPU PMU counters | B. Nikolic Software and Computing Blogbnikolic.co.uk