Linear/Fully-Connected Layers User's Guide :: NVIDIA Deep Learning Performance Documentation
This guide provides tips for improving the performance of fully-connected (or linear) layers. It also provides an example of the impact of the parameter choice with layers in the Transformer network.
Linear/Fully-Connected Layers User's Guide - NVIDIA Docs Menu Docs Hub NVIDIA Deep Learning Performance Submit Search Submit Search NVIDIA Docs Hub Homepage Deep Learning Performance NVIDIA Deep Learning Performance Linear/Fully-Connected Layers User's Guide Download PDF Linear/Fully-Connected Layers User's Guide Abstract This guide provides tips for improving the performance of fully-connected (or linear) layers. It also provides an example of the impact of the parameter choice with layers in the Transformer network. 1. Quick Start Checklist The following quick start checklist provides specif
saved by
related reading
- Memory-Limited Layers User's Guide - NVIDIA Docsdocs.nvidia.com
- The Best GPUs for Deep Learning in 2023 — An In-depth Analysistimdettmers.com
- GPU Performance Background User's Guide - NVIDIA Docsdocs.nvidia.com
- Tips for Optimizing GPU Performance Using Tensor Cores | NVIDIA Technical Blogdeveloper.nvidia.com
- Making Deep Learning go Brrrr From First Principleshorace.io
- Transformer Inference Arithmetic | kipply's blogkipp.ly
- Get Started With Deep Learning Performance - NVIDIA Docsdocs.nvidia.com
- CVPR2023_eff_tutorial_molchanov.pdfnvlabs.github.io
- How to Think About GPUs | How To Scale Your Modeljax-ml.github.io
- All About Rooflines | How To Scale Your Modeljax-ml.github.io
- Inside NVIDIA GPUs: Anatomy of high performance matmul kernels - Aleksa Gordićaleksagordic.com
- All the Transformer Math You Need to Know | How To Scale Your Modeljax-ml.github.io