✳flâneur — a map of the web's best reading

How to Optimize a CUDA Matmul Kernel for cuBLAS-like Performance: a Worklog

siboehm.com · 9,320 words · saved by 23 readers

In this post, I’ll iteratively optimize an implementation of matrix multiplication written in CUDA.My goal is not to build a cuBLAS replacement, but to deepl...

How to Optimize a CUDA Matmul Kernel for cuBLAS-like Performance: a Worklog Subscribe Si_Boehm Comments (16) December 2022 In this post, I’ll iteratively optimize an implementation of matrix multiplication written in CUDA. My goal is not to build a cuBLAS replacement, but to deeply understand the most important performance characteristics of the GPUs that are used for modern deep learning. This includes coalescing global memory accesses, shared memory caching and occupancy optimizations, among others. You can download the code for all kernels from Github . Also checkout wangzyon’s repo from wh

Explore this link on the map →

saved by

related reading