Demystifying GPU Compute Architectures - by Babbage
thechipletter.substack.com · 2,283 words · saved by 1 readers
Getting 'low level' with Nvidia and AMD GPUs
NVIDIA_GeForce_8800GTX_G80___DSC01200 via Fritzchens Fritz https://commons.wikimedia.org/w/index.php?curid=65926359 The complexity of modern GPUs needn’t obscure the essence of how these machines work. If we are to make the most of the advanced technology in these GPUs then we need a little less mystique. I think this is one of the most exciting times in computer architecture for many years. In CPUs we have x86, Arm and RISC-V, three increasingly well-supported application architectures. And GPU architectures are, of course, becoming much more important. GPUs are obviously a critical…
related reading
- Demystifying GPU Compute Architectures - by Babbagethechipletter.substack.com
- README | GPU Glossarymodal.com
- AI Chip Architecturesjacobpeake.com
- How to Think About GPUs | How To Scale Your Modeljax-ml.github.io
- A history of NVidia Stream Multiprocessorfabiensanglard.net
- GitHub - adam-maj/tiny-gpu: A minimal GPU design in Verilog to learn how GPUs work from the ground up · GitHubgithub.com
- AI Chip Architecturesjepeake.com
- The Best GPUs for Deep Learning in 2023 — An In-depth Analysistimdettmers.com
- General-purpose computing on graphics processing units - Wikipediaen.wikipedia.org
- Inside NVIDIA GPUs: Anatomy of high performance matmul kernels - Aleksa Gordićaleksagordic.com
- Execution Model - SLING user documentationdoc.sling.si
- CUDA C++ Programming Guide (Legacy) — CUDA C++ Programming Guidedocs.nvidia.com