An Even Easier Introduction to CUDA (Updated) | NVIDIA Technical Blog
Note: This blog post was originally published on Jan 25, 2017, but has been edited to reflect new updates. This post is a super simple introduction to CUDA, the popular parallel computing platform and programming model from NVIDIA. I wrote a previous post, An Easy Introduction to CUDA in 2013 that has been popular over the years. But CUDA programming has gotten easier, and GPUs have gotten much faster, so it’s time for an updated (and even easier) introduction. CUDA C++ is just one of the ways you can create massively parallel applications with CUDA. It lets you use the powerful C++ programming language to develop high performance algorithms accelerated by thousands of parallel threads running on GPUs. Many developers have accelerated their computation- and bandwidth-hungry applications this way, including the libraries and frameworks that underpin the ongoing revolution in artificial intelligence known as Deep Learning. So, you’ve heard about CUDA and you are interested in learning ho
An Even Easier Introduction to CUDA (Updated) | NVIDIA Technical Blog Technical Blog Subscribe Related Resources Data Science English 한국어 中文 An Even Easier Introduction to CUDA (Updated) May 02, 2025 By Mark Harris Like Discuss (148) L T F R E AI-Generated Summary Like Dislike CUDA is a parallel computing platform from NVIDIA that allows developers to create high-performance applications using thousands of parallel threads on GPUs. To get started with CUDA, developers need a CUDA-capable GPU and the free CUDA Toolkit, and can then write CUDA C++ code to accelerate computations, such as adding
Explore this link on the map →related reading
- CUDA C++ Programming Guide (Legacy) — CUDA C++ Programming Guidedocs.nvidia.com
- How to Optimize a CUDA Matmul Kernel for cuBLAS-like Performance: a Worklogsiboehm.com
- CUDA - Wikipediaen.wikipedia.org
- Mini Project: GPU Accelerated Matrix Multiplication (almost) like cuBLAS0mean1sigma.com
- Inside NVIDIA GPUs: Anatomy of high performance matmul kernels - Aleksa Gordićaleksagordic.com
- Writing CUDA Kernels - Numba 0+untagged.622.gaacf444.dirty documentationnumba.readthedocs.io
- What happens when you run a CUDA kernelfergusfinn.com
- Course on CUDA Programmingpeople.maths.ox.ac.uk
- GitHub - stanford-cs149/asst3: Stanford CS149 -- Assignment 3 · GitHubgithub.com
- Execution Model - SLING user documentationdoc.sling.si
- Worklog: Optimising GEMM on NVIDIA H100 for cuBLAS-like Performance (WIP) – Hamza's Bloghamzaelshafie.bearblog.dev
- Outperforming cuBLAS on H100: a Worklogcudaforfun.substack.com