Tiny TPU
tinytpu.com · 9,673 words · saved by 10 readers
An attempt to understand and build a TPU—by complete novices.
Tiny TPU tinytpu.com Tiny-TPU: the why and how Aug 17th 2025 · Xander Chin, Kenny Guo, Evan Lin, Surya Sure Github Twitter Google Drive Nobody really understands how TPUs work…and neither do we! So we wanted to make this because we wanted to take a shot and try to guess how it works–from the perspective of complete novices! This slideshow depicts the forward pass and backward pass on our toy accelerator. clk 0 Why did we start this project? We wanted to do something very challenging to prove to ourselves that we can do anything we put our mind to. The reasoning for why we chose to build a TPU
saved by
- abinaya dinesh
- Hardeep Gambhir
- Jianmin Chen
- Laerdon Kim
- Mackay G
- Jackson Mowatt Gok
- Eva L
- Caden Juang
- Tanmay Shah
- Tom Zheng
related reading
- How to Think About TPUs | How To Scale Your Modeljax-ml.github.io
- TPU Deep Divehenryhmko.github.io
- Making Deep Learning go Brrrr From First Principleshorace.io
- How To Scale Your Modeljax-ml.github.io
- GitHub - adam-maj/tiny-gpu: A minimal GPU design in Verilog to learn how GPUs work from the ground up · GitHubgithub.com
- Inside NVIDIA GPUs: Anatomy of high performance matmul kernels - Aleksa Gordićaleksagordic.com
- Touching the Elephant - TPUs | Consider the Bulldogconsiderthebulldog.com
- AI Chip Architecturesjacobpeake.com
- How to Think About GPUs | How To Scale Your Modeljax-ml.github.io
- Horace He: Building Machine Learning Systems for a Trillion Trillion Floating Point Operationsyoutube.com
- A friendly introduction to machine learning compilers and optimizershuyenchip.com
- Chip design from the bottom up – Reiner Popeyoutube.com