Dwarkesh Patel on X: "New blackboard lecture w @reinerpope How do chips actually work – starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do. 0:00:00 – Building a multiply-accumulate from logic gates 0:16:20 – Muxes and the cost of https://t.co/OhZlNxdYyz" / X
New blackboard lecture w @reinerpope How do chips actually work – starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do. 0:00:00 – Building a multiply-accumulate from logic gates 0:16:20 – Muxes and the cost of https://t.co/OhZlNxdYyz
Dwarkesh Patel @dwarkesh_sp New blackboard lecture w @ reinerpope How do chips actually work – starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do. 0:00:00 – Building a multiply-accumulate from logic gates 0:16:20 – Muxes and the cost of data movement 0:25:59 – How systolic arrays work 0:39:00 – Clock cycles and pipeline registers 0:51:40 – FPGAs vs ASICs 1:03:14 – Cache vs scratchpad 1:07:16 – Why CPU cores are much bigger than GPU cores 1:11:49 – Brains vs chips 1:15:22 – A GPU is just a bunch of tiny TPUs Look up Dwarkesh P
saved by
related reading
- Chip design from the bottom up – Reiner Popeyoutube.com
- Meta harness makes 10 times better Kimi K3 chipluoluo.ai
- AI Chip Architecturesjacobpeake.com
- How GPT, Claude, and Gemini are actually trained and served – Reiner Popeyoutube.com
- Turing Award Winner: TPU vs GPU vs CPU, Computer Architecture, RISC vs CISC | David Pattersonyoutube.com
- Reiner Pope of MatX on accelerating AI with transformer-optimized chipscheekypint.substack.com
- Tiny TPUtinytpu.com
- Horace He: Building Machine Learning Systems for a Trillion Trillion Floating Point Operationsyoutube.com
- What will computer chips look like in 2045?youtube.com
- How to Think About GPUs | How To Scale Your Modeljax-ml.github.io
- CPU vs GPU vs TPU vs DPU vs QPUyoutube.com
- Inside NVIDIA GPUs: Anatomy of high performance matmul kernels - Aleksa Gordićaleksagordic.com