Chip design from the bottom up – Reiner Pope - YouTube
Dwarkesh Clips explores the architectural differences between GPUs and TPUs by examining their distinct high-level block structures. The discussion focuses on how each design manages data movement, core organization, and hardware efficiency to support complex computational tasks.
New blackboard lecture with Reiner Pope: how do chips actually work - starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do. Reiner is CEO of MatX, a new chip startup (full disclosure - I’m an angel investor). He was previously at Google, where he worked on software efficiency, compilers, and TPU architecture. 𝐄𝐏𝐈𝐒𝐎𝐃𝐄 𝐋𝐈𝐍𝐊𝐒 * Transcript: https://www.dwarkesh.com/p/reiner-pope-2 𝐒𝐏𝐎𝐍𝐒𝐎𝐑𝐒 * Crusoe was one of only five GPU clouds that made the gold tier in SemiAnalysis' most recent ClusterMAX report.…
saved by
related reading
- How GPT, Claude, and Gemini are actually trained and served – Reiner Popeyoutube.com
- Reiner Pope – The math behind how LLMs are trained and serveddwarkesh.com
- Reiner Pope of MatX on accelerating AI with transformer-optimized chipscheekypint.substack.com
- Turing Award Winner: TPU vs GPU vs CPU, Computer Architecture, RISC vs CISC | David Pattersonyoutube.com
- What will computer chips look like in 2045?youtube.com
- AI Chip Architecturesjacobpeake.com
- An Interview with MatX CEO Reiner Pope About LLM Chipschipstrat.com
- Dwarkesh Patel on X: "New blackboard lecture w @reinerpope How do chips actually work – starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do. 0:00:00 – Building a multiply-ax.com
- AI EDAs: Is It Real?youtube.com
- TPU Deep Divehenryhmko.github.io
- How to Think About GPUs | How To Scale Your Modeljax-ml.github.io
- Tiny TPUtinytpu.com