Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️
gpus.llm-utils.org · 6,899 words · saved by 5 readers
This post is an exploration of the supply and demand of GPUs, particularly Nvidia H100s.
Table of Contents This post is an exploration of the supply and demand of GPUs, particularly Nvidia H100s. This post went mega viral. It was on the frontpage of HN, techmeme, many email newsletters, got tweets from Andrej Karpathy and others, comments from Mustafa (who will have $1B of GPUs online soon) from Inflection and Emad from Stability, and various asset managers and AI founders reached out. If you haven't read it yet, I hope you enjoy! People who've reached out have told me that it's all pretty accurate, with the exception of the "who has how many GPUs" parts - so please keep that in m
saved by
related reading
- $2 H100s: How the GPU Bubble Burst - by Eugene Cheahlatent.space
- Nvidia Envy: understanding the GPU gold rushblog.johnluttig.com
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- The Best GPUs for Deep Learning in 2023 — An In-depth Analysistimdettmers.com
- IIIa. Racing to the Trillion-Dollar Cluster - SITUATIONAL AWARENESSsituational-awareness.ai
- How to Think About GPUs | How To Scale Your Modeljax-ml.github.io
- GB200 Hardware Architecture - Component Supply Chain & BOMsemianalysis.com
- Nvidia’s Plans To Crush Competition – B100, “X100”, H200, 224G SerDes, OCS, CPO, PCIe 7.0, HBM3Esemianalysis.com
- Squaretower (@squaretower_) on Xx.com
- The Best GPUs for Deep Learning in 2023 — An In-depth Analysistimdettmers.com