✳flâneur — a map of the web's best reading
Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️
gpus.llm-utils.org · 6,899 words · saved by 4 readers
This post is an exploration of the supply and demand of GPUs, particularly Nvidia H100s.
Table of Contents This post is an exploration of the supply and demand of GPUs, particularly Nvidia H100s. This post went mega viral. It was on the frontpage of HN, techmeme, many email newsletters, got tweets from Andrej Karpathy and others, comments from Mustafa (who will have $1B of GPUs online soon) from Inflection and Emad from Stability, and various asset managers and AI founders reached out. If you haven't read it yet, I hope you enjoy! People who've reached out have told me that it's all pretty accurate, with the exception of the "who has how many GPUs" parts - so please keep that in m
Explore this link on the map →saved by
related reading
- $2 H100s: How the GPU Bubble Burst - by Eugene Cheahlatent.space
- Nvidia Envy: understanding the GPU gold rushblog.johnluttig.com
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- The Best GPUs for Deep Learning in 2023 — An In-depth Analysistimdettmers.com
- IIIa. Racing to the Trillion-Dollar Cluster - SITUATIONAL AWARENESSsituational-awareness.ai
- GB200 Hardware Architecture - Component Supply Chain & BOMsemianalysis.com
- How to Think About GPUs | How To Scale Your Modeljax-ml.github.io
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- Unlocking the full power of NVIDIA H100 GPUs for ML inference with TensorRTbaseten.co
- Nvidia’s Plans To Crush Competition – B100, “X100”, H200, 224G SerDes, OCS, CPO, PCIe 7.0, HBM3Esemianalysis.com
- Volatility in the GPU rental market - by Neha Desarajuquantfutures.substack.com
- H100 vs GB200 NVL72 Training Benchmarks – Power, TCO, and Reliability Analysis, Software Improvement Over Time – SemiAnalysissemianalysis.com