$2 H100s: How the GPU Bubble Burst - by Eugene Cheah
latent.space · 4,641 words · saved by 6 readers
H100s used to be $8/hr if you could get them. Now there's 7 different resale markets selling them under $2. What happened?
$2 H100s: How the GPU Rental Bubble Burst Last year, H100s were $8/hr if you could get them. Today, there's 7 different resale markets selling them under $2. What happened? Eugene Cheah Oct 11, 2024 137 18 10 Share Don’t miss Eugene’s responses on the HN and Reddit and Twitter discussions! Swyx’s note: we’re on a roll catching up with former guests! Apart from our recent guest spot on Raza Habib’s chat with Hamel Husain (see our Raza pod here ), we’re delighted for the return of Eugene Cheah (see our pod on RWKV last year ) as a rare guest writer for our newsletter . Eugene has now cofounded F
saved by
related reading
- Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️gpus.llm-utils.org
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- The Economics of Open-Weight Inferencedata.ornn.com
- The Best GPUs for Deep Learning in 2023 — An In-depth Analysistimdettmers.com
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- Why compute might get 10x more expensive in coming yearsdwarkesh.com
- Designing Compute Markets | Kavish Gargkavishgarg.com
- tokens are getting more expensive - by Ethan Dingethanding.substack.com
- Squaretower (@squaretower_) on Xx.com
- Volatility in the GPU rental market - by Neha Desarajuquantfutures.substack.com
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- How to Think About GPUs | How To Scale Your Modeljax-ml.github.io