$2 H100s: How the GPU Bubble Burst - by Eugene Cheah
latent.space · 4,641 words · saved by 6 readers
H100s used to be $8/hr if you could get them. Now there's 7 different resale markets selling them under $2. What happened?
$2 H100s: How the GPU Rental Bubble Burst Last year, H100s were $8/hr if you could get them. Today, there's 7 different resale markets selling them under $2. What happened? Eugene Cheah Oct 11, 2024 137 18 10 Share Don’t miss Eugene’s responses on the HN and Reddit and Twitter discussions! Swyx’s note: we’re on a roll catching up with former guests! Apart from our recent guest spot on Raza Habib’s chat with Hamel Husain (see our Raza pod here ), we’re delighted for the return of Eugene Cheah (see our pod on RWKV last year ) as a rare guest writer for our newsletter . Eugene has now cofounded F
saved by
related reading
- Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️gpus.llm-utils.org
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- Nvidia Envy: understanding the GPU gold rushblog.johnluttig.com
- Squaretower (@squaretower_) on Xx.com
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- Volatility in the GPU rental market - by Neha Desarajuquantfutures.substack.com
- The Best GPUs for Deep Learning in 2023 — An In-depth Analysistimdettmers.com
- Why compute might get 10x more expensive in coming yearsdwarkesh.com
- What's happening to H100 rental prices? - by Neha Desarajusquaretower.substack.com
- tokens are getting more expensive - by Ethan Dingethanding.substack.com
- AI Is Slowing Downwheresyoured.at
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com