The Shape of Compute Curve
In a recent podcast, Lambda (one of the neoclouds) CTO Stephen Balaban expressed almost bit of a disdain for the critics who wondered whether the hyperscalers or neoclouds are “gaming” the GPU accounting by assuming higher useful lives of the GPUs than warranted. From the podcast: Matt Turck: You’re
In a recent podcast, Lambda (one of the neoclouds) CTO Stephen Balaban expressed almost bit of a disdain for the critics who wondered whether the hyperscalers or neoclouds are “gaming” the GPU accounting by assuming higher useful lives of the GPUs than warranted. From the podcast: Matt Turck: You’re running an H100 at a higher rate because why? Because the demand for compute is so rabid that people will take any? Or the technical depreciation of the product is slower than people thought? What drives that? Stephen Balaban: Well, what’s driving it, I mean, certainly it’s the demand being…
saved by
related reading
- Nobody knows what a used GPU cluster is worthciphertalk.substack.com
- Hyperscalers vs AI Labs Debate, and the Moving AI Frontiermbi-deepdives.com
- $2 H100s: How the GPU Bubble Burst - by Eugene Cheahlatent.space
- Clouded Judgement 7.3.26 - The End of Compute Scarcity? Not So Fastcloudedjudgement.substack.com
- Why compute might get 10x more expensive in coming yearsdwarkesh.com
- Clouded Judgement 8.14.26 - Useful Lifecloudedjudgement.substack.com
- Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️gpus.llm-utils.org
- Why I don't worry (as much) about big tech's depreciation schedulembi-deepdives.com
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- Designing Compute Markets | Kavish Gargkavishgarg.com
- The question everyone in AI asking: How long before a GPU depreciates?cnbc.com