The Shape of Compute Curve
In a recent podcast, Lambda (one of the neoclouds) CTO Stephen Balaban expressed almost bit of a disdain for the critics who wondered whether the hyperscalers or neoclouds are “gaming” the GPU accounting by assuming higher useful lives of the GPUs than warranted. From the podcast: Matt Turck: You’re
In a recent podcast, Lambda (one of the neoclouds) CTO Stephen Balaban expressed almost bit of a disdain for the critics who wondered whether the hyperscalers or neoclouds are “gaming” the GPU accounting by assuming higher useful lives of the GPUs than warranted. From the podcast: Matt Turck: You’re running an H100 at a higher rate because why? Because the demand for compute is so rabid that people will take any? Or the technical depreciation of the product is slower than people thought? What drives that? Stephen Balaban: Well, what’s driving it, I mean, certainly it’s the demand being…
saved by
related reading
- Nobody knows what a used GPU cluster is worthciphertalk.substack.com
- $2 H100s: How the GPU Bubble Burst - by Eugene Cheahlatent.space
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- Clouded Judgement 8.14.26 - Useful Lifecloudedjudgement.substack.com
- Why I don't worry (as much) about big tech's depreciation schedulembi-deepdives.com
- Why compute might get 10x more expensive in coming yearsdwarkesh.com
- Banyan Ventures on X: "There’s a major misconception in the AI infrastructure world right now: that GPUs follow a fixed 4–6 year depreciation curve. They don’t. Not even close. Aravolta highlights what most lenders, operators, and investorsx.com
- Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️gpus.llm-utils.org
- Clouded Judgement 7.3.26 - The End of Compute Scarcity? Not So Fastcloudedjudgement.substack.com
- Nvidia Envy: understanding the GPU gold rushblog.johnluttig.com
- The question everyone in AI asking: How long before a GPU depreciates?cnbc.com
- Volatility in the GPU rental market - by Neha Desarajuquantfutures.substack.com