AI GPUs probably live longer than three years
People who think current AI use is unsustainable often rely on the claim that inference GPUs only last “three years at the most” under load1. The idea here is that once the AI bubble money drains away, current infrastructure will rapidly become obsolete, and there won’t be enough money floating around to buy a whole slate of brand-new GPUs. Inference costs would thus rapidly become way too expensive for current AI products to make any financial sense. Where does this “three years at the most” claim come from? Is it plausible? The original Tom’s Hardware article quotes this tweet from Tech Fund, an anonymous former PM and tech investor, who quotes an anonymous “GenAI principal architect” at Google as saying “if you have a high utilization rate, then constant high utilization rate for a year or two, I think the lifespan will be three years at most”. This screenshot looks like it was from an interview. What interview? I scrolled back to October 2024 on Tech Fund’s Twitter feed and saw a b
People who think current AI use is unsustainable often rely on the claim that inference GPUs only last “three years at the most” under load 1 . The idea here is that once the AI bubble money drains away, current infrastructure will rapidly become obsolete, and there won’t be enough money floating around to buy a whole slate of brand-new GPUs. Inference costs would thus rapidly become way too expensive for current AI products to make any financial sense. Where does this “three years at the most” claim come from? Is it plausible? Sourcing the quote The original Tom’s Hardware article quotes this
saved by
related reading
- The question everyone in AI asking: How long before a GPU depreciates?cnbc.com
- Banyan Ventures on X: "There’s a major misconception in the AI infrastructure world right now: that GPUs follow a fixed 4–6 year depreciation curve. They don’t. Not even close. Aravolta highlights what most lenders, operators, and investorsx.com
- Why I don't worry (as much) about big tech's depreciation schedulembi-deepdives.com
- AI Is Slowing Downwheresyoured.at
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- My picture of the present in AI — LessWronglesswrong.com
- $2 H100s: How the GPU Bubble Burst - by Eugene Cheahlatent.space
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- IIIa. Racing to the Trillion-Dollar Cluster - SITUATIONAL AWARENESSsituational-awareness.ai
- The Shape of Compute Curvembi-deepdives.com
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- Nvidia Envy: understanding the GPU gold rushblog.johnluttig.com