AI GPUs probably live longer than three years
People who think current AI use is unsustainable often rely on the claim that inference GPUs only last “three years at the most” under load1. The idea here is that once the AI bubble money drains away, current infrastructure will rapidly become obsolete, and there won’t be enough money floating around to buy a whole slate of brand-new GPUs. Inference costs would thus rapidly become way too expensive for current AI products to make any financial sense. Where does this “three years at the most” claim come from? Is it plausible? The original Tom’s Hardware article quotes this tweet from Tech Fund, an anonymous former PM and tech investor, who quotes an anonymous “GenAI principal architect” at Google as saying “if you have a high utilization rate, then constant high utilization rate for a year or two, I think the lifespan will be three years at most”. This screenshot looks like it was from an interview. What interview? I scrolled back to October 2024 on Tech Fund’s Twitter feed and saw a b
People who think current AI use is unsustainable often rely on the claim that inference GPUs only last “three years at the most” under load 1 . The idea here is that once the AI bubble money drains away, current infrastructure will rapidly become obsolete, and there won’t be enough money floating around to buy a whole slate of brand-new GPUs. Inference costs would thus rapidly become way too expensive for current AI products to make any financial sense. Where does this “three years at the most” claim come from? Is it plausible? Sourcing the quote The original Tom’s Hardware article quotes this
Explore this link on the map →saved by
related reading
- The question everyone in AI asking: How long before a GPU depreciates?cnbc.com
- Banyan Ventures on X: "There’s a major misconception in the AI infrastructure world right now: that GPUs follow a fixed 4–6 year depreciation curve. They don’t. Not even close. Aravolta highlights what most lenders, operators, and investorsx.com
- Why I don't worry (as much) about big tech's depreciation schedulembi-deepdives.com
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- My picture of the present in AI — LessWronglesswrong.com
- AI Is Slowing Downwheresyoured.at
- $2 H100s: How the GPU Bubble Burst - by Eugene Cheahlatent.space
- IIIa. Racing to the Trillion-Dollar Cluster - SITUATIONAL AWARENESSsituational-awareness.ai
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- Can AI scaling continue through 2030? | Epoch AIepoch.ai
- Lifespan of AI Chips: The $300 Billion Question - CITP Blogblog.citp.princeton.edu
- How to Sound Like an Expert in Any AI Bubble Debatederekthompson.org