AI Chip Component Costs: Memory at 63% | Epoch AI | Epoch AI
High-bandwidth memory (HBM) accounts for 63% of AI chip component costs, up from 52% in Q1 2024. Epoch AI's breakdown of component cost shifts across major chip designers.
AI Chip Component Costs: Memory at 63% | Epoch AI | Epoch AI High-bandwidth memory (HBM) has grown from 52% to 63% of total AI chip component spending between Q1 2024 and Q4 2025. These estimates are an average across all AI chips designed by Nvidia, AMD, Google, and Amazon, weighted by production volume. As a share of spend, logic dies stayed roughly flat near 13%, while advanced packaging fell from 19% to 15% and auxiliary components fell from 15% to 9%. In absolute terms, HBM spend across these four designers grew from roughly $12 billion in 2024 to $32 billion in 2025, a faster year-over-y
Explore this link on the map →saved by
related reading
- AI Chip Owners Documentation – Methodology | Epoch AIepoch.ai
- My picture of the present in AI — LessWronglesswrong.com
- An Interview with MatX CEO Reiner Pope About LLM Chipschipstrat.com
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- AI Is Slowing Downwheresyoured.at
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- Jon Y (Asianometry) on Problems And Progress in Semiconductor Manufacturing - Hear This Ideahearthisidea.com
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- Reiner Pope of MatX on accelerating AI with transformer-optimized chipscheekypint.substack.com
- Compute Forecast — AI 2027ai-2027.com
- Lifespan of AI Chips: The $300 Billion Question - CITP Blogblog.citp.princeton.edu
- China's AI Chip Landscape: A Complete Map of Who's Building Whatcrossingriver.substack.com