AI Chip Component Costs: Memory at 63% | Epoch AI | Epoch AI
High-bandwidth memory (HBM) accounts for 63% of AI chip component costs, up from 52% in Q1 2024. Epoch AI's breakdown of component cost shifts across major chip designers.
AI Chip Component Costs: Memory at 63% | Epoch AI | Epoch AI High-bandwidth memory (HBM) has grown from 52% to 63% of total AI chip component spending between Q1 2024 and Q4 2025. These estimates are an average across all AI chips designed by Nvidia, AMD, Google, and Amazon, weighted by production volume. As a share of spend, logic dies stayed roughly flat near 13%, while advanced packaging fell from 19% to 15% and auxiliary components fell from 15% to 9%. In absolute terms, HBM spend across these four designers grew from roughly $12 billion in 2024 to $32 billion in 2025, a faster year-over-y
saved by
related reading
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- The AI Chip Supply Chain — A Primerjoshuamuthu.substack.com
- AI Chip Owners Documentation – Methodology | Epoch AIepoch.ai
- The performance per dollar of AI chips purchased each quarter has grown by an average of 49% per yearepoch.ai
- AI Chip Architecturesjacobpeake.com
- The Great AI Silicon Shortagenewsletter.semianalysis.com
- Can AI scaling continue through 2030? | Epoch AIepoch.ai
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- Lifespan of AI Chips: The $300 Billion Question - CITP Blogblog.citp.princeton.edu
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- How much does it cost to train frontier AI models? | Epoch AIepoch.ai
- Computational Power and AI - AI Now Instituteainowinstitute.org