How Much Does It Cost to Train Frontier AI Models? | Epoch AI
epoch.ai · 1,485 words · saved by 2 readers
The cost of training top AI models has grown 2-3x annually for the past eight years. By 2027, the largest models could cost over a billion dollars.
How much does it cost to train frontier AI models? | Epoch AI Summary of findings The costs of training frontier AI models have grown dramatically in recent years, but there is limited public data on the magnitude and growth of these expenses. In our new paper , we develop a detailed cost model to address this gap, estimating training costs for up to 45 frontier models using three different approaches that account for hardware and energy expenditures, cloud rental costs, and R&D staff expenses, respectively. This work builds upon the cost estimates featured in the 2024 AI Index . Our analysis
saved by
related reading
- AI progress is about to speed up | Epoch AIepoch.ai
- Can AI scaling continue through 2030? | Epoch AIepoch.ai
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- Trends in AI: Training Costs and Diffusion Speeddewierwan.github.io
- Frontier labs don’t use most AI compute (yet) - by Josh Youepochai.substack.com
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- Training Imperativesdan.io
- The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
- Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
- Why compute might get 10x more expensive in coming yearsdwarkesh.com
- How Much Energy Will It Take To Power AI? | Contrary Researchcontrary.com
- Fermi estimate of future training runsdanieldewey.net