How Much Does It Cost to Train Frontier AI Models? | Epoch AI

The cost of training top AI models has grown 2-3x annually for the past eight years. By 2027, the largest models could cost over a billion dollars.

How much does it cost to train frontier AI models? | Epoch AI Summary of findings The costs of training frontier AI models have grown dramatically in recent years, but there is limited public data on the magnitude and growth of these expenses. In our new paper , we develop a detailed cost model to address this gap, estimating training costs for up to 45 frontier models using three different approaches that account for hardware and energy expenditures, cloud rental costs, and R&D staff expenses, respectively. This work builds upon the cost estimates featured in the 2024 AI Index . Our analysis

saved by

• Eshaan Moorjani
• Keane Moraes

related reading

• Trends in AI: Training Costs and Diffusion Speeddewierwan.github.io
• Small Models Have Arrivedcalv.info
• Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
• My picture of the present in AI — LessWronglesswrong.com
• frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
• AI progress is about to speed up | Epoch AIepoch.ai
• Fermi estimate of future training runsdanieldewey.net
• Navigating the High Cost of AI Compute | Andreessen Horowitza16z.com
• The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
• Training Imperativesdan.io
• Scaling: The State of Play in AIoneusefulthing.org
• Can AI scaling continue through 2030? | Epoch AIepoch.ai