Can AI Scaling Continue Through 2030? | Epoch AI
We investigate four constraints to scaling AI training: power, chip manufacturing, data, and latency. We predict 2e29 FLOP runs will be feasible by 2030.
Can AI scaling continue through 2030? | Epoch AI Introduction In recent years, the capabilities of AI models have significantly improved. Our research suggests that this growth in computational resources accounts for a significant portion of AI performance improvements . 1 The consistent and predictable improvements from scaling have led AI labs to aggressively expand the scale of training , with training compute expanding at a rate of approximately 4x per year. To put this 4x annual growth in AI training compute into perspective, it outpaces even some of the fastest technological expansions i
saved by
related reading
- Can AI scaling continue through 2030? | Epoch AIepochai.org
- How to Build the Future of AI in the United States | IFPifp.org
- AI progress is about to speed up | Epoch AIepoch.ai
- Fermi estimate of future training runsdanieldewey.net
- Will scaling work?dwarkeshpatel.com
- IIIa. Racing to the Trillion-Dollar Cluster - SITUATIONAL AWARENESSsituational-awareness.ai
- AI 2027ai-2027.com
- My picture of the present in AI — LessWronglesswrong.com
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- Will scaling work? - by Dwarkesh Patel - Dwarkesh Podcastdwarkesh.com
- Fast, scalable, clean, and cheap enoughoffgridai.us
- Multi-Datacenter Training: OpenAI's Ambitious Plan To Beat Google's Infrastructuresemianalysis.com