Can AI Scaling Continue Through 2030? | Epoch AI
We investigate four constraints to scaling AI training: power, chip manufacturing, data, and latency. We predict 2e29 FLOP runs will be feasible by 2030.
Can AI scaling continue through 2030? | Epoch AI Introduction In recent years, the capabilities of AI models have significantly improved. Our research suggests that this growth in computational resources accounts for a significant portion of AI performance improvements . 1 The consistent and predictable improvements from scaling have led AI labs to aggressively expand the scale of training , with training compute expanding at a rate of approximately 4x per year. To put this 4x annual growth in AI training compute into perspective, it outpaces even some of the fastest technological expansions i
Explore this link on the map →saved by
related reading
- Can AI scaling continue through 2030? | Epoch AIepochai.org
- How to Build the Future of AI in the United States | IFPifp.org
- IIIa. Racing to the Trillion-Dollar Cluster - SITUATIONAL AWARENESSsituational-awareness.ai
- My picture of the present in AI — LessWronglesswrong.com
- The Moon Should Be a Computerpalladiummag.com
- Multi-Datacenter Training: OpenAI's Ambitious Plan To Beat Google's Infrastructuresemianalysis.com
- Fermi estimate of future training runsdanieldewey.net
- Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI computedwarkesh.com
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- AI progress is about to speed up | Epoch AIepoch.ai
- Roadmap: The AI data center stack - Bessemer Venture Partnersbvp.com
- Deep Dive: Economics of the AI Build-Out | Contrary Researchresearch.contrary.com