Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion?
Once AI fully automates AI R&D, there might be a period of fast and accelerating software progress – a software intelligence explosion. One objection to this is that it takes a long time to train AI systems from scratch. Would retraining each new generation of AI stop progress accelerating during a software intelligence explosion? If not, would it significantly delay a software intelligence explosion? This post investigates this objection. Using a theoretical analysis and some spreadsheet models, I argue that retraining won’t stop software progress from accelerating over time, but does make it less likely that a software intelligence explosion happens in shorter than 10 months.
Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion? Tom Davidson Citations Cite Citations PDF Contact 26th March 2025 Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion? Summary Theoretical analysis Toy model of the software intelligence explosion Software explosion with continuous retraining - model explanation Software explosion without retraining – model explanation Comparing the two scenarios Synthesis [AI Narration] Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion? Playback spe
Explore this link on the map →saved by
related reading
- Once AI Research is Automated, Will AI Progress Accelerate?forethought.org
- How Can AI Labs Incorporate Risks From AI Accelerating AI Progress Into Their Responsible Scaling Policies?forethought.org
- The least understood driver of AI progress | Epoch AIepoch.ai
- Will AI R&D Automation Cause a Software Intelligence Explosion?forethought.org
- When AI builds itself \ Anthropicanthropic.com
- AI 2027ai-2027.com
- The software intelligence explosion debate needs experiments | Epoch AIepoch.ai
- Preparing for the Intelligence Explosionforethought.org
- The Artificial Intelligence Revolution: Part 1 - Wait But Whywaitbutwhy.com
- My picture of the present in AI — LessWronglesswrong.com
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- Do the returns to software R&D point towards a singularity? | Epoch AIepochai.org