Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion?
Once AI fully automates AI R&D, there might be a period of fast and accelerating software progress – a software intelligence explosion. One objection to this is that it takes a long time to train AI systems from scratch. Would retraining each new generation of AI stop progress accelerating during a software intelligence explosion? If not, would it significantly delay a software intelligence explosion? This post investigates this objection. Using a theoretical analysis and some spreadsheet models, I argue that retraining won’t stop software progress from accelerating over time, but does make it less likely that a software intelligence explosion happens in shorter than 10 months.
Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion? Tom Davidson Citations Cite Citations PDF Contact 26th March 2025 Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion? Summary Theoretical analysis Toy model of the software intelligence explosion Software explosion with continuous retraining - model explanation Software explosion without retraining – model explanation Comparing the two scenarios Synthesis [AI Narration] Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion? Playback spe
saved by
related reading
- Once AI Research is Automated, Will AI Progress Accelerate?forethought.org
- How quick and big would a software intelligence explosion be?forethought.org
- Will AI R&D Automation Cause a Software Intelligence Explosion?forethought.org
- The least understood driver of AI progress | Epoch AIepoch.ai
- The software intelligence explosion debate needs experiments | Epoch AIepoch.ai
- When AI builds itself \ Anthropicanthropic.com
- Full automation of AI R&D probably yields a large speed up even without a software-only singularityblog.redwoodresearch.org
- Will Compute Bottlenecks Prevent a Software Intelligence Explosion?forethought.org
- AI 2027ai-2027.com
- Three Types of Intelligence Explosionforethought.org
- Preparing for the Intelligence Explosionforethought.org
- II. From AGI to Superintelligence: the Intelligence Explosion - SITUATIONAL AWARENESSsituational-awareness.ai