flâneur — a map of the web's best reading

Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion?

forethought.org · 2,311 words · saved by 1 readers

Once AI fully automates AI R&D, there might be a period of fast and accelerating software progress – a software intelligence explosion. One objection to this is that it takes a long time to train AI systems from scratch. Would retraining each new generation of AI stop progress accelerating during a software intelligence explosion? If not, would it significantly delay a software intelligence explosion? This post investigates this objection. Using a theoretical analysis and some spreadsheet models, I argue that retraining won’t stop software progress from accelerating over time, but does make it less likely that a software intelligence explosion happens in shorter than 10 months.

Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion? Tom Davidson Citations Cite Citations PDF Contact 26th March 2025 Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion? Summary Theoretical analysis Toy model of the software intelligence explosion Software explosion with continuous retraining - model explanation Software explosion without retraining – model explanation Comparing the two scenarios Synthesis [AI Narration] Will the Need to Retrain AI Models from Scratch Block a Software Intelligence Explosion? Playback spe

Explore this link on the map →

saved by

related reading