Are There Examples of Overhang for Other Technologies?
One major concern about pausing AI development, from a purely safety perspective, is the possibility of hardware overhang.1 Here is the concern as I understand it: Suppose a policy were put in place tomorrow that banned all progress in AI capabilities anywhere in the world for the next five years.2 Afterwards, the ban would be completely lifted. Hardware would continue to progress during this AI pause. Immediately after the pause ended, it would be possible to train new AI systems using significantly more compute than was previously possible, taking advantage of the improved hardware. There would be a period of extremely rapid growth, or perhaps a discontinuity,3 until the capabilities returned to their previous trend. Figure 1 shows a sketch of what we might expect progress to look like. Figure 1: What AI progress might look like if there were a temporary pause in capabilities progress. The ‘overhang’ is the difference between what AI capabilities currently are as a result of the paus
Are There Examples of Overhang for Other Technologies? Jeffrey Heninger Dec 13, 2023 6 3 Share TL;DR: No. What Do I Mean By ‘Overhang’? Hardware Overhang for AI One major concern about pausing AI development, from a purely safety perspective, is the possibility of hardware overhang. 1 Here is the concern as I understand it: Suppose a policy were put in place tomorrow that banned all progress in AI capabilities anywhere in the world for the next five years. 2 Afterwards, the ban would be completely lifted. Hardware would continue to progress during this AI pause. Immediately after the pause end
Explore this link on the map →saved by
related reading
- Comments on Manheim's "What's in a Pause?" — EA Forumforum.effectivealtruism.org
- Policy ideas for mitigating AI risk — EA Forumforum.effectivealtruism.org
- What's in a Pause? — EA Forumforum.effectivealtruism.org
- AI Pause Will Likely Backfire — EA Forumforum.effectivealtruism.org
- How to think about slowing AI — EA Forumforum.effectivealtruism.org
- How could a moratorium fail? — EA Forumforum.effectivealtruism.org
- AI as Normal Technology | Knight First Amendment Instituteknightcolumbia.org
- How Should We Implement an AI Pause? | Sudarsh Kunnavakkamsudarsh.com
- Does AI Progress Have a Speed Limit?—Asteriskasteriskmag.com
- Dario Amodei — Policy on the AI Exponentialdarioamodei.com
- Preparing for the Intelligence Explosionforethought.org
- Preparing for Launch | IFPifp.org