flâneur — a map of the web's best reading

Project ideas: Governance during explosive technological growth

lukasfinnveden.substack.com · saved by 1 readers

This is part of a series of lists of projects. The unifying theme is that the projects are not targeted at solving alignment or engineered pandemics but still targeted at worlds where transformative AI is coming in the next 10 years or so. See here for the introductory post. Commonly discussed motivations cited for why rapid AI progress might be scary are: Risks from misalignment. Risk from AI-assisted bioweapons. But even aside from these risks, it seems likely that advanced AI will lead to explosive technological and economic growth across the board, which could lead to a large number of problems emerging at a frighteningly fast pace.1 The growth speed-ups could be extreme. The basic worry is that AI would let us return to a historical trend of super-exponential growth.2 If this happens, I don’t know any reassuring upper limit for how fast growth could go. (Illustratively: Paul Christiano’s suggested definition for slow takeoff is “There will be a complete 4 year interval in which wo

This is part of a series of lists of projects. The unifying theme is that the projects are not targeted at solving alignment or engineered pandemics but still targeted at worlds where transformative AI is coming in the next 10 years or so. See here for the introductory post. Commonly discussed motivations cited for why rapid AI progress might be scary are: Risks from misalignment. Risk from AI-assisted bioweapons. But even aside from these risks, it seems likely that advanced AI will lead to explosive technological and economic growth across the board, which could lead to a large number of pro

Explore this link on the map →