Is AI progress slowing down?
normaltech.ai · 3,940 words · saved by 1 readers
Making sense of recent technology trends and claims
By Arvind Narayanan, Benedikt Ströbl, and Sayash Kapoor. After the release of GPT-4 in March 2023, the dominant narrative in the tech world was that continued scaling of models would lead to artificial general intelligence and then superintelligence. Those extreme predictions gradually receded, but up until a month ago, the prevailing belief in the AI industry was that model scaling would continue for the foreseeable future. Then came three back-to-back news reports from The Information, Reuters, and Bloomberg revealing that three leading AI developers — OpenAI, Anthropic, and Google…
related reading
- Will scaling work?dwarkeshpatel.com
- AI progress is about to speed up | Epoch AIepoch.ai
- Scaling: The State of Play in AIoneusefulthing.org
- AI 2027ai-2027.com
- Does AI Progress Have a Speed Limit?—Asteriskasteriskmag.com
- There Are No New Ideas in AI… Only New Datasetsblog.jxmo.io
- AI scaling mythsnormaltech.ai
- Will scaling work? - by Dwarkesh Patel - Dwarkesh Podcastdwarkesh.com
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- My picture of the present in AI — LessWronglesswrong.com
- Is AI hitting a wall?substack.com
- The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com