Will scaling work? - by Dwarkesh Patel - Dwarkesh Podcast
dwarkesh.com · 4,545 words · saved by 2 readers
Data bottlenecks, generalization benchmarks, primate evolution, intelligence as compression, world modelers, and other considerations
Blog Will scaling work? Data bottlenecks, generalization benchmarks, primate evolution, intelligence as compression, world modelers, and other considerations Dwarkesh Patel Dec 26, 2023 360 50 33 Share Article voiceover 0:00 -25:43 Audio playback is not supported on your browser. Please upgrade. Listen on Apple Podcasts , Spotify , or any other podcast platform . When should we expect AGI? If we can keep scaling LLMs++ (and get better and more general performance as a result), then there’s reason to expect powerful AIs by 2040 (or much sooner) which can automate most cognitive labor and speed
saved by
related reading
- Will scaling work?dwarkeshpatel.com
- The Scaling Hypothesis · Gwern.netgwern.net
- Ilya Sutskever — We're moving from the age of scaling to the age of researchdwarkesh.com
- AGI is still 30 years away — Ege Erdil & Tamay Besirogludwarkesh.com
- The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
- What will GPT-2030 look like? — AI Alignment Forumalignmentforum.org
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- AI scaling mythsnormaltech.ai
- Scaling: The State of Play in AIoneusefulthing.org
- AI progress is about to speed up | Epoch AIepoch.ai
- As Rocks May Think | Eric Jangevjang.com
- Scaling is subtler than it seemsberen.io