The real data wall is billions of years of evolution
dynomight.net · 1,950 words · saved by 2 readers
Careful with those human analogies
Say you have a time machine. You can only use it once, to send a single idea back to 2005. If you wanted to speed up the development of AI, what would you send back? Many people suggest attention or transformers. But I’m convinced that the answer is “brute-force”—to throw as much data at the problem as possible. AI has recently been improving at a harrowing rate. If trends hold, we are in for quite a show. But some suggest AI progress might falter due to a “data wall”. Current language models are trained on datasets fast approaching “all the text, ever”. What happen when it runs out? Many…
saved by
related reading
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- There Are No New Ideas in AI… Only New Datasetsblog.jxmo.io
- Ilya Sutskever — We're moving from the age of scaling to the age of researchdwarkesh.com
- A Short History of Artificial Intelligenceevery.to
- Data bottlenecks won’t prevent an intelligence explosionnewsletter.forethought.org
- The Only Important Technology Is The Internet - Kevin Lukevinlu.ai
- The Artificial Intelligence Revolution: Part 1 - Wait But Whywaitbutwhy.com
- Will scaling work? - by Dwarkesh Patel - Dwarkesh Podcastdwarkesh.com
- The data black hole at the center of AIdwarkesh.com
- Will scaling work?dwarkeshpatel.com
- Norman Mu | The Myth of Data Inefficiency in Large Language Modelsnormanmu.com
- Language Models in Plato's Cave - by Sergey Levinesergeylevine.substack.com