Scaling works. These researchers are betting billions it isn't enough
Transformers have ruled AI for a decade. But some think world models, pure reinforcement learning or neurosymbolic AI might be a better path to true intelligence
Credit: Getty/aleksandarvelasevic Intelligence is a slippery thing. For millennia, humans assumed it flowed through a fluid, or one continuous sheet crumpled inside the skull. Microscopes later revealed a dizzying network of individual neurons, sculpting intelligence from electrochemical noise to give our brains a certain je ne sais quoi. In the late 1950s, psychologist Frank Rosenblatt designed the perceptron, a brain-inspired algorithm that adjusts the relative strength of its units’ connections with experience. The New York Times described it as “the embryo of an electronic computer”…
saved by
related reading
- Will scaling work?dwarkeshpatel.com
- The Only Important Technology Is The Internet - Kevin Lukevinlu.ai
- The Scaling Hypothesis · Gwern.netgwern.net
- There Are No New Ideas in AI… Only New Datasetsblog.jxmo.io
- Scaling: The State of Play in AIoneusefulthing.org
- The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
- AI Revolution - Transformers and Large Language Models (LLMs)blog.eladgil.com
- Designing AI for Disruptive Scienceasimov.press
- Will scaling work? - by Dwarkesh Patel - Dwarkesh Podcastdwarkesh.com
- A Short History of Artificial Intelligenceevery.to
- Artificial General Intelligence Is Already Herenoemamag.com
- Language Models in Plato's Cave - by Sergey Levinesergeylevine.substack.com