Scaling works. These researchers are betting billions it isn't enough
Transformers have ruled AI for a decade. But some think world models, pure reinforcement learning or neurosymbolic AI might be a better path to true intelligence
Credit: Getty/aleksandarvelasevic Intelligence is a slippery thing. For millennia, humans assumed it flowed through a fluid, or one continuous sheet crumpled inside the skull. Microscopes later revealed a dizzying network of individual neurons, sculpting intelligence from electrochemical noise to give our brains a certain je ne sais quoi. In the late 1950s, psychologist Frank Rosenblatt designed the perceptron, a brain-inspired algorithm that adjusts the relative strength of its units’ connections with experience. The New York Times described it as “the embryo of an electronic computer”…
saved by
related reading
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- A Short History of Artificial Intelligenceevery.to
- There Are No New Ideas in AI… Only New Datasetsblog.jxmo.io
- What I've Learned About AI in the Past Two Months.sheracaolity.ghost.io
- As Rocks May Think | Eric Jangevjang.com
- Ilya Sutskever — We're moving from the age of scaling to the age of researchdwarkesh.com
- AI Revolution - Transformers and Large Language Models (LLMs)blog.eladgil.com
- GenAI Handbookgenai-handbook.github.io
- The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
- Artificial General Intelligence Is Already Herenoemamag.com
- Language Models in Plato's Cave - by Sergey Levinesergeylevine.substack.com
- Memory makes computation universal, remember?thinks.lol