Where the Bitter Lesson ends | the singularity is nearer
Humanity only has one engineering project, building better engineers than humans. After that, the thing we built can do the engineering. Clips have been making the rounds on Twitter from my second Lex about the “bishop guy” in a chess engine, or a “cone guy” in a self driving car. These engineering ideas look ever more ridiculous. Since the beginning of comma, I wanted to make a machine that could drive cars like a human. Obviously there’s no reference to traffic cones inside human DNA, they learn about them from data. So there shouldn’t be any reference to traffic cones in your codebase. Rich Sutton stated this most iconically in 2019. One thing that should be learned from the bitter lesson is the great power of general purpose methods, of methods that continue to scale with increased computation even as the available computation becomes very great. The two methods that seem to scale arbitrarily in this way are search and learning. But then where does it stop? Why draw the line at DNA
Humanity only has one engineering project, building better engineers than humans. After that, the thing we built can do the engineering. Clips have been making the rounds on Twitter from my second Lex about the “bishop guy” in a chess engine, or a “cone guy” in a self driving car. These engineering ideas look ever more ridiculous. Since the beginning of comma, I wanted to make a machine that could drive cars like a human. Obviously there’s no reference to traffic cones inside human DNA, they learn about them from data. So there shouldn’t be any reference to traffic cones in your codebase. Rich
Explore this link on the map →related reading
- The Artificial Intelligence Revolution: Part 1 - Wait But Whywaitbutwhy.com
- When AI builds itself \ Anthropicanthropic.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Harness Engineering for Self-Improvement | Lil'Loglilianweng.github.io
- The Coming Technological Singularityedoras.sdsu.edu
- 2023 letter | Zhengdongzhengdongwang.com
- Why Computers Won’t Make Themselves Smarter | The New Yorkernewyorker.com
- Does the Bitter Lesson Have Limits?dbreunig.com
- Surprised by Brains — LessWronglesswrong.com
- Unfalsifiable stories of doom | Mechanize, Inc.mechanize.work
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- Import AI 455: AI systems are about to start building themselves.importai.substack.com