Does the Bitter Lesson Have Limits? | Drew Breunig

Recently, “the bitter lesson” is having a moment. Coined in an essay by Rich Sutton, the bitter lesson is that, “general methods that leverage computation are ultimately the most effective, and by a large margin.” Why is the lesson bitter? Sutton writes:

Aug 1, 2025 AI DESIGN BITTER LESSON Does the Bitter Lesson Have Limits? Recently, “the bitter lesson” is having a moment. Coined in an essay by Rich Sutton , the bitter lesson is that, “general methods that leverage computation are ultimately the most effective, and by a large margin.” Why is the lesson bitter? Sutton writes: The bitter lesson is based on the historical observations that 1) AI researchers have often tried to build knowledge into their agents, 2) this always helps in the short term, and is personally satisfying to the researcher, but 3) in the long run it plateaus and even inhi

saved by

• Nathan Chiu
• Omkar Gadewar

related reading

• The Bitter Lesson – Yuxi on the Wiredyuxi-liu-wired.github.io
• The Bitter Lessonartfintel.com
• The Bitter Lessonincompleteideas.net
• The Bitter Lessonincompleteideas.net
• The Bitter Lesson is Misunderstoodobviouslywrong.substack.com
• The Bitter Lesson versus The Garbage Can - by Ethan Mollickoneusefulthing.org
• AI Founder's Bitter Lesson. Chapter 1 - History Repeats Itself | Lukas Petersson's bloglukaspetersson.com
• Why Tool AIs Want to Be Agent AIs · Gwern.netgwern.net
• As Rocks May Think | Eric Jangevjang.com
• Dario Amodei — "We are near the end of the exponential"dwarkesh.com
• Andrej Karpathy — AGI is still a decade awaydwarkesh.com
• Ilya Sutskever — We're moving from the age of scaling to the age of researchdwarkesh.com