Does the Bitter Lesson Have Limits? | Drew Breunig

Recently, “the bitter lesson” is having a moment. Coined in an essay by Rich Sutton, the bitter lesson is that, “general methods that leverage computation are ultimately the most effective, and by a large margin.” Why is the lesson bitter? Sutton writes:

Aug 1, 2025 AI DESIGN BITTER LESSON Does the Bitter Lesson Have Limits? Recently, “the bitter lesson” is having a moment. Coined in an essay by Rich Sutton , the bitter lesson is that, “general methods that leverage computation are ultimately the most effective, and by a large margin.” Why is the lesson bitter? Sutton writes: The bitter lesson is based on the historical observations that 1) AI researchers have often tried to build knowledge into their agents, 2) this always helps in the short term, and is personally satisfying to the researcher, but 3) in the long run it plateaus and even inhi

saved by

• Nathan Chiu
• 7059

related reading

• The Bitter Lesson – Yuxi on the Wiredyuxi-liu-wired.github.io
• The Bitter Lessonincompleteideas.net
• The Bitter Lessonincompleteideas.net
• The Bitter Lesson - by Finbarr Timbersartfintel.com
• The Bitter Lesson versus The Garbage Can - by Ethan Mollickoneusefulthing.org
• AI Founder's Bitter Lesson. Chapter 1 - History Repeats Itself | Lukas Petersson's bloglukaspetersson.com
• Dario Amodei — "We are near the end of the exponential"dwarkesh.com
• Why Tool AIs Want to Be Agent AIs · Gwern.netgwern.net
• Andrej Karpathy — AGI is still a decade awaydwarkesh.com
• Why AGI Will Not Happen - Tim Dettmerstimdettmers.com
• Dario Amodei — "We are near the end of the exponential"dwarkesh.com
• I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai