What's Wrong with Artificial Intelligence
I hold that AI has gone astray by neglecting its essential objective --- the turning over of responsibility for the decision-making and organization of the AI system to the AI system itself. It has become an accepted, indeed lauded, form of success in the field to exhibit a complex system that works well primarily because of some insight the designers have had into solving a particular problem. This is part of an anti-theoretic, or "engineering stance", that considers itself open to any way of solving a problem. But whatever the merits of this approach as engineering, it is not really addressing the objective of AI. For AI it is not enough merely to achieve a better system; it matters how the system was made. The reason it matters can ultimately be considered a practical one, one of scaling. An AI system too reliant on manual tuning, for example, will not be able to scale past what can be held in the heads of a few programmers. This, it seems to me, is essentially the situation we are
What's Wrong with Artificial Intelligence What's Wrong with Artificial Intelligence Rich Sutton November 12, 2001 I hold that AI has gone astray by neglecting its essential objective --- the turning over of responsibility for the decision-making and organization of the AI system to the AI system itself. It has become an accepted, indeed lauded, form of success in the field to exhibit a complex system that works well primarily because of some insight the designers have had into solving a particular problem. This is part of an anti-theoretic, or "engineering stance", that considers itself open t
Explore this link on the map →related reading
- 2023 letter | Zhengdongzhengdongwang.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- AI as Normal Technology | Knight First Amendment Instituteknightcolumbia.org
- The Future Worth Building Is Human - Thinking Machines Labthinkingmachines.ai
- What failure looks like — LessWronglesswrong.com
- Current AIs seem pretty misaligned to meblog.redwoodresearch.org
- Sporadicamichaelnotebook.com
- AI Safety for Fleshy Humans: a whirlwind touraisafety.dance
- 2025 Retrospective: AI vs Systems vs Humans | Laurent Bindschaedlerbinds.ch
- AI will change the world, but won’t take it over by playing “3-dimensional chess”. – Windows On Theorywindowsontheory.org
- Toward a Critical Technical Practicepages.gseis.ucla.edu
- Concerns of an Artificial Intelligence Pioneer | Quanta Magazinequantamagazine.org