What's Wrong with Artificial Intelligence
I hold that AI has gone astray by neglecting its essential objective --- the turning over of responsibility for the decision-making and organization of the AI system to the AI system itself. It has become an accepted, indeed lauded, form of success in the field to exhibit a complex system that works well primarily because of some insight the designers have had into solving a particular problem. This is part of an anti-theoretic, or "engineering stance", that considers itself open to any way of solving a problem. But whatever the merits of this approach as engineering, it is not really addressing the objective of AI. For AI it is not enough merely to achieve a better system; it matters how the system was made. The reason it matters can ultimately be considered a practical one, one of scaling. An AI system too reliant on manual tuning, for example, will not be able to scale past what can be held in the heads of a few programmers. This, it seems to me, is essentially the situation we are
What's Wrong with Artificial Intelligence What's Wrong with Artificial Intelligence Rich Sutton November 12, 2001 I hold that AI has gone astray by neglecting its essential objective --- the turning over of responsibility for the decision-making and organization of the AI system to the AI system itself. It has become an accepted, indeed lauded, form of success in the field to exhibit a complex system that works well primarily because of some insight the designers have had into solving a particular problem. This is part of an anti-theoretic, or "engineering stance", that considers itself open t
related reading
- 2023 letter | Zhengdongzhengdongwang.com
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- What failure looks like — LessWronglesswrong.com
- Current AIs seem pretty misaligned to meblog.redwoodresearch.org
- Sporadicamichaelnotebook.com
- The Problem — LessWronglesswrong.com
- What failure looks like — AI Alignment Forumalignmentforum.org
- AI Safety for Fleshy Humans: a whirlwind touraisafety.dance
- [2104.12871] Why AI is Harder Than We Thinkarxiv.org
- Diffusion of Responsibilitytante.cc
- What is AI alignment? - by Adam Jones - BlueDot Impactblog.bluedot.org
- 2025 Retrospective: AI vs Systems vs Humans | Laurent Bindschaedlerbinds.ch