Self-Verification, The Key to AI
It is a bit unseemly for an AI researcher to claim to have a special insight or plan for how his field should proceed. If he has such, why doesn't he just pursue it and, if he is right, exhibit its special fruits? Without denying that, there is still a role for assessing and analyzing the field as a whole, for diagnosing the ills that repeatedly plague it, and to suggest general solutions. The insight that I would claim to have is that the key to a successful AI is that it can tell for itself whether or not it is working correctly. At one level this is a pragmatic issue. If the AI can't tell for itself whether it is working properly, then some person has to make that assessment and make any necessary modifications. An AI that can assess itself may be able to make the modifications itself. The Verification Principle: Successful verification occurs in all search-based AI systems, such as planners, game-players, even genetic algorithms. Deep Blue, for example, produces a score for each of
Self-Verification, The Key to AI Verification, The Key to AI by Rich Sutton November 15, 2001 It is a bit unseemly for an AI researcher to claim to have a special insight or plan for how his field should proceed. If he has such, why doesn't he just pursue it and, if he is right, exhibit its special fruits? Without denying that, there is still a role for assessing and analyzing the field as a whole, for diagnosing the ills that repeatedly plague it, and to suggest general solutions. The insight that I would claim to have is that the key to a successful AI is that it can tell for itself whether
Explore this link on the map →saved by
related reading
- Verificationincompleteideas.net
- Asymmetry of verification and verifier’s rule - Jason Weijasonwei.net
- 2023 letter | Zhengdongzhengdongwang.com
- AI 2027ai-2027.com
- When AI Writes the World's Software, Who Verifies It? — Leonardo de Mouraleodemoura.github.io
- [2004.07213] Toward Trustworthy AI Development: Mechanisms for Supporting Verifiable Claimsarxiv.org
- [1911.01547] On the Measure of Intelligencearxiv.org
- Current AIs seem pretty misaligned to me — LessWronglesswrong.com
- AI 2027ai-2027.com
- Current AIs seem pretty misaligned to meblog.redwoodresearch.org
- AI Safety Seems Hard to Measurecold-takes.com
- Import AIjack-clark.net