Instrumental convergence
Instrumental convergence is the hypothetical tendency of sufficiently intelligent, goal-directed beings (human and nonhuman) to pursue similar sub-goals (such as survival or resource acquisition), even if their ultimate goals are quite different. More precisely, beings with agency may pursue similar instrumental goals—goals which are made in pursuit of some particular end, but are not the end goals themselves—because it helps accomplish end goals.
Instrumental convergence - Wikipedia Jump to content From Wikipedia, the free encyclopedia Hypothesis about intelligent agents Instrumental convergence is the hypothetical tendency of sufficiently intelligent, goal-directed beings (human and nonhuman) to pursue similar sub-goals (such as survival or resource acquisition), even if their ultimate goals are quite different. [ 1 ] More precisely, beings with agency may pursue similar instrumental goals —goals which are made in pursuit of some particular end, but are not the end goals themselves—because it helps accomplish end goals. Instrumental c
Explore this link on the map →related reading
- Instrumental convergence — LessWronglesswrong.com
- The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agentsnickbostrom.com
- Why AIs aren't power-seeking yet — LessWronglesswrong.com
- The Artificial Intelligence Revolution: Part 2 - Wait But Whywaitbutwhy.com
- Why Tool AIs Want to Be Agent AIs · Gwern.netgwern.net
- Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
- The hot mess theory of AI misalignment: More intelligent agents behave less coherently | Jascha’s blogsohl-dickstein.github.io
- ⿻ Symbiogenesis vs. Convergent Consequentialism — LessWronglesswrong.com
- Superintelligence: The Idea That Eats Smart Peopleidlewords.com
- P₂B: Plan to P₂B Better — AI Alignment Forumalignmentforum.org
- Varieties Of Doomminihf.com
- Existential risk from artificial intelligence - Wikipediaen.wikipedia.org