Instrumental convergence
Instrumental convergence is the hypothetical tendency of sufficiently intelligent, goal-directed beings (human and nonhuman) to pursue similar sub-goals (such as survival or resource acquisition), even if their ultimate goals are quite different. More precisely, beings with agency may pursue similar instrumental goals—goals which are made in pursuit of some particular end, but are not the end goals themselves—because it helps accomplish end goals.
Instrumental convergence - Wikipedia Jump to content From Wikipedia, the free encyclopedia Hypothesis about intelligent agents Instrumental convergence is the hypothetical tendency of sufficiently intelligent, goal-directed beings (human and nonhuman) to pursue similar sub-goals (such as survival or resource acquisition), even if their ultimate goals are quite different. [ 1 ] More precisely, beings with agency may pursue similar instrumental goals —goals which are made in pursuit of some particular end, but are not the end goals themselves—because it helps accomplish end goals. Instrumental c
related reading
- Instrumental convergence — LessWronglesswrong.com
- Why Tool AIs Want to Be Agent AIs · Gwern.netgwern.net
- Why AIs aren't power-seeking yet — LessWronglesswrong.com
- The hot mess theory of AI misalignment: More intelligent agents behave less coherently | Jascha’s blogsohl-dickstein.github.io
- After Orthogonality: Virtue-Ethical Agency and AI Alignmentthegradient.pub
- Explore: AI alignmentarbital.greaterwrong.com
- Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
- why assume AGIs will optimize for fixed goals? — LessWronglesswrong.com
- Orthogonality Thesis — LessWronglesswrong.com
- Instrumental and value rationality - Wikipediaen.wikipedia.org
- Towards a scale-free theory of intelligent agency — AI Alignment Forumalignmentforum.org
- Terminal Values and Instrumental Values — LessWronglesswrong.com