Instrumental convergence
Instrumental convergence is the hypothetical tendency of sufficiently intelligent, goal-directed beings (human and nonhuman) to pursue similar sub-goals (such as survival or resource acquisition), even if their ultimate goals are quite different. More precisely, beings with agency may pursue similar instrumental goals—goals which are made in pursuit of some particular end, but are not the end goals themselves—because it helps accomplish end goals.
Instrumental convergence - Wikipedia Jump to content From Wikipedia, the free encyclopedia Hypothesis about intelligent agents Instrumental convergence is the hypothetical tendency of sufficiently intelligent, goal-directed beings (human and nonhuman) to pursue similar sub-goals (such as survival or resource acquisition), even if their ultimate goals are quite different. [ 1 ] More precisely, beings with agency may pursue similar instrumental goals —goals which are made in pursuit of some particular end, but are not the end goals themselves—because it helps accomplish end goals. Instrumental c
related reading
- Instrumental convergence — LessWronglesswrong.com
- The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agentsnickbostrom.com
- The Artificial Intelligence Revolution: Part 2 - Wait But Whywaitbutwhy.com
- Why AIs aren't power-seeking yet — LessWronglesswrong.com
- Beliefs are Chosen to Serve Goals — LessWronglesswrong.com
- Orthogonality Thesis — LessWronglesswrong.com
- The hot mess theory of AI misalignment: More intelligent agents behave less coherently | Jascha’s blogsohl-dickstein.github.io
- Superintelligence: The Idea That Eats Smart Peopleidlewords.com
- Varieties Of Doomminihf.com
- The Problem — LessWronglesswrong.com
- ⿻ Symbiogenesis vs. Convergent Consequentialism — LessWronglesswrong.com
- Robin Hanson Says You're Going to Liverichardhanania.substack.com