The Dark Side of Cognition Hypothesis — LessWrong
It is sometimes claimed that the ultimate, unifying goal of artificial intelligence research is to instantiate human-level cognition in a computational system (e.g., Minsky, 1961; Lake et al, 2017). If artificial general intelligence (AGI) of this sort is ever successfully developed, the consequences would be unimaginable in scope—surely, it would be the most impressive invention of our tool-making species to date. In what follows, I’ll argue that current AI systems almost entirely lack a critical facet of human-level cognition. I’ll discuss the reasons why it is particularly hard for us to recognize—let alone instantiate—this aspect of our cognition, and I'll investigate the predictions that emerge from this sort of account. After sketching this general picture, I'll argue that the framing put forward here ultimately has the potential to unify AI engineering and AI safety as one single project. At the outset, it is worth asking the extent to which cognitive science bears relevance to
x The Dark Side of Cognition Hypothesis — LessWrong Cognitive Science General intelligence Value Learning AI Risk Emergent Behavior ( Emergence ) Human Values Neuromorphic AI Practice & Philosophy of Science AI Frontpage 19 The Dark Side of Cognition Hypothesis by Cameron Berg 3rd Oct 2021 19 min read 1 19 It is sometimes claimed that the ultimate, unifying goal of artificial intelligence research is to instantiate human-level cognition in a computational system (e.g., Minsky, 1961; Lake et al, 2017). If artificial general intelligence (AGI) of this sort is ever successfully developed, the con
Explore this link on the map →related reading
- 2023 letter | Zhengdongzhengdongwang.com
- Neurotechnology is Critical for AI Alignmentmilan.cvitkovic.net
- AI 2027ai-2027.com
- Cyborgism — LessWronglesswrong.com
- Artificial General Intelligence Is Already Herenoemamag.com
- Core views on AI safety: When, why, what, and how \ Anthropicanthropic.com
- Language Models in Plato's Cave - by Sergey Levinesergeylevine.substack.com
- Cognitive Security as an AI Safety Cause Area — LessWronglesswrong.com
- Consciousness in Artificial Intelligencearxiv.org
- Toward a Critical Technical Practicepages.gseis.ucla.edu
- AI as a science, and three obstacles to alignment strategies — LessWronglesswrong.com
- AI will change the world, but won’t take it over by playing “3-dimensional chess”. – Windows On Theorywindowsontheory.org