flâneur — a map of the web's best reading

The Dark Side of Cognition Hypothesis — LessWrong

lesswrong.com · 5,536 words · saved by 1 readers

It is sometimes claimed that the ultimate, unifying goal of artificial intelligence research is to instantiate human-level cognition in a computational system (e.g., Minsky, 1961; Lake et al, 2017). If artificial general intelligence (AGI) of this sort is ever successfully developed, the consequences would be unimaginable in scope—surely, it would be the most impressive invention of our tool-making species to date. In what follows, I’ll argue that current AI systems almost entirely lack a critical facet of human-level cognition. I’ll discuss the reasons why it is particularly hard for us to recognize—let alone instantiate—this aspect of our cognition, and I'll investigate the predictions that emerge from this sort of account. After sketching this general picture, I'll argue that the framing put forward here ultimately has the potential to unify AI engineering and AI safety as one single project. At the outset, it is worth asking the extent to which cognitive science bears relevance to

x The Dark Side of Cognition Hypothesis — LessWrong Cognitive Science General intelligence Value Learning AI Risk Emergent Behavior ( Emergence ) Human Values Neuromorphic AI Practice & Philosophy of Science AI Frontpage 19 The Dark Side of Cognition Hypothesis by Cameron Berg 3rd Oct 2021 19 min read 1 19 It is sometimes claimed that the ultimate, unifying goal of artificial intelligence research is to instantiate human-level cognition in a computational system (e.g., Minsky, 1961; Lake et al, 2017). If artificial general intelligence (AGI) of this sort is ever successfully developed, the con

Explore this link on the map →

related reading