A critique of pure learning and what artificial neural networks can learn from animal brains
Recent gains in artificial neural networks rely heavily on large amounts of training data. Here, the author suggests that for AI to learn from animal brains, it is important to consider that animal behaviour results from brain connectivity specified in the genome through evolution, and not due to unique learning algorithms.
Download PDF Subjects Computer science Network models Abstract Artificial neural networks (ANNs) have undergone a revolution, catalyzed by better supervised learning algorithms. However, in stark contrast to young animals (including humans), training such networks requires enormous numbers of labeled examples, leading to the belief that animals must rely instead mainly on unsupervised learning. Here we argue that most animal behavior is not the result of clever learning algorithms—supervised or unsupervised—but is encoded in the genome. Specifically, animals are born with highly structured bra
saved by
related reading
- A Recipe for Training Neural Networkskarpathy.github.io
- Artificial Neural Nets Finally Yield Clues to How Brains Learn | Quanta Magazinequantamagazine.org
- A Recipe for Training Neural Networkskarpathy.github.io
- You can’t imitation-learn how to continual-learn — LessWronglesswrong.com
- So how does learning work?cs.mcgill.ca
- Human-like Neural Nets by Catapulting · Gwern.netgwern.net
- Analogies between Biology and Deep Learning [rough note] -- colah's blogcolah.github.io
- How our data shaped neural architecture discovery, and how automation can reshape the future | Core Automationcoreauto.com
- Inferring neural activity before plasticity as a foundation for learning beyond backpropagation.mrcbndu.ox.ac.uk
- Building machines that learn and think like people | Behavioral and Brain Sciences | Cambridge Corecambridge.org
- nn-notes.pdfboris-hanin.github.io
- Artificial intelligence by mimicking natural intelligencesubstack.com