Analogies between Biology and Deep Learning [rough note] -- colah's blog

A list of advantages that make understanding artificial nerural networks much easier than biological ones.

Analogies between Biology and Deep Learning [rough note] -- colah's blog Analogies between Biology and Deep Learning [rough note] Posted on Oct 2, 2021 This article is a rough note. Writing rough notes allows me share more content, since polishing takes lots of time. While I hope it's useful, it's likely lower quality and less carefully considered than my usual articles. It's very possible I wouldn't stand by this content if I thought about it more. There are a number of exciting connections between physics and deep learning. Perhaps the most discussed are scaling laws (e.g. Kaplan et al, 2020

saved by

• Winnie Xu
• Raffi Hotter

related reading

• Zoom In: An Introduction to Circuitsdistill.pub
• Neural Networks, Types, and Functional Programming -- colah's blogcolah.github.io
• Neural networks and deep learningneuralnetworksanddeeplearning.com
• [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
• Home - colah's blogcolah.github.io
• Interpretability vs Neuroscience [rough note] -- colah's blogcolah.github.io
• How Computationally Complex Is a Single Neuron? | Quanta Magazinequantamagazine.org
• A critique of pure learning and what artificial neural networks can learn from animal brains | Nature Communicationsnature.com
• Deep learning as program synthesis — LessWronglesswrong.com
• Eric Jang: Don't Mess with Backprop: Doubts about Biologically Plausible Deep Learningblog.evjang.com
• Artificial Neural Nets Finally Yield Clues to How Brains Learn | Quanta Magazinequantamagazine.org
• Book Review: Design Principles of Biological Circuits — LessWronglesswrong.com