Analogies between Biology and Deep Learning [rough note] -- colah's blog

A list of advantages that make understanding artificial nerural networks much easier than biological ones.

Analogies between Biology and Deep Learning [rough note] -- colah's blog Analogies between Biology and Deep Learning [rough note] Posted on Oct 2, 2021 This article is a rough note. Writing rough notes allows me share more content, since polishing takes lots of time. While I hope it's useful, it's likely lower quality and less carefully considered than my usual articles. It's very possible I wouldn't stand by this content if I thought about it more. There are a number of exciting connections between physics and deep learning. Perhaps the most discussed are scaling laws (e.g. Kaplan et al, 2020

saved by

• Winnie Xu
• Raffi Hotter
• Harshu Musunuri

related reading

• Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
• A Recipe for Training Neural Networkskarpathy.github.io
• Neural Networks, Types, and Functional Programming -- colah's blogcolah.github.io
• Home - colah's blogcolah.github.io
• Interpretability vs Neuroscience [rough note] -- colah's blogcolah.github.io
• A Recipe for Training Neural Networkskarpathy.github.io
• [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
• Neural networks and deep learningneuralnetworksanddeeplearning.com
• Human-like Neural Nets by Catapulting · Gwern.netgwern.net
• So how does learning work?cs.mcgill.ca
• A short note on interpretability and mindsericjmichaud.com
• You can’t imitation-learn how to continual-learn — LessWronglesswrong.com