The Brain vs. Deep Learning vs. Singularity
In this blog post I will delve into the brain and explain its basic information processing machinery and compare it to deep learning. I do this by moving step-by-step along with the brains electrochemical and biological information processing pipeline and relating it directly to the architecture of convolutional nets. Thereby we will see that a neuron and a convolutional net are very similar information processing machines. While performing this comparison, I will also discuss the computational complexity of these processes and thus derive an estimate for the brains overall computational power. I will use these estimates, along with knowledge from high performance computing, to show that it is unlikely that there will be a technological singularity in this century. This blog post is complex as it arcs over multiple topics in order to unify them into a coherent framework of thought. I have tried to make this article as readable as possible, but I might have not succeeded in all places.
In this blog post I will delve into the brain and explain its basic information processing machinery and compare it to deep learning. I do this by moving step-by-step along with the brains electrochemical and biological information processing pipeline and relating it directly to the architecture of convolutional nets. Thereby we will see that a neuron and a convolutional net are very similar information processing machines. While performing this comparison, I will also discuss the computational complexity of these processes and thus derive an estimate for the brains overall computational power
Explore this link on the map →related reading
- Neuralink and the Brain's Magical Future — Wait But Whywaitbutwhy.com
- The Unbearable Slowness of Beingarxiv.org
- So how does learning work?cs.mcgill.ca
- How Computationally Complex Is a Single Neuron? | Quanta Magazinequantamagazine.org
- Could a Neuroscientist Understand a Microprocessor? | PLOS Computational Biologyjournals.plos.org
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- https://io0.github.ioio0.github.io
- Artificial Neural Nets Finally Yield Clues to How Brains Learn | Quanta Magazinequantamagazine.org
- Towards deep learning with segregated dendrites | eLifeelifesciences.org
- Analogies between Biology and Deep Learning [rough note] -- colah's blogcolah.github.io
- A deep learning framework for neuroscience - PMCncbi.nlm.nih.gov
- What If We Had Bigger Brains? Imagining Minds beyond Ours-Stephen Wolfram Writingswritings.stephenwolfram.com