✳flâneur — a map of the web's best reading
Branch Specialization
distill.pub · 3,390 words · saved by 1 readers
When a neural network layer is divided into multiple branches, neurons self-organize into coherent groupings.
Branch Specialization Distill Branch Specialization Authors Affiliations Chelsea Voss OpenAI Gabriel Goh OpenAI Nick Cammarata OpenAI Michael Petrov OpenAI Ludwig Schubert Chris Olah Published April 5, 2021 DOI 10.23915/distill.00024.008 This article is part of the Circuits thread , an experimental format collecting invited short articles and critical commentary delving into the inner workings of neural networks. Visualizing Weights Weight Banding Introduction If we think of interpretability as a kind of “anatomy of neural networks,” most of the circuits thread has involved studying tiny littl
Explore this link on the map →related reading
- Toy Models of Superpositiontransformer-circuits.pub
- Zoom In: An Introduction to Circuitsdistill.pub
- Feature Visualizationdistill.pub
- Neuralink and the Brain's Magical Future — Wait But Whywaitbutwhy.com
- Distill — Latest articles about machine learningdistill.pub
- Analogies between Biology and Deep Learning [rough note] -- colah's blogcolah.github.io
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- Neural Networks, Types, and Functional Programming -- colah's blogcolah.github.io
- A Recipe for Training Neural Networkskarpathy.github.io
- On neural scaling and the quanta hypothesisericjmichaud.com
- Visualizing Weightsdistill.pub
- Naturally Occurring Equivariance in Neural Networksdistill.pub