Multimodal Neurons in Artificial Neural Networks

We report the existence of multimodal neurons in artificial neural networks, similar to those found in the human brain.

Multimodal Neurons in Artificial Neural Networks Distill Multimodal Neurons in Artificial Neural Networks Authors Affiliations Gabriel Goh OpenAI Nick Cammarata † OpenAI Chelsea Voss † OpenAI Shan Carter Observable Michael Petrov OpenAI Ludwig Schubert Alec Radford OpenAI Chris Olah Published March 4, 2021 DOI 10.23915/distill.00030 li")].map(node => node.id)` --> Acknowledgments We are deeply grateful to Sandhini Agarwal, Daniela Amodei, Dario Amodei, Tom Brown, Jeff Clune, Steve Dowling, Gretchen Krueger, Brice Menard, Reiichiro Nakano, Aditya Ramesh, Pranav Shyam, Ilya Sutskever and Martin

saved by

• Thi Vũ
• Noah T

related reading

• Distill — Latest articles about machine learningdistill.pub
• Feature Visualizationdistill.pub
• The Building Blocks of Interpretabilitydistill.pub
• Toy Models of Superpositiontransformer-circuits.pub
• Home - colah's blogcolah.github.io
• Zoom In: An Introduction to Circuitsdistill.pub
• Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
• Alexa Tartaglini | aboutalexatartaglini.com
• Language models can explain neurons in language modelsopenaipublic.blob.core.windows.net
• Feature Visualizationdistill.pub
• Neural networks and deep learningneuralnetworksanddeeplearning.com
• CLIP Enrichment Circuitsseri-win21-circuits.github.io