Multimodal Neurons in Artificial Neural Networks

We report the existence of multimodal neurons in artificial neural networks, similar to those found in the human brain.

Multimodal Neurons in Artificial Neural Networks Distill Multimodal Neurons in Artificial Neural Networks Authors Affiliations Gabriel Goh OpenAI Nick Cammarata † OpenAI Chelsea Voss † OpenAI Shan Carter Observable Michael Petrov OpenAI Ludwig Schubert Alec Radford OpenAI Chris Olah Published March 4, 2021 DOI 10.23915/distill.00030 li")].map(node => node.id)` --> Acknowledgments We are deeply grateful to Sandhini Agarwal, Daniela Amodei, Dario Amodei, Tom Brown, Jeff Clune, Steve Dowling, Gretchen Krueger, Brice Menard, Reiichiro Nakano, Aditya Ramesh, Pranav Shyam, Ilya Sutskever and Martin

saved by

• Niranjana S
• Thi Vũ
• Noah T

related reading

• Feature Visualizationdistill.pub
• The Building Blocks of Interpretabilitydistill.pub
• Naturally Occurring Equivariance in Neural Networksdistill.pub
• Toy Models of Superpositiontransformer-circuits.pub
• Distill — Latest articles about machine learningdistill.pub
• Zoom In: An Introduction to Circuitsdistill.pub
• The World Inside Neural Networksgoodfire.ai
• Language models can explain neurons in language modelsopenaipublic.blob.core.windows.net
• A deep learning framework for neuroscience - PMCncbi.nlm.nih.gov
• Feature Visualizationdistill.pub
• Visualizing Weightsdistill.pub
• Dimensionality reduction in neural data analysisxcorr.net