Reverse Engineering a Neural Network's Clever Solution to Binary Addition - Casey Primozic's Homepage

While training small neural networks to perform binary addition, a surprising solution emerged that allows the network to solve the problem very effectively. This post explores the mechanism behind that solution and how it relates to analog electronics.

Reverse Engineering a Neural Network's Clever Solution to Binary Addition - Casey Primozic's Homepage cprimozic.net | @ameobea10 cprimozic.net @ameobea10 • Portfolio • Contact • Blog • Professional Experience Reverse Engineering a Neural Network's Clever Solution to Binary Addition 2023-01-15 Subscribe to Blog via RSS Training the Network Unique Activation Functions Dissecting the Model The Network's Clever Solution Summary Epilogue There's a ton of attention lately on massive neural networks with billions of parameters, and rightly so. By combining huge parameter counts with powerful architec

saved by

• Cole Killian

related reading

• Neural networks and deep learningneuralnetworksanddeeplearning.com
• Zoom In: An Introduction to Circuitsdistill.pub
• Jane Street Blog - Can you reverse engineer our neural network?blog.janestreet.com
• A Geometric Calculator Inside a Neural Networkgoodfire.ai
• A Recipe for Training Neural Networkskarpathy.github.io
• CS231n Deep Learning for Computer Visioncs231n.github.io
• Simple arithmetic addition with neural networks | Andy Kongandykong.org
• [2602.16849] On the Mechanism and Dynamics of Modular Addition: Fourier Features, Lottery Ticket, and Grokkingarxiv.org
• A Recipe for Training Neural Networkskarpathy.github.io
• A Mechanistic Interpretability Analysis of Grokking — AI Alignment Forumalignmentforum.org
• Ping pong computation in superposition — LessWronglesswrong.com
• Neural networks and deep learningneuralnetworksanddeeplearning.com