Curve Circuits
distill.pub · 646 words · saved by 1 readers
Reverse engineering the curve detection algorithm from InceptionV1 and reimplementing it from scratch.
Curve Circuits Distill Curve Circuits We reverse engineer a non-trivial learned algorithm from the weights of a neural network and use its core ideas to craft an artificial artificial neural network from scratch that reimplements it. Artificial Curve Neurons Natural InceptionV1 Curve Neurons We can compare the curve detectors in a neural network we hand-crafted with the curve detectors in InceptionV1 by measuring how they activate to synthetic curve stimuli. We see that across a range of radii and orientations, our artificial curve neurons approximate the natural ones. Authors Affiliations Nic
related reading
- Zoom In: An Introduction to Circuitsdistill.pub
- Curve Detectorsdistill.pub
- An Overview of Early Vision in InceptionV1distill.pub
- Multimodal Neurons in Artificial Neural Networksdistill.pub
- Naturally Occurring Equivariance in Neural Networksdistill.pub
- Circuit Tracing: Revealing Computational Graphs in Language Modelstransformer-circuits.pub
- Visualizing Weightsdistill.pub
- Distill — Latest articles about machine learningdistill.pub
- Language Model Circuits Are Sparse in the Neuron Basis | Transluce AItransluce.org
- Transformer Circuits Threadtransformer-circuits.pub
- What if not Circuits? — LessWronglesswrong.com
- The World Inside Neural Networksgoodfire.ai