The World Inside Neural Networks

How neural geometry will unlock understanding and control of AI

The World Inside Neural Networks Research The Neural Geometry Series → The World Inside Neural Networks How neural geometry will unlock understanding and control of AI Authors Atticus Geiger * Ekdeep Singh Lubana * Thomas Fel * Jack Merullo * Michael Jae Byun * Owen Lewis * Tom McGrath * Correspondence to atticus@goodfire.ai, ekdeep@goodfire.ai Published May 7, 2026 --> Our world is full of objects and richly structured geometric relationships—the color wheel, road networks, family trees, months of the year—and humans use structured mental concepts to represent and navigate this complex realit

saved by

• Uzay Girit
• Lydia Nottingham
• Timothy Kostolansky
• Vihan Tiwari
• Rohan Prakash
• Jack Hogan
• Sean Lee

related reading

• Steering Along Manifolds to Control Neural Networksgoodfire.ai
• The Neural Geometry Series - Goodfiregoodfire.com
• Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
• Toy Models of Superpositiontransformer-circuits.pub
• The Linear Representation Hypothesis and the Geometry of Large Language Modelsarxiv.org
• Uncovering Neural Geometry in Vision Models With Block-Sparse Featurizersgoodfire.ai
• Zoom In: An Introduction to Circuitsdistill.pub
• The Building Blocks of Interpretabilitydistill.pub
• Structure and Interpretation of Deep Networkssidn.baulab.info
• Neuronpedianeuronpedia.org
• Language models can explain neurons in language modelsopenaipublic.blob.core.windows.net
• A Geometric Calculator Inside a Neural Networkgoodfire.ai