The World Inside Neural Networks

How neural geometry will unlock understanding and control of AI

The World Inside Neural Networks Research The Neural Geometry Series → The World Inside Neural Networks How neural geometry will unlock understanding and control of AI Authors Atticus Geiger * Ekdeep Singh Lubana * Thomas Fel * Jack Merullo * Michael Jae Byun * Owen Lewis * Tom McGrath * Correspondence to atticus@goodfire.ai, ekdeep@goodfire.ai Published May 7, 2026 --> Our world is full of objects and richly structured geometric relationships—the color wheel, road networks, family trees, months of the year—and humans use structured mental concepts to represent and navigate this complex realit

saved by

• Uzay Girit
• Timothy Kostolansky
• Vihan Tiwari
• Rohan Prakash
• Jack Hogan
• Sean Lee

related reading

• Steering Along Manifolds to Control Neural Networksgoodfire.ai
• Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
• Toy Models of Superpositiontransformer-circuits.pub
• Zoom In: An Introduction to Circuitsdistill.pub
• The Building Blocks of Interpretabilitydistill.pub
• A Geometric Calculator Inside a Neural Networkgoodfire.ai
• Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
• Towards Monosemanticity: Decomposing Language Models With Dictionary Learningtransformer-circuits.pub
• Transformer Circuits Threadtransformer-circuits.pub
• Feature Visualizationdistill.pub
• Language models can explain neurons in language modelsopenaipublic.blob.core.windows.net
• [2602.15029] Symmetry in language statistics shapes the geometry of model representationsarxiv.org