[2409.06843] Universal scale-free representations in human visual cortex
Abstract:How does the human brain encode complex visual information? While previous research has characterized individual dimensions of visual representation in cortex, we still lack a comprehensive understanding of how visual information is organized across the full range of neural population activity. Here, analyzing fMRI responses to natural scenes across multiple individuals, we discover that neural representations in human visual cortex follow a remarkably consistent scale-free organization -- their variance systematically decays as a power law, detected across four orders of magnitude of latent dimensions. This scale-free structure appears consistently across multiple visual regions and across individuals, suggesting it reflects a fundamental organizing principle of visual processing. Critically, when we align neural responses across individuals using hyperalignment, we find that these representational dimensions are largely shared between people, revealing a universal high-dimensional spectrum of visual information that emerges despite individual differences in brain anatomy and visual experience. Traditional analysis approaches in cognitive neuroscience have focused primarily on a small number of high-variance dimensions, potentially missing crucial aspects of visual representation. Our results demonstrate that visual information is distributed across the full dimensionality of cortical activity in a systematic way, suggesting we need to move beyond low-dimensional characterizations to fully understand how the brain represents the visual world. This work reveals a new fundamental principle of neural coding in human visual cortex and highlights the importance of examining neural representations across their full dimensionality.
Abstract:How does the human brain encode complex visual information? While previous research has characterized individual dimensions of visual representation in cortex, we still lack a comprehensive understanding of how visual information is organized across the full range of neural population activity. Here, analyzing fMRI responses to natural scenes across multiple individuals, we discover that neural representations in human visual cortex follow a remarkably consistent scale-free organization -- their variance systematically decays as a power law, detected across four orders of magnitude of
Explore this link on the map →related reading
- The Unbearable Slowness of Beingarxiv.org
- Representational geometry: integrating cognition, computation, and the brain - PMCncbi.nlm.nih.gov
- Feature Visualizationdistill.pub
- Representations in human primary visual cortex drift over time | Nature Communicationsnature.com
- Triple-N Dataset: Non-human Primate Neural Responses to Natural Scenes | bioRxivbiorxiv.org
- The topology of neural activity in mouse visual cortexlev.la
- A Browsable Petascale Reconstruction of the Human Cortexai.googleblog.com
- Simultaneous, cortex-wide and cellular-resolution neuronal population dynamics reveal an unbounded scaling of dimensionality with neuron numberbiorxiv.org
- Multimodal Neurons in Artificial Neural Networksdistill.pub
- Cartoon Epistemology by Steven Lehar (2003) | Qualia Computingqualiacomputing.com
- Cortical representational geometry of diverse tasks reveals subject-specific and subject-invariant cognitive structures | Communications Biologynature.com
- ISTA | Looking beyondista.ac.at