Natural scenes | Information processing in biological systems

The efficient coding hypothesis states that sensory neural systems invest resources, such as energy, cells, and neural ‘wiring,’ in proportion to the expected gain of information that can be extracted from the environment. The predictions of this hypothesis can be calculated if we know the distributions of naturalistic signals that the neural system has to detect, encode, transmit and process. According to the hypothesis, our visual systems would presumably be different if they were adapted to a world containing random uncorrelated stimuli, rather than to the world populated with 3D objects that on our retinas create images full of edges, corners and texture. An example image from the Penn Natural Image database. We study statistical structure in natural scenes and ask if evolution has shaped our visual processing pathways to efficiently extract information from natural (but not synthetic random) stimuli. To make quantitative predictions, we therefore study the statistics of natural sc

The efficient coding hypothesis states that sensory neural systems invest resources, such as energy, cells, and neural ‘wiring,’ in proportion to the expected gain of information that can be extracted from the environment. The predictions of this hypothesis can be calculated if we know the distributions of naturalistic signals that the neural system has to detect, encode, transmit and process. According to the hypothesis, our visual systems would presumably be different if they were adapted to a world containing random uncorrelated stimuli, rather than to the world populated with 3D objects th

related reading

• ISTA | Looking beyondista.ac.at
• The Unbearable Slowness of Beingarxiv.org
• Visual Information Theory -- colah's blogcolah.github.io
• Information theory in neuroscience - PMCncbi.nlm.nih.gov
• 1 The Challenge of Vision – Foundations of Computer Visionvisionbook.mit.edu
• When Models Manipulate Manifolds: The Geometry of a Counting Tasktransformer-circuits.pub
• Research - Redwood Center for Theoretical Neuroscienceredwood.berkeley.edu
• https://io0.github.ioio0.github.io
• Natural Abstractions: Key Claims, Theorems, and Critiques — LessWronglesswrong.com
• [2409.06843] Universal scale-free representations in human visual cortexarxiv.org
• To Be Energy-Efficient, Brains Predict Their Perceptions | Quanta Magazinequantamagazine.org
• ​Computational Neuroscience - MIT McGovern Institutemcgovern.mit.edu