PsyArXiv Preprints | What is "where": Physical reasoning informs object location

A central puzzle the visual system tries to solve is: “what is where?” While a great deal of research attempts to model object recognition (“what”), a comparatively smaller body of work seeks to model object location (“where”), especially in perceiving everyday objects. How do people locate an object, right now, in front of them? In three experiments collecting over 35,000 judgements on stimuli spanning different levels of realism (line drawings, real images, and crude forms), participants clicked “where” an object is, as if pointing to it. We modeled their responses with eight different methods, including both human response-based models (judgements of physical reasoning, spatial memory, free-response “click anywhere” judgements, and judgements of where people would grab the object), and image-based models (uniform distributions over the image, convex hull, saliency map, and medial axis). Physical reasoning was the best predictor of “where,” performing significantly better than even s

OSF

related reading

• When Models Manipulate Manifolds: The Geometry of a Counting Tasktransformer-circuits.pub
• Cartoon Epistemology by Steven Lehar (2003) | Qualia Computingqualiacomputing.com
• Gears in understanding — LessWronglesswrong.com
• Invariant representations of mass in the human brain | eLifeelifesciences.org
• Figure–ground (perception) - Wikipediaen.wikipedia.org
• Target Confusability Competition Modelbradylab.ucsd.edu
• Intuitive experimentation in the physical worldcicl.stanford.edu
• 1 The Challenge of Vision – Foundations of Computer Visionvisionbook.mit.edu
• Can There Be Vague Objects?astrofrelat.fcaglp.unlp.edu.ar
• What is visual-spatial processing?understood.org
• ReferIt3D: Neural Listeners for Fine-Grained 3D Object Identification in Real-World Scenesecva.net
• A Functional Taxonomy of World Models - Dr. Fei-Fei Lidrfeifei.substack.com