Machine Learning for Inverse Graphics – Scene Representation Group
From a single picture, humans reconstruct a mental representation of the underlying 3D scene that is incredibly rich in information such as shape, appearance, physical properties, purpose, how things would feel, smell, sound, etc. These mental representations allow us to understand, navigate, and interact with our environment in our everyday lives. We learn this from little supervision, mainly by interacting with our world and observing the world around us. Emerging neural scene representations aim to build models that replicate this behavior: Trained in a self-supervised manner, the goal is to reconstruct rich representations of 3D scenes that can then be used in downstream tasks such as computer vision, robotics, and graphics. This course covers fundamental and advanced techniques in this field at the intersection of computer vision, computer graphics, and geometric deep learning. It will lay the foundations of how cameras see the world, how we can represent 3D scenes for artificial
Machine Learning for Inverse Graphics – Scene Representation Group Skip to content Teaching Machine Learning for Inverse Graphics 6.S980 fall 2023 Details Syllabus Related Courses Piazza Canvas Course Contents From a single picture, humans reconstruct a mental representation of the underlying 3D scene that is incredibly rich in information such as shape, appearance, physical properties, purpose, how things would feel, smell, sound, etc. These mental representations allow us to understand, navigate, and interact with our environment in our everyday lives. We learn this from little supervision,
Explore this link on the map →saved by
related reading
- NeRF: Neural Radiance Fieldsmatthewtancik.com
- The flavor of the bitter lesson for computer vision - Vincent Sitzmannvincentsitzmann.com
- 3DMV3dmv2023.github.io
- Neural radiance field - Wikipediaen.wikipedia.org
- The Platonic Representation Hypothesisphillipi.github.io
- Foundations of Computer Visionvisionbook.mit.edu
- [2008.05711] Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Darxiv.org
- [2212.02493] Canonical Fields: Self-Supervised Learning of Pose-Canonicalized Neural Fieldsarxiv.org
- 6.S898 Deep Learning, Fall 2023phillipi.github.io
- A New Trick Lets Artificial Intelligence See in 3D | WIREDwired.com
- Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dresearch.nvidia.com
- Learning Generalizable Feature Fields for Mobile Manipulationarxiv.org