Point-NeRF: Point-based Neural Radiance Fields
Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct scene geometry via direct network inference. Point-NeRF combines the advantages of these two approaches by using neural 3D point clouds, with associated neural features, to model a radiance field. Point-NeRF can be rendered efficiently by aggregating neural point features near scene surfaces, in a ray marching-based rendering pipeline. Moreover, Point-NeRF can be initialized via direct inference of a pre-trained deep network to produce a neural point cloud; this point cloud can be finetuned to surpass the visual quality of NeRF with 30X faster training time. Point-NeRF can be combined with other 3D reconstruction methods and handles the errors and outliers in such methods via a novel pruning and growing mechanism. Overview of Point-NeRF. (a) From multi-
Point-NeRF: Point-based Neural Radiance Fields --> Visitors: Point-NeRF: Point-based Neural Radiance Fields (CVPR 2022 Oral 🤩🤯🔥) A high performance novel neural radiance representation. Qiangeng Xu , Zexiang Xu , Julien Philip , Sai Bi , Zhixin Shu Kalyan Sunkavalli , Ulrich Neumann Paper Code Oral Presentation @ CVPR 2022 Abstract Volumetric neural rendering methods like NeRF generate high-quality view synthesis results but are optimized per-scene leading to prohibitive reconstruction time. On the other hand, deep multi-view stereo methods can quickly reconstruct scene geometry via direct
Explore this link on the map →related reading
- NeRF: Neural Radiance Fieldsmatthewtancik.com
- Neural radiance field - Wikipediaen.wikipedia.org
- NeRF Explosion 2020 - Frank Dellaertdellaert.github.io
- 3D Gaussian Splatting for Real-Time Radiance Field Renderingrepo-sam.inria.fr
- [2308.04079] 3D Gaussian Splatting for Real-Time Radiance Field Renderingarxiv.org
- NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Cloudsimmortalco.github.io
- 3DMV3dmv2023.github.io
- 2311.15980arxiv.org
- Machine Learning for Inverse Graphics – Scene Representation Groupscenerepresentations.org
- Zip-NeRFjonbarron.info
- [2212.02493] Canonical Fields: Self-Supervised Learning of Pose-Canonicalized Neural Fieldsarxiv.org
- [2207.13807] Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fieldsarxiv.org