NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Clouds
This paper proposes NeuralEditor that enables neural radiance fields (NeRFs) natively editable for general shape editing tasks. Despite their impressive results on novel-view synthesis, it remains a fundamental challenge for NeRFs to edit the shape of the scene. Our key insight is to exploit the explicit point cloud representation as the underlying structure to construct NeRFs, inspired by the intuitive interpretation of NeRF rendering as a process that projects or “plots” the associated 3D point cloud to a 2D image plane. To this end, NeuralEditor introduces a novel rendering scheme based on deterministic integration within K-D tree-guided density-adaptive voxels, which produces both high-quality rendering results and precise point clouds through optimization. NeuralEditor then performs shape editing via mapping associated points between point clouds. Extensive evaluation shows that NeuralEditor achieves state-of-the-art performance in both shape deformation and scene morphing tasks.
NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Clouds NeuralEditor : Editing Neural Radiance Fields via Manipulating Point Clouds CVPR 2023 Jun-Kun Chen 1† Jipeng Lyu 2† Yu-Xiong Wang 1 1 University of Illinois at Urbana-Champaign   2 Peking University   † Equal Contribution { junkun3 , yxw }@illinois.edu   lvjipeng@pku.edu.cn Paper Poster Video Benchmark Code --> Human-Guided Shape Deformation Scene Morphing Abstract --> This paper proposes NeuralEditor that enables neural radiance fields (NeRFs) natively editable for general shape editing tasks. Despite th
Explore this link on the map →related reading
- NeRF: Neural Radiance Fieldsmatthewtancik.com
- Neural radiance field - Wikipediaen.wikipedia.org
- Point-NeRF: Point-based Neural Radiance Fieldsxharlie.github.io
- NeRF Explosion 2020 - Frank Dellaertdellaert.github.io
- [2212.02493] Canonical Fields: Self-Supervised Learning of Pose-Canonicalized Neural Fieldsarxiv.org
- 3D Gaussian Splatting for Real-Time Radiance Field Renderingrepo-sam.inria.fr
- [2308.04079] 3D Gaussian Splatting for Real-Time Radiance Field Renderingarxiv.org
- Paper Shaders – Ultra-fast zero-dependency shadersshaders.paper.design
- ReferIt3D: Neural Listeners for Fine-Grained 3D Object Identification in Real-World Scenesecva.net
- [2211.10440] Magic3D: High-Resolution Text-to-3D Content Creationarxiv.org
- Zip-NeRFjonbarron.info
- A New Trick Lets Artificial Intelligence See in 3D | WIREDwired.com