We present NARUTO, a neural active reconstruction system that combines a hybrid neural representation with uncertainty learning, enabling high-fidelity surface reconstruction. Our approach leverages a multi-resolution hash-grid as the mapping backbone, chosen for its exceptional convergence speed and capacity to capture high-frequency local features.The centerpiece of our work is the incorporation of an uncertainty learning module that dynamically quantifies reconstruction uncertainty while actively reconstructing the environment. By harnessing learned uncertainty, we propose a novel uncertainty aggregation strategy for goal searching and efficient path planning. Our system autonomously explores by targeting uncertain observations and reconstructs environments with remarkable completeness and fidelity. We also demonstrate the utility of this uncertainty-aware approach by enhancing SOTA neural SLAM systems through an active ray sampling strategy. Extensive evaluations of NARUTO in various environments, using an indoor scene simulator, confirm its superior performance and state-of-the-art status in active reconstruction, as evidenced by its impressive results on benchmark datasets like Replica and MP3D.
Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimization
School of Mechanical Engineering and Automation, Harbin Institute of Technology Shenzhen(哈尔滨工业大学(深圳)机械工程与自动化学院);Shenzhen University General Hospital(深圳大学总医院)
Multi-robot autonomous 3D reconstruction using Gaussian splatting with Semantic guidance
College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院);College of Information Engineering, Zhejiang University of Technology(浙江工业大学信息工程学院)
Uncertainty Quantification for Cardiac Shape Reconstruction with Deep Signed Distance Functions via MCMC methods
Department of Mathematics and Scientific Computing, University of Graz, Austria(格拉茨大学数学与科学计算系,奥地利);PRIN-PNRR project no. P2022N5ZNP(PRIN-PNRR项目编号P2022N5ZNP);INdAM-GNCS
Leveraging Geometric Prior Uncertainty and Complementary Constraints for High-Fidelity Neural Indoor Surface Reconstruction
Department of Automation, Shanghai Jiao Tong University(自动化系,上海交通大学);Department of Mechanical and Automation Engineering and T Stone Robotics Institute, The Chinese University of Hong Kong(机械与自动化工程系及T Stone机器人研究所,香港中文大学)
Bayesian Uncertainty Estimation of Learned Variational MRI Reconstruction
Graz University of Technology(格拉茨技术大学);Silicon Austria Labs(奥地利硅谷实验室);University of Bonn(波恩大学);Johannes Kepler University(约翰·开普勒大学);Technical University of Munich(慕尼黑工业大学);Imperial College London(伦敦帝国理工学院);NYU School of Medicine(纽约大学医学院)
DynActiveGS: Active Gaussian Splatting for Dynamic Scene Reconstruction
Tsinghua University, Shenzhen International Graduate School(清华大学深圳国际研究生院);Huawei Technologies Ltd(华为技术有限公司);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Peng Cheng Laboratory(鹏城实验室)
MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation
Imperial College London(伦敦帝国学院);Royal Brompton Hospital(皇家布朗普顿医院);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);University of Cambridge(剑桥大学)
GURecon: Learning Detailed 3D Geometric Uncertainties for Neural Surface Reconstruction
Zesong Yang 1(第一作者单位);Ru Zhang 1(第一作者单位);Jiale Shi 1(第一作者单位);Zixiang Ai 1(第一作者单位);Boming Zhao 1(第一作者单位);Hujun Bao 1(第一作者单位);Luwei Yang 2(第二作者单位);Zhaopeng Cui 1(第一作者单位)
Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction
Finnish Center for Artificial Intelligence (FCAI)(芬兰人工智能中心);ELLIS Unit Helsinki(欧洲学习与智能系统研究所赫尔辛基分部);University of Helsinki(赫尔辛基大学);Institute for Urban Studies (Urbaria)(城市研究所);Institute of Sustainability Science (HELSUS)(可持续发展科学研究所)
Trustworthy MRI Reconstruction via Bayesian Uncertainty Quantification with Sparsity Prior Models
Department of Computer Science, University of Exeter(埃克塞特大学计算机科学系);UCL Hawkes Institute, Department of Computer Science, University College London(伦敦大学学院计算机科学系霍克斯研究所)
Sparse Gain Radio Map Reconstruction With Geometry Priors and Uncertainty-Guided Measurement Selection
National Key Laboratory of Wireless Communications, University of Electronic Science and Technology of China (UESTC)(电子科技大学通信抗干扰全国重点实验室);University of Electronic Science and Technology of China (UESTC)(电子科技大学);Department of Information Science Technology, University of Houston(休斯顿大学信息科学与技术系);School of Science, Technology and Engineering, University of the Sunshine Coast(阳光海岸大学科学、技术与工程学院);ZGC Institute of Ubiquitous-X Innovation and Applications(中关村泛在融合创新研究院)
Department of Computer Science, University of Exeter, UK(埃克塞特大学计算机科学系,英国);UCL Hawkes Institute, Department of Computer Science, University College London, UK(伦敦大学学院霍克斯研究所,计算机科学系,英国)
GauSS-MI: Gaussian Splatting Shannon Mutual Information for Active 3D Reconstruction
School of Computing and Data Science, The University of Hong Kong(计算与数据科学学院,香港大学);Division of Robotics, Perception, and Learning, KTH Royal Institute of Technology(机器人、感知与学习 division,皇家理工学院);Faculty of Engineering, The University of Hong Kong(工程学院,香港大学);Centre for Transformative Garment Production, Hong Kong SAR, China(变革性服装生产中心,香港特别行政区,中国)
U-DAVI: Uncertainty-Aware Diffusion-Prior-Based Amortized Variational Inference for Image Reconstruction
Computing and Mathematical Sciences, California Institute of Technology(计算与数学科学系,加州理工学院);Mathematical Sciences, California Institute of Technology(数学科学系,加州理工学院)