arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2504.21067cs.GRcs.CVcs.RO

GauSS-MI:用于主动三维重建的高斯泼溅香农互信息

GauSS-MI: Gaussian Splatting Shannon Mutual Information for Active 3D Reconstruction

School of Computing and Data Science, The University of Hong Kong(计算与数据科学学院,香港大学);Division of Robotics, Perception, and Learning, KTH Royal Institute of Technology(机器人、感知与学习 division,皇家理工学院);Faculty of Engineering, The University of Hong Kong(工程学院,香港大学);Centre for Transformative Garment Production, Hong Kong SAR, China(变革性服装生产中心,香港特别行政区,中国)

Yuhan Xie, Yixi Cai, Yinqiang Zhang, Lei Yang, Jia Pan

AI总结:

本文提出GauSS-MI准则,利用香农互信息实时量化每个高斯分布的视觉不确定性以选择下一最佳视角,并集成至主动重建系统,显著提升了三维重建的视觉质量与效率。

摘要:

本研究致力于解决实时主动视角选择与主动三维重建中视觉质量的不确定性量化挑战。视觉质量是三维重建的关键方面。NeRF与3DGS等近期进展显著提升了重建模型的图像渲染质量。然而,高效获取重建输入图像——即选择信息量最大的视角——仍是未解难题,而这对于主动重建至关重要。现有研究多聚焦于几何完整性评估与未知区域探索,未直接评估重建模型内部的视觉不确定性。为填补此空白,本文提出一种概率模型以量化每个高斯分布的视觉不确定性。利用香农互信息,我们构建了GauSS-MI准则,可实时评估新视角的视觉互信息,从而辅助选择下一最佳视角。GauSS-MI被集成至结合视角与运动规划器的主动重建系统中。在多种模拟与真实场景的实验表明,该系统在视觉质量与重建效率上表现卓越。

英文摘要:

This research tackles the challenge of real-time active view selection and uncertainty quantification on visual quality for active 3D reconstruction. Visual quality is a critical aspect of 3D reconstruction. Recent advancements such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have notably enhanced the image rendering quality of reconstruction models. Nonetheless, the efficient and effective acquisition of input images for reconstruction-specifically, the selection of the most informative viewpoint-remains an open challenge, which is crucial for active reconstruction. Existing studies have primarily focused on evaluating geometric completeness and exploring unobserved or unknown regions, without direct evaluation of the visual uncertainty within the reconstruction model. To address this gap, this paper introduces a probabilistic model that quantifies visual uncertainty for each Gaussian. Leveraging Shannon Mutual Information, we formulate a criterion, Gaussian Splatting Shannon Mutual Information (GauSS-MI), for real-time assessment of visual mutual information from novel viewpoints, facilitating the selection of next best view. GauSS-MI is implemented within an active reconstruction system integrated with a view and motion planner. Extensive experiments across various simulated and real-world scenes showcase the superior visual quality and reconstruction efficiency performance of the proposed system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑