使用平面先验去噪、稳定和完成3D重建
De-noising, Stabilizing and Completing 3D Reconstructions On-the-go using Plane Priors
摘要:
近年来,在机器人和其他移动设备上创建3D地图已成为现实。在线3D重建可以在机器人和AR/VR游戏中实现许多令人兴奋的应用。然而,重建是嘈杂的,通常是不完整的。此外,在深度重建期间,表面随着每个新集成的深度图像而变化,这对物理引擎和路径规划算法构成了重大挑战。本文提出了一种新的,快速和强大的方法来获取和使用有关平面表面的信息,如墙壁,地板和天花板作为一个阶段,在3D重建的基础上签署的距离场。我们的算法恢复干净和准确的表面,减少移动的个别网格顶点造成的噪声在线重建和填充在闭塞和未观察到的地区。我们实现并评估了两种不同的策略来生成平面候选者和两种策略来合并它们。我们的实现经过优化,可以在Tango平板电脑等移动设备上实时运行。在一组广泛的实验中,我们验证了我们的方法在大量的自然环境中工作良好,尽管存在大量的遮挡,杂波和噪声,这些经常发生。我们进一步表明,平面拟合,使在许多情况下,一个有意义的语义分割的现实世界的场景。
英文摘要:
Creating 3D maps on robots and other mobile devices has become a reality in recent years. Online 3D reconstruction enables many exciting applications in robotics and AR/VR gaming. However, the reconstructions are noisy and generally incomplete. Moreover, during onine reconstruction, the surface changes with every newly integrated depth image which poses a significant challenge for physics engines and path planning algorithms. This paper presents a novel, fast and robust method for obtaining and using information about planar surfaces, such as walls, floors, and ceilings as a stage in 3D reconstruction based on Signed Distance Fields. Our algorithm recovers clean and accurate surfaces, reduces the movement of individual mesh vertices caused by noise during online reconstruction and fills in the occluded and unobserved regions. We implemented and evaluated two different strategies to generate plane candidates and two strategies for merging them. Our implementation is optimized to run in real-time on mobile devices such as the Tango tablet. In an extensive set of experiments, we validated that our approach works well in a large number of natural environments despite the presence of significant amount of occlusion, clutter and noise, which occur frequently. We further show that plane fitting enables in many cases a meaningful semantic segmentation of real-world scenes.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。