arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.03451cs.CV
收藏

PlanarSplatting:3分钟内完成精确平面表面重建

PlanarSplatting: Accurate Planar Surface Reconstruction in 3 Minutes

Ant Group(蚂蚁集团);University of Louisville(路易斯维尔大学)

Bin Tan, Rui Yu, Yujun Shen, Nan Xue

AI总结:

本文提出 PlanarSplatting,通过直接优化三维平面并将其泼溅为深度与法线图,在3分钟内实现高几何精度的室内多视图表面重建。

摘要:

本文提出了 PlanarSplatting,这是一种用于多视角室内图像的超快且精确的表面重建方法。鉴于三维平面在室内场景中的紧凑性和结构表达能力,我们将三维平面作为主要目标,并开发了一个显式优化框架,通过将三维平面泼溅(splatting)为2.5D深度图和法线图,学习拟合室内场景的预期表面。由于我们的 PlanarSplatting 直接作用于三维平面基元,它消除了平面表面重建对二维/三维平面检测以及平面匹配与跟踪的依赖。此外,得益于基于平面的表示所具有的本质优势,以及平面泼溅函数的基于 CUDA 的实现,PlanarSplatting 可在3分钟内重建一个室内场景,同时具有显著更优的几何精度。凭借我们超快的重建速度,在 ScanNet 和 ScanNet++ 数据集上针对数百个场景开展的最大规模定量评估清楚地证明了本方法的优势。我们相信,这种精确且超快的平面表面重建方法未来将应用于面向表面重建的结构化数据整理。我们的 CUDA 实现代码将公开发布。项目页面:https://icetttb.github.io/PlanarSplatting/

英文摘要:

This paper presents PlanarSplatting, an ultra-fast and accurate surface reconstruction approach for multiview indoor images. We take the 3D planes as the main objective due to their compactness and structural expressiveness in indoor scenes, and develop an explicit optimization framework that learns to fit the expected surface of indoor scenes by splatting the 3D planes into 2.5D depth and normal maps. As our PlanarSplatting operates directly on the 3D plane primitives, it eliminates the dependencies on 2D/3D plane detection and plane matching and tracking for planar surface reconstruction. Furthermore, the essential merits of plane-based representation plus CUDA-based implementation of planar splatting functions, PlanarSplatting reconstructs an indoor scene in 3 minutes while having significantly better geometric accuracy. Thanks to our ultra-fast reconstruction speed, the largest quantitative evaluation on the ScanNet and ScanNet++ datasets over hundreds of scenes clearly demonstrated the advantages of our method. We believe that our accurate and ultrafast planar surface reconstruction method will be applied in the structured data curation for surface reconstruction in the future. The code of our CUDA implementation will be publicly available. Project page: https://icetttb.github.io/PlanarSplatting/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑