交互平面揭示3D线条映射
Interacted Planes Reveal 3D Line Mapping
AI总结:
LiP-Map通过联合优化线条与平面原始语义,实现了高效且准确的3D线条映射,并在多个数据集上提升了重建精度和视觉定位性能。
摘要:
从多视角RGB图像中提取3D线条映射为场景提供了紧凑且结构化的视觉表示。我们从物理和拓扑的角度研究该问题:一个3D线条最自然地表现为有限3D平面补丁的边缘。我们提出了LiP-Map,一种联合优化线条-平面框架,该框架显式地建模可学习的线条和平面原始语义。这种耦合使3D线条映射能够准确且详细地进行,同时保持强大的效率(通常每个场景的重建在3到5分钟内完成)。LiP-Map开创性地将平面拓扑整合到3D线条映射中,不是通过施加成对共面约束,而是通过显式构建平面和线条原始语义之间的交互,从而为人工环境中结构化重建提供了一条原则性的路线。在超过100个场景上,LiP-Map在ScanNetV2、ScanNet++、Hypersim、7Scenes和Tanks\&Temple中均优于最先进的方法。除了线条映射质量外,LiP-Map显著提升了线条辅助的视觉定位,其在7Scenes上表现出强劲的性能。我们的代码已发布在https://github.com/calmke/LiPMAP以供可重复研究。
英文摘要:
3D line mapping from multi-view RGB images provides a compact and structured visual representation of scenes. We study the problem from a physical and topological perspective: a 3D line most naturally emerges as the edge of a finite 3D planar patch. We present LiP-Map, a line-plane joint optimization framework that explicitly models learnable line and planar primitives. This coupling enables accurate and detailed 3D line mapping while maintaining strong efficiency (typically completing a reconstruction in 3 to 5 minutes per scene). LiP-Map pioneers the integration of planar topology into 3D line mapping, not by imposing pairwise coplanarity constraints but by explicitly constructing interactions between plane and line primitives, thus offering a principled route toward structured reconstruction in man-made environments. On more than 100 scenes from ScanNetV2, ScanNet++, Hypersim, 7Scenes, and Tanks\&Temple, LiP-Map improves both accuracy and completeness over state-of-the-art methods. Beyond line mapping quality, LiP-Map significantly advances line-assisted visual localization, establishing strong performance on 7Scenes. Our code is released at https://github.com/calmke/LiPMAP for reproducible research.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。