arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.04517cs.CVcs.RO
收藏

S-MUSt3R:滑动多视角三维重建

S-MUSt3R: Sliding Multi-view 3D Reconstruction

Leonid Antsfeld, Boris Chidlovskii, Yohann Cabon, Vincent Leroy, Jerome Revaud

AI总结:

S-MUSt3R通过序列分割和轻量级优化实现高效单目三维重建,利用MUSt3R模型在大规模RGB流中实现高精度重建。

摘要:

最近三维视觉领域范式转变导致了基础模型的兴起,这些模型在从非校准图像中进行三维感知方面表现出色。然而,将这些模型扩展到大规模RGB流三维重建仍然具有挑战性,因为存在内存限制。本文提出了S-MUSt3R,一种简单且高效的流程,扩展了基础模型在单目三维重建中的极限。我们的方法通过简单的序列分割策略,随后进行片段对齐和轻量级循环闭合优化,解决了基础模型的可扩展性瓶颈。无需模型重新训练,我们受益于MUSt3R模型出色的三维重建能力,并实现了与传统方法相当的轨迹和重建性能,尽管架构更复杂。我们在TUM、7-Scenes和专有机器人导航数据集上评估了S-MUSt3R,并展示了S-MUSt3R能够在长RGB序列上成功运行,并产生准确且一致的三维重建。我们的结果突显了利用MUSt3R模型进行可扩展单目三维场景重建在现实世界中的潜力,其重要优势在于可以直接在度量空间中进行预测。

英文摘要:

The recent paradigm shift in 3D vision led to the rise of foundation models with remarkable capabilities in 3D perception from uncalibrated images. However, extending these models to large-scale RGB stream 3D reconstruction remains challenging due to memory limitations. This work proposes S-MUSt3R, a simple and efficient pipeline that extends the limits of foundation models for monocular 3D reconstruction. Our approach addresses the scalability bottleneck of foundation models through a simple strategy of sequence segmentation followed by segment alignment and lightweight loop closure optimization. Without model retraining, we benefit from remarkable 3D reconstruction capacities of MUSt3R model and achieve trajectory and reconstruction performance comparable to traditional methods with more complex architecture. We evaluate S-MUSt3R on TUM, 7-Scenes and proprietary robot navigation datasets and show that S-MUSt3R runs successfully on long RGB sequences and produces accurate and consistent 3D reconstruction. Our results highlight the potential of leveraging the MUSt3R model for scalable monocular 3D scene in real-world settings, with an important advantage of making predictions directly in the metric space.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑