arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2510.15072cs.CV

SaLon3R:基于未标定图像的结构感知长期可泛化三维重建

SaLon3R: Structure-aware Long-term Generalizable 3D Reconstruction from Unposed Images

The Chinese University of Hong Kong(香港中文大学);Hong Kong Center for Logistics Robotics(香港物流机器人中心);University of California, Berkeley(加州大学伯克利分校);Zhejiang University(浙江大学)

Jiaxin Guo, Tongfan Guan, Wenzhen Dong, Wenzhao Zheng, Wenting Wang, Yue Wang, Yeung Yam, Yun-Hui Liu

AI总结:

针对现有3DGS重建方法在长视频中冗余高、几何不一致的问题,提出SaLon3R框架,通过显著性感知量化和3D点Transformer实现高效鲁棒的长期可泛化3D重建。

摘要:

3D高斯溅射(3D Gaussian Splatting, 3DGS)的最新进展已实现了对序列输入视图的可泛化实时重建。然而,现有方法通常预测逐像素高斯分布,并将所有视图的高斯分布组合作为场景表示,导致长时长视频序列中存在大量冗余和几何不一致性。为解决这一问题,我们提出了SaLon3R,一种用于结构感知长期3DGS重建的新型框架。据我们所知,SaLon3R是首个能够以超过10 FPS的速度重建超过50个视图、冗余去除率达50%至90%的在线可泛化GS方法。我们的方法引入了紧凑锚点基元,通过可微的显著性感知高斯量化消除冗余,并结合3D点Transformer优化锚点属性和显著性,以解决跨帧几何和光度不一致问题。具体而言,我们首先利用3D重建骨干网络预测密集的逐像素高斯分布,以及编码区域几何复杂度的显著性图。通过优先考虑高复杂度区域,将冗余高斯压缩为紧凑锚点。随后,3D点Transformer从训练数据中学习3D空间中的空间结构先验,以优化锚点属性和显著性,实现区域自适应的高斯解码,保证几何保真度。在无需已知相机参数或测试时优化的情况下,我们的方法通过单次前向传播即可有效消除伪影并裁剪冗余的3DGS。在多个数据集上的实验表明,我们的方法在新视角合成和深度估计任务上均达到了最先进性能,展现出在长期可泛化3D重建方面卓越的效率、鲁棒性和泛化能力。项目页面:https://wrld.github.io/SaLon3R/。

英文摘要:

Recent advances in 3D Gaussian Splatting (3DGS) have enabled generalizable, on-the-fly reconstruction of sequential input views. However, existing methods often predict per-pixel Gaussians and combine Gaussians from all views as the scene representation, leading to substantial redundancies and geometric inconsistencies in long-duration video sequences. To address this, we propose SaLon3R, a novel framework for Structure-aware, Long-term 3DGS Reconstruction. To our best knowledge, SaLon3R is the first online generalizable GS method capable of reconstructing over 50 views in over 10 FPS, with 50% to 90% redundancy removal. Our method introduces compact anchor primitives to eliminate redundancy through differentiable saliency-aware Gaussian quantization, coupled with a 3D Point Transformer that refines anchor attributes and saliency to resolve cross-frame geometric and photometric inconsistencies. Specifically, we first leverage a 3D reconstruction backbone to predict dense per-pixel Gaussians and a saliency map encoding regional geometric complexity. Redundant Gaussians are compressed into compact anchors by prioritizing high-complexity regions. The 3D Point Transformer then learns spatial structural priors in 3D space from training data to refine anchor attributes and saliency, enabling regionally adaptive Gaussian decoding for geometric fidelity. Without known camera parameters or test-time optimization, our approach effectively resolves artifacts and prunes the redundant 3DGS in a single feed-forward pass. Experiments on multiple datasets demonstrate our state-of-the-art performance on both novel view synthesis and depth estimation, demonstrating superior efficiency, robustness, and generalization ability for long-term generalizable 3D reconstruction. Project Page: https://wrld.github.io/SaLon3R/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑