arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2507.13891cs.CV

PCR-GS:通过位姿协同正则化实现无COLMAP的3D高斯泼溅

PCR-GS: COLMAP-Free 3D Gaussian Splatting via Pose Co-Regularizations

Nanyang Technological University(南洋理工大学);Zhejiang University of Technology(浙江工业大学);University of Chinese Academy of Sciences(中国科学院大学)

Yu Wei, Jiahui Zhang, Xiaoqin Zhang, Ling Shao, Shijian Lu

AI总结:

PCR-GS提出一种无COLMAP的3D高斯泼溅方法,通过DINO特征重投影正则化和基于小波的频率正则化协同约束相机位姿,解决复杂相机轨迹下位姿估计与场景联合优化陷入局部极小值的问题,实现高质量无位姿3D场景重建。

摘要:

无COLMAP的3D高斯泼溅(3D-GS)近年来因其在从未标定位姿的图像或视频中重建高质量3D场景方面的卓越性能而受到越来越多的关注。然而,它往往难以处理具有复杂相机轨迹的场景,这类场景的特点是相邻相机视图之间存在剧烈的旋转和平移,导致相机位姿估计质量下降,并进一步使相机位姿与3D-GS的联合优化陷入局部极小值。我们提出PCR-GS,一种创新的无COLMAP 3DGS技术,通过相机位姿协同正则化实现卓越的3D场景建模和相机位姿估计。PCR-GS从两个角度实现正则化。第一是特征重投影正则化,它从相邻相机视图中提取对视角鲁棒的DINO特征,并对齐其语义信息以进行相机位姿正则化。第二是基于小波的频率正则化,它利用高频细节中的差异进一步优化相机位姿中的旋转矩阵。在多个真实世界场景上的大量实验表明,所提出的PCR-GS在相机轨迹剧烈变化的情况下实现了卓越的无位姿3D-GS场景建模。

英文摘要:

COLMAP-free 3D Gaussian Splatting (3D-GS) has recently attracted increasing attention due to its remarkable performance in reconstructing high-quality 3D scenes from unposed images or videos. However, it often struggles to handle scenes with complex camera trajectories as featured by drastic rotation and translation across adjacent camera views, leading to degraded estimation of camera poses and further local minima in joint optimization of camera poses and 3D-GS. We propose PCR-GS, an innovative COLMAP-free 3DGS technique that achieves superior 3D scene modeling and camera pose estimation via camera pose co-regularization. PCR-GS achieves regularization from two perspectives. The first is feature reprojection regularization which extracts view-robust DINO features from adjacent camera views and aligns their semantic information for camera pose regularization. The second is wavelet-based frequency regularization which exploits discrepancy in high-frequency details to further optimize the rotation matrix in camera poses. Extensive experiments over multiple real-world scenes show that the proposed PCR-GS achieves superior pose-free 3D-GS scene modeling under dramatic changes of camera trajectories.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑