arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2502.09563cs.CVcs.GR

用于大视场角重建的自标定Gaussian Splatting

Self-Calibrating Gaussian Splatting for Large Field of View Reconstruction

Cornell University(康奈尔大学);Netflix Eyeline Studios(Netflix Eyeline工作室);Stanford University(斯坦福大学)

Youming Deng, Wenqi Xian, Guandao Yang, Leonidas Guibas, Gordon Wetzstein, Steve Marschner, Paul Debevec

AI总结:

本文提出一种自标定框架,联合优化相机参数、镜头畸变和3D Gaussian表示,通过混合网络和立方体贴图重采样策略,实现大视场角图像的高质量高效场景重建。

摘要:

本文提出一种自标定框架,联合优化相机参数、镜头畸变和3D Gaussian表示,实现准确高效的场景重建。具体而言,该技术能从广角镜头拍摄的大视场角(FOV)图像中实现高质量场景重建,允许使用较少数量的图像对场景进行建模。该方法引入一种利用混合网络建模复杂镜头畸变的新方法,该网络结合了可逆残差网络和显式网格。此设计有效正则化了优化过程,比传统相机模型实现了更高的精度。此外,我们提出一种基于立方体贴图的重采样策略,以支持大FOV图像而不牺牲分辨率或引入畸变伪影。该方法兼容Gaussian Splatting的快速光栅化,适应多种相机镜头畸变,并在合成和真实数据集上展现了最先进的性能。

英文摘要:

In this paper, we present a self-calibrating framework that jointly optimizes camera parameters, lens distortion and 3D Gaussian representations, enabling accurate and efficient scene reconstruction. In particular, our technique enables high-quality scene reconstruction from Large field-of-view (FOV) imagery taken with wide-angle lenses, allowing the scene to be modeled from a smaller number of images. Our approach introduces a novel method for modeling complex lens distortions using a hybrid network that combines invertible residual networks with explicit grids. This design effectively regularizes the optimization process, achieving greater accuracy than conventional camera models. Additionally, we propose a cubemap-based resampling strategy to support large FOV images without sacrificing resolution or introducing distortion artifacts. Our method is compatible with the fast rasterization of Gaussian Splatting, adaptable to a wide variety of camera lens distortion, and demonstrates state-of-the-art performance on both synthetic and real-world datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑