arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2605.26447cs.CV

Underwater360: 基于全景高斯泼溅的全景图像水下场景重建

Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting

School of Software, Dalian University of Technology(大连理工大学软件学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)

Jiangbei Hu, Weichao Song, Shibo Yu, Mohan Wang, Zihan Yi, Rui Wu, Mingkang Xiang, Na Lei, Shengfa Wang, Zhongxuan Luo, Ying He

AI总结:

提出Underwater360框架,利用物理信息引导的全向高斯泼溅,通过球面光线投射和外观-介质建模,实现水下全景场景的高质量重建与外观恢复。

摘要:

水下场景重建对于沉浸式探索水生环境至关重要,但由于复杂的参与介质效应(如吸收和散射)以及传统相机的有限视场(FoV),仍然具有挑战性。尽管将全景成像与3D高斯泼溅(3DGS)相结合为逼真的水下渲染提供了有前景的方向,但传统的3DGS难以处理球面投影畸变和水下介质退化。在本文中,我们提出了 extbf{Underwater360},一个物理信息引导的全向3DGS框架,用于水下全景场景重建。首先,我们引入了一个全向高斯泼溅模块,该模块直接在球面相机空间中进行光线投射,而不是依赖2D投影近似,从而减少了360$^\circ$视场下的几何畸变。其次,我们设计了一个基于物理的外观-介质建模架构,带有姿态条件的外观嵌入,以明确地将内在场景辐射与深度相关的后向散射和衰减解耦,从而实现物理基础的外观恢复。最后,我们建立了一个新的全景水下基准数据集,包含合成场景和真实场景。大量实验表明,Underwater360在水下新视图合成和场景外观恢复方面取得了优越的性能,在复杂水下环境中提供了改进的渲染质量和跨视图一致性。代码和数据集发布在https://github.com/SwcK423/Underwater360。

英文摘要:

Underwater scene reconstruction is essential for immersive exploration of aquatic environments, yet remains challenging due to complex participating-media effects such as absorption and scattering, as well as the limited field of view (FoV) of conventional cameras. Although combining panoramic imaging with 3D Gaussian Splatting (3DGS) offers a promising direction for photorealistic underwater rendering, traditional 3DGS struggles with both spherical projection distortion and underwater medium degradation. In this paper, we propose \textbf{Underwater360}, a physics-informed omnidirectional 3DGS framework for underwater panoramic scene reconstruction. First, we introduce an Omnidirectional Gaussian Splatting module that performs ray casting directly in spherical camera space instead of relying on 2D projection approximations, thereby reducing geometric distortions under 360$^\circ$ FoV. Second, we design a physics-based appearance-medium modeling architecture with pose-conditioned appearance embeddings to explicitly decouple intrinsic scene radiance from depth-dependent backscatter and attenuation, enabling physically grounded scene appearance restoration. Finally, we establish a new panoramic underwater benchmark dataset containing both synthetic and real-world scenes. Extensive experiments demonstrate that Underwater360 achieves superior performance in underwater novel view synthesis and scene appearance restoration, delivering improved rendering quality and cross-view consistency in complex underwater environments. The code and datasets are released at https://github.com/SwcK423/Underwater360

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑