基于鱼眼图像的3D高斯点撒：视场分析与基于深度的初始化
3D Gaussian Splatting with Fisheye Images: Field of View Analysis and Depth-Based Initialization
AI总结：
本文首次评估了基于鱼眼图像的3D高斯点撒方法，通过对比不同视场下的重建效果，发现160度视场表现最佳，并引入基于深度的UniK3D方法提升宽角重建性能。
摘要：
我们首次对基于真实鱼眼图像的3D高斯点撒方法进行了评估，这些图像的视场超过180度。我们的研究评估了Fisheye-GS和3DGUT在使用200度鱼眼相机拍摄的室内外场景上的表现，旨在评估在严重失真情况下宽角重建的实用性。通过比较200度、160度和120度视场的重建结果，我们发现两种方法在160度视场下表现最佳，这在场景覆盖与图像质量之间达到了平衡，而200度视场的失真会降低性能。为了解决结构从运动（SfM）初始化在如此宽角度下的常见失败问题，我们引入了一种基于深度的替代方法，使用UniK3D（通用相机单目3D估计）模型。这代表了UniK3D首次应用于超过200度的鱼眼图像，尽管该模型并未在这样的数据上进行训练。通过将预测点的数量控制以匹配SfM进行公平比较，UniK3D产生了几何上准确的重建，即使在有雾、眩光或开阔天空的困难场景中，其表现也与SfM相当或更优。这些结果展示了基于鱼眼的3D高斯点撒的可行性，并为未来从稀疏和失真输入中进行宽角重建的研究提供了基准。
英文摘要：
We present the first evaluation of 3D Gaussian Splatting methods on real fisheye imagery with fields of view above 180\textdegree{}. Our study evaluates Fisheye-GS \cite{liao2024fisheyegslightweightextensiblegaussian} and 3DGUT \cite{wu20253dgut} on indoor and outdoor scenes captured with 200\textdegree{} fisheye cameras, with the aim of assessing the practicality of wide-angle reconstruction under severe distortion. By comparing reconstructions at 200\textdegree{}, 160\textdegree{}, and 120\textdegree{} field-of-view, we show that both methods achieve their best results at 160\textdegree{}, which balances scene coverage with image quality, while distortion at 200\textdegree{} degrades performance. To address the common failure of Structure-from-Motion (SfM) initialization at such wide angles, we introduce a depth-based alternative using UniK3D (Universal Camera Monocular 3D Estimation) \cite{piccinelli2025unik3d}. This represents the first application of UniK3D to fisheye imagery beyond 200\textdegree{}, despite the model not being trained on such data. With the number of predicted points controlled to match SfM for fairness, UniK3D produces geometrically accurate reconstructions that rival or surpass SfM, even in challenging scenes with fog, glare, or open sky. These results demonstrate the feasibility of fisheye-based 3D Gaussian Splatting and provides a benchmark for future research on wide-angle reconstruction from sparse and distorted inputs.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
