Fisheye-GS：面向鱼眼相机的轻量可扩展高斯泼溅模块
Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Cameras
AI总结：
针对3DGS适配鱼眼相机的投影计算难题与瓦片泼溅效率问题，提出Fisheye-GS，重算鱼眼投影变换及梯度，可作为轻量模块集成到其他渲染方法，视觉质量优于去畸变后训练的方法。
摘要：
近年来，3D高斯泼溅（3D Gaussian Splatting, 3DGS）凭借高保真度与实时渲染特性受到关注。然而，由于独特的3D到2D投影计算，将3DGS适配到不同相机模型（尤其是鱼眼镜头）面临挑战。此外，基于瓦片的泼溅存在效率低下问题，在鱼眼镜头的极端曲率和大视场场景下尤为突出，这对其更广泛的实际应用至关重要。为解决这些挑战，我们提出Fisheye-GS。该创新方法重新计算了鱼眼相机的投影变换及其梯度。我们的方法可作为模块无缝集成到其他高效3D渲染方法中，凸显了其可扩展性、轻量特性与模块化设计。由于我们仅修改了投影组件，它也能轻松适配不同相机模型。与先去畸变再训练的方法相比，我们的方法在视觉质量上展现出明显提升。
英文摘要：
Recently, 3D Gaussian Splatting (3DGS) has garnered attention for its high fidelity and real-time rendering. However, adapting 3DGS to different camera models, particularly fisheye lenses, poses challenges due to the unique 3D to 2D projection calculation. Additionally, there are inefficiencies in the tile-based splatting, especially for the extreme curvature and wide field of view of fisheye lenses, which are crucial for its broader real-life applications. To tackle these challenges, we introduce Fisheye-GS.This innovative method recalculates the projection transformation and its gradients for fisheye cameras. Our approach can be seamlessly integrated as a module into other efficient 3D rendering methods, emphasizing its extensibility, lightweight nature, and modular design. Since we only modified the projection component, it can also be easily adapted for use with different camera models. Compared to methods that train after undistortion, our approach demonstrates a clear improvement in visual quality.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
