Ground4D: 从单目视频进行一致性感知的四维重建
Ground4D: Consistency-Aware 4D Reconstruction from Monocular Video
AI总结：
提出Ground4D框架，结合3D基础模型进行几何初始化与动态高斯泼溅进行一致性优化，实现从单目视频的高保真4D重建与新视角渲染。
摘要：
从单个单目视频学习支持动态新视角合成并随时间保持忠实几何的四维场景表示仍然具有挑战性。动态高斯泼溅通过光度优化实现了强大的渲染性能，但并未明确强制多视图几何一致性。相比之下，3D基础模型恢复了连贯的场景几何和相机运动，但其基于点的输出并非为逼真渲染而设计。我们提出Ground4D，一个基于几何的两阶段框架。首先，我们通过3D基础模型进行几何初始化，以无需训练的方式利用VGGT从单目视频重建多视图一致的3D几何和相机姿态。恢复的几何为动态高斯表示提供了结构化和可靠的初始化。其次，我们通过动态高斯泼溅进行几何一致性感知的细化，通过可微渲染优化表示，同时在观察和合成视点上保持多视图几何一致性。此外，Ground4D固有地建模了场景的连续四维动态，自然支持任意时间戳的渲染。通过将基础级别的几何先验集成到动态高斯优化中，Ground4D实现了更强的重建保真度和渲染性能，突显了几何基础约束在鲁棒四维场景建模中的作用。
英文摘要：
Learning a 4D scene representation from a single monocular video that supports dynamic novel-view synthesis while maintaining faithful geometry over time remains challenging. Dynamic Gaussian Splatting achieves strong rendering performance through photometric optimization, yet does not explicitly enforce multi-view geometric consistency. In contrast, 3D foundation models recover coherent scene geometry and camera motion, but their point-based outputs are not designed for photorealistic rendering. We propose Ground4D, a geometry-grounded framework built on two stages. First, we perform geometry initialization via 3D foundation models, leveraging VGGT in a training-free manner to reconstruct multi-view-consistent 3D geometry and camera poses from monocular video. The recovered geometry provides a structured and reliable initialization for dynamic Gaussian representations. Second, we conduct geometry-consistency-aware refinement via dynamic Gaussian Splatting, optimizing the representation through differentiable rendering while maintaining multi-view geometric consistency across both observed and synthesized viewpoints. Furthermore, Ground4D inherently models the continuous 4D dynamics of the scene, naturally supporting rendering at arbitrary timestamps. By integrating foundation-level geometric priors into dynamic Gaussian optimization, Ground4D achieves stronger reconstruction fidelity and rendering performance, underscoring the role of geometry-grounded constraints in robust 4D scene modeling.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
