arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

FAST-GS:用于逼真动态新视图合成的频率感知时空高斯溅射

FAST-GS: Frequency Aware Space-time Gaussian Splatting for Photorealistic Dynamic Novel View Synthesis

Zhengyang Zhang, Ziyu Lu, PengCheng Li, Hongbo Duan, Yi Liu, Pengting Luo, Peiyu Zhuang, Xinghui Li, Shaohua Ma

arXiv 2608.01958首次发表:更新:

AI 中文总结

本文针对现有4DGS动态建模的不足,提出傅里叶运动建模模块与运动感知正则化策略,在N3V和Google Immersive数据集上验证了方法在复杂动态场景下的性能。

AI 中文摘要

4D高斯溅射(4DGS)凭借高效的4D高斯表示和可并行渲染,在动态3D重建与实时新视图合成中表现出色。但现有4DGS方法依赖单一多项式建模运动,在存在高频运动分量的复杂动态场景中性能受限,且因轨迹漂移累积无法保证长期稳定性。为解决这些问题,本文提出傅里叶运动建模模块:该范式将运动分解为基于频率的正弦分量,同时捕获低频全局轨迹与高频局部细节,以准确建模复杂运动模式,在保留4DGS实时渲染能力的同时,提升复杂运动拟合与长期一致性。此外,本文在损失函数中融入运动感知正则化策略:采用频率相关权重抑制高频抖动,同时保留低频运动一致性。在N3V和Google Immersive数据集的多场景实验验证了所提方法的有效性。

英文摘要

4D Gaussian Splatting (4DGS) excels in dynamic 3D reconstruction and real-time novel view synthesis via efficient 4D Gaussian representations and parallelizable rendering. However, existing 4DGS approaches rely on a single polynomial to model motion, which limits performance in complex dynamic scenes where high-frequency motion components are prevalent, and fails to ensure long-term stability due to cumulative trajectory drift. To address these issues, we propose a Fourier Motion Modeling module: this paradigm decomposes motion into frequency-based sinusoidal components, capturing both low-frequency global trajectories and high-frequency local details to model complex motion patterns accurately. It retains the real-time rendering capability of 4DGS while improving complex motion fitting and long-term coherence. Additionally, we integrate a motion-aware regularization strategy into the loss function: it uses frequency-dependent weights to suppress high-frequency jitter while preserving low-frequency motion coherence. Extensive experiments on N3V and Google Immersive datasets from multiple scenarios demonstrate the effectiveness of our method.

Commentsaccepted by ICASSP2026

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑