arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2602.09816cs.CV

CompSplat: 为真实世界视频设计的压缩感知3D高斯点散布

CompSplat: Compression-aware 3D Gaussian Splatting for Real-world Video

Kyungpook National University(Kyungpook国立大学);Adobe Research(Adobe研究院)

Hojun Song, Heejung Choi, Aro Kim, Chae-yeong Song, Gahyeon Kim, Soo Ye Kim, Jaehyup Lee, Sang-hyo Park

AI总结:

CompSplat是一种针对真实世界视频压缩感知的3D高斯点散布框架,通过建模帧级压缩特性来减少帧间不一致性和累积几何误差,实现了在高压缩条件下更高质量的视角合成。

摘要:

高质量的全新视角合成(NVS)从真实世界视频中至关重要,对于文化遗产保护、数字孪生和沉浸式媒体等应用具有重要意义。然而,真实世界视频通常包含长序列,具有不规则的摄像机轨迹和未知姿态,导致重建过程中出现姿态漂移、特征错位和几何失真。此外,有损压缩会加剧这些问题,通过引入不一致性和逐渐降低几何和渲染质量。尽管最近的研究已经解决了长序列NVS或无姿态重建问题,但压缩感知方法仍集中在特定的伪影或有限场景上,未能充分探索长视频中多样的压缩模式。在本文中,我们提出了CompSplat,一种压缩感知训练框架,该框架明确建模帧级压缩特性,以缓解帧间不一致性和累积的几何误差。CompSplat结合了压缩感知的帧加权和自适应剪枝策略,以增强鲁棒性和几何一致性,特别是在高压缩情况下。在具有挑战性的基准测试中,包括Tanks and Temples、Free和Hike,大量实验表明,CompSplat在渲染质量和姿态准确性方面达到了最先进的水平,显著超越了大多数最近的NVS方法在严苛压缩条件下。

英文摘要:

High-quality novel view synthesis (NVS) from real-world videos is crucial for applications such as cultural heritage preservation, digital twins, and immersive media. However, real-world videos typically contain long sequences with irregular camera trajectories and unknown poses, leading to pose drift, feature misalignment, and geometric distortion during reconstruction. Moreover, lossy compression amplifies these issues by introducing inconsistencies that gradually degrade geometry and rendering quality. While recent studies have addressed either long-sequence NVS or unposed reconstruction, compression-aware approaches still focus on specific artifacts or limited scenarios, leaving diverse compression patterns in long videos insufficiently explored. In this paper, we propose CompSplat, a compression-aware training framework that explicitly models frame-wise compression characteristics to mitigate inter-frame inconsistency and accumulated geometric errors. CompSplat incorporates compression-aware frame weighting and an adaptive pruning strategy to enhance robustness and geometric consistency, particularly under heavy compression. Extensive experiments on challenging benchmarks, including Tanks and Temples, Free, and Hike, demonstrate that CompSplat achieves state-of-the-art rendering quality and pose accuracy, significantly surpassing most recent state-of-the-art NVS approaches under severe compression conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑