TVMC: 通过多阶段锚网格生成实现时间变化网格压缩
TVMC: Time-Varying Mesh Compression via Multi-Stage Anchor Mesh Generation
AI总结:
TVMC通过多阶段锚网格生成实现动态网格的高效压缩,提升压缩率并保持高质量重建。
摘要:
时间变化网格以其动态连接性和变化的顶点数量,在增强现实等应用中具有重要潜力。然而,由于高保真表示所需的大量数据量,其实际应用仍面临挑战。尽管各种压缩方法试图利用连续网格帧之间的时序冗余,但大多数方法在拓扑不一致性和运动引起的伪影方面存在困难。为此,我们提出时间变化网格压缩(TVMC),一种基于多阶段粗到细锚网格生成的新型框架,用于帧间预测。具体而言,锚网格分三个阶段逐步构建:初始、粗略和精细。初始锚网格通过快速拓扑对齐来利用时序一致性。随后,基于卡尔曼滤波的运动估计模块通过准确补偿帧间运动生成粗锚网格。接着,基于二次误差度量的细化步骤优化顶点位置,以形成具有改进几何保真度的精细锚网格。基于优化后的锚网格,编码帧间运动相对于参考基网格,同时对细分精细锚网格与输入网格之间的残差位移进行自适应量化和压缩。这种分层策略保持了连通性的稳定性,并实现了动态几何的高效紧凑表示。在标准MPEG动态网格序列上的广泛实验表明,TVMC实现了最先进的压缩性能。与最新V-DMC标准相比,其在BD-rate方面获得了10.2%~16.9%的显著提升,同时保持了高质量的重建质量。代码可在https://github.com/H-Huang774/TVMC上获得。
英文摘要:
Time-varying meshes, characterized by dynamic connectivity and varying vertex counts, hold significant promise for applications such as augmented reality. However, their practical utilization remains challenging due to the substantial data volume required for high-fidelity representation. While various compression methods attempt to leverage temporal redundancy between consecutive mesh frames, most struggle with topological inconsistency and motion-induced artifacts. To address these issues, we propose Time-Varying Mesh Compression (TVMC), a novel framework built on multi-stage coarse-to-fine anchor mesh generation for inter-frame prediction. Specifically, the anchor mesh is progressively constructed in three stages: initial, coarse, and fine. The initial anchor mesh is obtained through fast topology alignment to exploit temporal coherence. A Kalman filter-based motion estimation module then generates a coarse anchor mesh by accurately compensating inter-frame motions. Subsequently, a Quadric Error Metric-based refinement step optimizes vertex positions to form a fine anchor mesh with improved geometric fidelity. Based on the refined anchor mesh, the inter-frame motions relative to the reference base mesh are encoded, while the residual displacements between the subdivided fine anchor mesh and the input mesh are adaptively quantized and compressed. This hierarchical strategy preserves consistent connectivity and high-quality surface approximation, while achieving an efficient and compact representation of dynamic geometry. Extensive experiments on standard MPEG dynamic mesh sequences demonstrate that TVMC achieves state-of-the-art compression performance. Compared to the latest V-DMC standard, it delivers a significant BD-rate gain of 10.2% ~ 16.9%, while preserving high reconstruction quality. The code is available at https://github.com/H-Huang774/TVMC.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。