arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.05151cs.CVcs.GR
收藏

Ultron:利用时间对应关系和网格变形实现3D网格序列的时间几何压缩

Ultron: Enabling Temporal Geometry Compression of 3D Mesh Sequences using Temporal Correspondence and Mesh Deformation

Haichao Zhu

AI总结:

针对任意拓扑三维网格序列,本文提出Ultron,通过帧间时间对应、网格变形、质量评估及熵与角表编码实现高效时间几何压缩,并达到最先进性能。

摘要:

随着计算机视觉的发展,动态三维重建技术取得了显著进展,并在多个领域得到应用。然而,这些技术会产生大量三维数据序列,因此需要高效的存储和传输方法。现有的三维模型压缩方法主要关注静态模型,未考虑帧间信息,从而限制了其减小数据规模的能力。受到较少关注的时间网格压缩通常要求所有输入网格具有相同拓扑,而这一条件在实际应用中很少满足。本研究提出一种利用时间对应关系和网格变形压缩任意拓扑网格序列的方法。该方法在连续帧之间建立时间对应关系,应用变形模型将网格从一帧变换到后续帧,并在质量满足容差阈值时用变形网格替换原始网格。大量实验表明,该方法在压缩性能方面可达到最先进水平。本文贡献包括:用于在网格之间建立时间对应关系的基于几何与运动的模型,面向时间网格序列的网格质量评估,基于熵编码和角表的网格序列压缩方法,以及证明所提方法有效性的大量实验。所有代码将在 https://github.com/lszhuhaichao/ultron 开源。

英文摘要:

With the advancement of computer vision, dynamic 3D reconstruction techniques have seen significant progress and found applications in various fields. However, these techniques generate large amounts of 3D data sequences, necessitating efficient storage and transmission methods. Existing 3D model compression methods primarily focus on static models and do not consider inter-frame information, limiting their ability to reduce data size. Temporal mesh compression, which has received less attention, often requires all input meshes to have the same topology, a condition rarely met in real-world applications. This research proposes a method to compress mesh sequences with arbitrary topology using temporal correspondence and mesh deformation. The method establishes temporal correspondence between consecutive frames, applies a deformation model to transform the mesh from one frame to subsequent frames, and replaces the original meshes with deformed ones if the quality meets a tolerance threshold. Extensive experiments demonstrate that this method can achieve state-of-the-art performance in terms of compression performance. The contributions of this paper include a geometry and motion-based model for establishing temporal correspondence between meshes, a mesh quality assessment for temporal mesh sequences, an entropy-based encoding and corner table-based method for compressing mesh sequences, and extensive experiments showing the effectiveness of the proposed method. All the code will be open-sourced at https://github.com/lszhuhaichao/ultron.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑