arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.16341cs.CV
收藏

从时空描述符学习并行稠密对应以实现高效和鲁棒的4D重建

Learning Parallel Dense Correspondence from Spatio-Temporal Descriptors for Efficient and Robust 4D Reconstruction

South China University of Technology(华南理工大学);DAMO Academy, Alibaba Group(阿里巴巴达摩院);HKUST(香港科技大学);Pazhou Lab(琶洲实验室);Peng Cheng Laboratory(鹏城实验室);The Hong Kong Polytechnic University(香港理工大学)

Jiapeng Tang, Dan Xu, Kui Jia, Lei Zhang

摘要:

本文重点研究了从一系列点云数据中进行4D形状重建的问题。尽管最近通过将深度隐式表示扩展到4D空间取得了成功,但在两个方面仍然是一个巨大的挑战,即如何设计一个灵活的框架来从4D点云学习鲁棒的时空形状表示,并开发一个有效的机制来捕获形状动态。在这项工作中,我们提出了一种新的管道,通过跨帧占用字段之间的空间连续的转换函数来学习三维人体形状的时间演变。其关键思想是通过从鲁棒的时空形状表示中显式地学习连续的位移向量场,在不同的时间步长处建立预测的占用场之间的密集对应关系。与以前的最先进的广泛比较表明,我们的方法在4D形状自动编码和完成问题中的4D人体重建具有优越的准确性,并且具有约8倍加速比的更快的网络推理证明了我们方法的显着效率。经过训练的模型和实现代码可在https://github.com/tangjiapeng/LPDC-Net上获得。

英文摘要:

This paper focuses on the task of 4D shape reconstruction from a sequence of point clouds. Despite the recent success achieved by extending deep implicit representations into 4D space, it is still a great challenge in two respects, i.e. how to design a flexible framework for learning robust spatio-temporal shape representations from 4D point clouds, and develop an efficient mechanism for capturing shape dynamics. In this work, we present a novel pipeline to learn a temporal evolution of the 3D human shape through spatially continuous transformation functions among cross-frame occupancy fields. The key idea is to parallelly establish the dense correspondence between predicted occupancy fields at different time steps via explicitly learning continuous displacement vector fields from robust spatio-temporal shape representations. Extensive comparisons against previous state-of-the-arts show the superior accuracy of our approach for 4D human reconstruction in the problems of 4D shape auto-encoding and completion, and a much faster network inference with about 8 times speedup demonstrates the significant efficiency of our approach. The trained models and implementation code are available at https://github.com/tangjiapeng/LPDC-Net.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑