arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2008.01639cs.CVcs.GR
收藏

PatchNets:基于块的可泛化深隐式3D形状表示

PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations

Max Planck Institute for Informatics(马克斯·普朗克信息学研究所);Facebook Reality Labs(Facebook现实实验室)

Edgar Tretschk, Ayush Tewari, Vladislav Golyanik, Michael Zollhöfer, Carsten Stoll, Christian Theobalt

摘要:

隐式表面表示,如符号距离函数,结合深度学习,已经产生了令人印象深刻的模型,可以表示具有任意拓扑结构的物体的详细形状。由于学习了连续函数,因此也可以以任意分辨率提取重建。但是,需要大型数据集(如ShapeNet)来训练此类模型。在本文中,我们提出了一种新的中层基于块的表面表示。在补丁级别,不同类别的对象具有相似性,这导致了更普遍的模型。然后,我们介绍了一种新的方法来学习这种基于补丁的表示在一个规范的空间,使它尽可能对象不可知。我们表明,我们在ShapeNet的一类对象上训练的表示也可以很好地表示任何其他类别的详细形状。此外,与现有方法相比,它可以使用更少的形状进行训练。我们展示了我们的新表示的几个应用程序,包括形状插值和部分点云完成。由于明确控制的位置,方向和规模的补丁,我们的表示也更可控相比,对象级表示,这使我们能够变形编码的形状非刚性。

英文摘要:

Implicit surface representations, such as signed-distance functions, combined with deep learning have led to impressive models which can represent detailed shapes of objects with arbitrary topology. Since a continuous function is learned, the reconstructions can also be extracted at any arbitrary resolution. However, large datasets such as ShapeNet are required to train such models. In this paper, we present a new mid-level patch-based surface representation. At the level of patches, objects across different categories share similarities, which leads to more generalizable models. We then introduce a novel method to learn this patch-based representation in a canonical space, such that it is as object-agnostic as possible. We show that our representation trained on one category of objects from ShapeNet can also well represent detailed shapes from any other category. In addition, it can be trained using much fewer shapes, compared to existing approaches. We show several applications of our new representation, including shape interpolation and partial point cloud completion. Due to explicit control over positions, orientations and scales of patches, our representation is also more controllable compared to object-level representations, which enables us to deform encoded shapes non-rigidly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑