arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.06523cs.CV
收藏

通过潜在空间连接从频谱中即时恢复形状

Instant recovery of shape from spectrum via latent space connections

University of Verona(维罗纳大学);Sapienza University of Rome(罗马大学);Ecole Polytechnique, IP Paris(巴黎理工学院综合理工学院)

Riccardo Marin, Arianna Rampini, Umberto Castellani, Emanuele Rodolà, Maks Ovsjanikov, Simone Melzi

摘要:

我们介绍了第一个基于学习的方法,从拉普拉斯光谱恢复形状。给定一个自动编码器,我们的模型采用循环一致性模块的形式将潜在向量映射到特征值序列。该模块提供了一个高效和有效的光谱和给定形状的几何形状之间的联系。我们的数据驱动方法取代了先前方法所需的ad-hoc正则化器,同时以一小部分计算成本提供更准确的结果。我们的学习模型适用于不同的维度(2D和3D形状),表示(网格,轮廓和点云)以及不同的形状类别,并且允许输入光谱的任意分辨率而不影响复杂性。增加的灵活性使我们能够提供可微特征分解的代理,并在统一的框架内解决3D视觉和几何处理中众所周知的困难任务,包括从频谱生成形状,网格超分辨率,形状探索,样式转移,从点云估计频谱,分割转移和点对点匹配。

英文摘要:

We introduce the first learning-based method for recovering shapes from Laplacian spectra. Given an auto-encoder, our model takes the form of a cycle-consistent module to map latent vectors to sequences of eigenvalues. This module provides an efficient and effective linkage between spectrum and geometry of a given shape. Our data-driven approach replaces the need for ad-hoc regularizers required by prior methods, while providing more accurate results at a fraction of the computational cost. Our learning model applies without modifications across different dimensions (2D and 3D shapes alike), representations (meshes, contours and point clouds), as well as across different shape classes, and admits arbitrary resolution of the input spectrum without affecting complexity. The increased flexibility allows us to provide a proxy to differentiable eigendecomposition and to address notoriously difficult tasks in 3D vision and geometry processing within a unified framework, including shape generation from spectrum, mesh super-resolution, shape exploration, style transfer, spectrum estimation from point clouds, segmentation transfer and point-to-point matching.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑