等变形状空间学习的帧平均算法
Frame Averaging for Equivariant Shape Space Learning
摘要:
形状空间学习的任务涉及将一组训练形状映射到具有良好泛化特性的潜在表示空间以及从具有良好泛化特性的潜在表示空间映射一组形状。通常,真实世界的形状集合具有对称性,这可以定义为不改变形状本质的变换。将对称性纳入形状空间学习的一种自然方法是要求到形状空间的映射(编码器)和从形状空间的映射(解码器)与相关对称性是等变的。在本文中,我们提出了一个框架,通过引入两个贡献,将等方差的编码器和解码器:(i)适应最近的帧平均(FA)框架,以建立通用的,高效的,最大限度地表达等变自编码器;和(ii)构建自编码器等变分段欧几里得运动应用于不同部分的形状。据我们所知,这是第一个完全分段欧几里得等变自编码器的建设。训练我们的框架很简单:它使用标准的重建损失,不需要引入新的损失。我们的架构是建立在标准(骨干)架构与适当的帧平均,使他们等变。在使用隐式神经表示的刚性形状数据集和使用基于网格的神经网络的铰接形状数据集上测试我们的框架,显示出对看不见的测试形状的最新概括,大幅提高了相关基线。特别是,我们的方法在推广到看不见的关节姿势方面表现出显着的改进。
英文摘要:
The task of shape space learning involves mapping a train set of shapes to and from a latent representation space with good generalization properties. Often, real-world collections of shapes have symmetries, which can be defined as transformations that do not change the essence of the shape. A natural way to incorporate symmetries in shape space learning is to ask that the mapping to the shape space (encoder) and mapping from the shape space (decoder) are equivariant to the relevant symmetries. In this paper, we present a framework for incorporating equivariance in encoders and decoders by introducing two contributions: (i) adapting the recent Frame Averaging (FA) framework for building generic, efficient, and maximally expressive Equivariant autoencoders; and (ii) constructing autoencoders equivariant to piecewise Euclidean motions applied to different parts of the shape. To the best of our knowledge, this is the first fully piecewise Euclidean equivariant autoencoder construction. Training our framework is simple: it uses standard reconstruction losses and does not require the introduction of new losses. Our architectures are built of standard (backbone) architectures with the appropriate frame averaging to make them equivariant. Testing our framework on both rigid shapes dataset using implicit neural representations, and articulated shape datasets using mesh-based neural networks show state-of-the-art generalization to unseen test shapes, improving relevant baselines by a large margin. In particular, our method demonstrates significant improvement in generalizing to unseen articulated poses.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。