arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.13271cs.CV
收藏

非刚性运动恢复结构的秩一基方法

Non-Rigid Structure-From-Motion by Rank-One Basis Shapes

Institution1(机构1);Institution2(机构2)

Sami S. Brandt, Hanno Ackermann

摘要:

在本文中,我们表明,仿射,非刚性的运动恢复结构问题可以解决的秩一,从而退化,基础形状。它是Bregler等人的经典低秩方法的自然重新表述,其中假设可变形3D结构由刚性基础形状的线性组合产生。非刚性形状将被分解为平均形状和退化形状,从低秩分解的右奇异向量构造。右奇异向量被仿射反投影到3D空间中,并且仿射反投影也将作为因子分解的一部分来求解。通过构造,对低秩分解的右奇异向量的直接解释也将遵循:它们可以被视为主成分,因此,我们的方法的第一个变体被称为Rank-1-PCA。第二种变体,称为秩-1-ICA,另外估计正交变换,该正交变换将变形模式映射到尽可能统计独立的模式。它的优点是精确定位统计相关的子空间,例如,在人脸上的嘴唇运动。此外,与现有的作品相比,没有预定义的维度的子空间。在多个数据集上的实验表明,该方法比现有方法具有更好的效果,计算速度更快,对变形模式的解释更直观。

英文摘要:

In this paper, we show that the affine, non-rigid structure-from-motion problem can be solved by rank-one, thus degenerate, basis shapes. It is a natural reformulation of the classic low-rank method by Bregler et al., where it was assumed that the deformable 3D structure is generated by a linear combination of rigid basis shapes. The non-rigid shape will be decomposed into the mean shape and the degenerate shapes, constructed from the right singular vectors of the low-rank decomposition. The right singular vectors are affinely back-projected into the 3D space, and the affine back-projections will also be solved as part of the factorisation. By construction, a direct interpretation for the right singular vectors of the low-rank decomposition will also follow: they can be seen as principal components, hence, the first variant of our method is referred to as Rank-1-PCA. The second variant, referred to as Rank-1-ICA, additionally estimates the orthogonal transform which maps the deformation modes into as statistically independent modes as possible. It has the advantage of pinpointing statistically dependent subspaces related to, for instance, lip movements on human faces. Moreover, in contrast to prior works, no predefined dimensionality for the subspaces is imposed. The experiments on several datasets show that the method achieves better results than the state-of-the-art, it can be computed faster, and it provides an intuitive interpretation for the deformation modes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑