arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1901.07677cs.CVcs.AIcs.RO
收藏

基于四元数的神经网络人体运动建模

Modeling Human Motion with Quaternion-based Neural Networks

ETH Zurich(苏黎世联邦理工学院);Facebook AI Research(Facebook人工智能研究院);Google Brain(谷歌大脑)

Dario Pavllo, Christoph Feichtenhofer, Michael Auli, David Grangier

摘要:

先前关于预测或生成3D人体姿势序列的工作回归关节旋转或关节位置。前一种策略容易沿着运动链积累误差,以及使用欧拉角或指数映射作为参数化时的不连续性。后者需要重新投影到骨架约束上,以避免骨骼拉伸和无效配置。这项工作解决了这两个限制。QuaterNet用四元数表示旋转,我们的损失函数在骨架上执行正运动学,以惩罚绝对位置误差而不是角度误差。我们研究了递归和卷积架构,并对短期预测和长期生成进行了评估。对于后者,我们的方法被定性判断为现实的最近的神经策略,从图形文献。我们的实验比较四元数欧拉角以及指数映射,并表明,只有一个非常短的上下文是需要作出可靠的未来预测。最后,我们证明了Human3.6M的标准评估协议会产生高方差结果,并提出了一个简单的解决方案。

英文摘要:

Previous work on predicting or generating 3D human pose sequences regresses either joint rotations or joint positions. The former strategy is prone to error accumulation along the kinematic chain, as well as discontinuities when using Euler angles or exponential maps as parameterizations. The latter requires re-projection onto skeleton constraints to avoid bone stretching and invalid configurations. This work addresses both limitations. QuaterNet represents rotations with quaternions and our loss function performs forward kinematics on a skeleton to penalize absolute position errors instead of angle errors. We investigate both recurrent and convolutional architectures and evaluate on short-term prediction and long-term generation. For the latter, our approach is qualitatively judged as realistic as recent neural strategies from the graphics literature. Our experiments compare quaternions to Euler angles as well as exponential maps and show that only a very short context is required to make reliable future predictions. Finally, we show that the standard evaluation protocol for Human3.6M produces high variance results and we propose a simple solution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑