arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.06447cs.ROcs.LG
收藏

具有安全保证的自监督运动重定向

Self-Supervised Motion Retargeting with Safety Guarantee

School of Artificial Intelligence, Korea University(高丽大学人工智能学院);Courant Institute of Mathematical Sciences, New York University(纽约大学柯朗数学科学研究所);Technical University of Munich(慕尼黑工业大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Sungjoon Choi, Min Jae Song, Hyemin Ahn, Joohyung Kim

摘要:

在本文中,我们提出了自监督共享潜在嵌入(S3LE),数据驱动的运动重定向方法,使自然运动的生成人形机器人从运动捕捉数据或RGB视频。虽然它需要成对的数据组成的人的姿势和他们相应的机器人配置,它显着的必要性,耗时的数据收集通过新的成对数据生成过程。我们的自监督学习过程包括两个步骤:自动生成配对数据以引导运动重定向,以及学习投影不变映射以处理人类和人形机器人的不同表现力。此外,我们的方法保证所产生的机器人姿势是无碰撞的,并通过利用非参数回归在共享的潜在空间满足位置限制。我们证明了我们的方法可以从CMU运动捕捉数据库和YouTube视频中生成富有表现力的机器人运动。

英文摘要:

In this paper, we present self-supervised shared latent embedding (S3LE), a data-driven motion retargeting method that enables the generation of natural motions in humanoid robots from motion capture data or RGB videos. While it requires paired data consisting of human poses and their corresponding robot configurations, it significantly alleviates the necessity of time-consuming data-collection via novel paired data generating processes. Our self-supervised learning procedure consists of two steps: automatically generating paired data to bootstrap the motion retargeting, and learning a projection-invariant mapping to handle the different expressivity of humans and humanoid robots. Furthermore, our method guarantees that the generated robot pose is collision-free and satisfies position limits by utilizing nonparametric regression in the shared latent space. We demonstrate that our method can generate expressive robotic motions from both the CMU motion capture database and YouTube videos.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑