arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.13208cs.ROcs.AIcs.LG
收藏

利用人体先验重新定义运动重定向的数据配对

Redefining Data Pairing for Motion Retargeting Leveraging a Human Body Prior

Ulsan National Institute of Science and Technology(蔚山科学技术院)

Xiyana Figuera, Soogeun Park, Hyemin Ahn

AI总结:

本文提出MR HuBo方法,通过反向生成机器人到人类的配对姿态数据并利用人体先验过滤极端姿态,结合两阶段监督学习网络,实现高质量的人形机器人运动重定向。

摘要:

我们提出MR HuBo(利用人体先验的运动重定向,Motion Retargeting leveraging a HUman BOdy prior),这是一种成本效益高且便捷的方法,用于收集高质量的上半身<机器人,人类>配对姿态数据,而这类数据对于数据驱动的运动重定向方法至关重要。与现有方法通过将人类动作捕捉(MoCap)姿态转换为机器人姿态来收集<机器人,人类>姿态数据不同,我们的方法反其道而行之。我们首先采样多样化的随机机器人姿态,然后将其转换为人类姿态。然而,由于随机机器人姿态可能导致极端且不可行的人类姿态,我们提出了一种额外技术,通过利用从大量人类姿态数据中训练得到的人体先验来剔除极端姿态。只要设计或优化系统的超参数(包括尺寸比例因子和用于采样的关节角度范围),我们的数据收集方法即可用于任何人形机器人。除了该数据收集方法外,我们还提出了一种两阶段运动重定向神经网络,该网络可以通过监督学习在大量配对数据上进行训练。与其他通过无监督学习训练的基于学习的方法相比,我们发现使用充足的高质量配对数据训练的深度神经网络取得了显著的性能。我们的实验还表明,与使用原始且含噪声的数据训练模型相比,我们的数据过滤方法能产生更好的重定向结果。我们的代码和视频结果可在https://sites.google.com/view/mr-hubo/上获取。

英文摘要:

We propose MR HuBo(Motion Retargeting leveraging a HUman BOdy prior), a cost-effective and convenient method to collect high-quality upper body paired <robot, human> pose data, which is essential for data-driven motion retargeting methods. Unlike existing approaches which collect <robot, human> pose data by converting human MoCap poses into robot poses, our method goes in reverse. We first sample diverse random robot poses, and then convert them into human poses. However, since random robot poses can result in extreme and infeasible human poses, we propose an additional technique to sort out extreme poses by exploiting a human body prior trained from a large amount of human pose data. Our data collection method can be used for any humanoid robots, if one designs or optimizes the system's hyperparameters which include a size scale factor and the joint angle ranges for sampling. In addition to this data collection method, we also present a two-stage motion retargeting neural network that can be trained via supervised learning on a large amount of paired data. Compared to other learning-based methods trained via unsupervised learning, we found that our deep neural network trained with ample high-quality paired data achieved notable performance. Our experiments also show that our data filtering method yields better retargeting results than training the model with raw and noisy data. Our code and video results are available on https://sites.google.com/view/mr-hubo/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑