从不完美的人类运动数据中学习竞技型人形网球技能
Learning Athletic Humanoid Tennis Skills from Imperfect Human Motion Data
AI总结:
本文提出LATENT系统,通过不完美的网球运动数据学习人形机器人网球技能,提升真实场景中的网球表现。
摘要:
人类运动员展示了灵活且高度动态的网球技能,以成功进行高速网球球的对抗。然而,在人形机器人上复现此类行为具有挑战性,部分原因是缺乏完美的机器人动作数据或人类运动学运动数据作为参考。本文提出LATENT,一个从不完美的人类运动数据中学习竞技型人形网球技能的系统。不完美的人类运动数据仅包含捕捉网球运动中基本技能的运动片段,而非精确完整的真人网球运动序列,从而显著降低了数据收集的难度。我们的关键洞察是,尽管不完美,此类近现实数据仍提供了关于网球场景中人类基本技能的先验知识。通过进一步的修正和组合,我们学习了一种人形策略,能够在各种条件下一致地击打 incoming 球并将其返回到目标位置,同时保持自然的运动风格。我们还提出了一系列设计以实现鲁棒的仿真到现实转移,并在Unitree G1人形机器人上部署我们的策略。我们的方法在现实世界中取得了令人惊讶的结果,并能稳定地与人类玩家进行多拍对抗。项目页面:https://zzk273.github.io/LATENT/
英文摘要:
Human athletes demonstrate versatile and highly-dynamic tennis skills to successfully conduct competitive rallies with a high-speed tennis ball. However, reproducing such behaviors on humanoid robots is difficult, partially due to the lack of perfect humanoid action data or human kinematic motion data in tennis scenarios as reference. In this work, we propose LATENT, a system that Learns Athletic humanoid TEnnis skills from imperfect human motioN daTa. The imperfect human motion data consist only of motion fragments that capture the primitive skills used when playing tennis rather than precise and complete human-tennis motion sequences from real-world tennis matches, thereby significantly reducing the difficulty of data collection. Our key insight is that, despite being imperfect, such quasi-realistic data still provide priors about human primitive skills in tennis scenarios. With further correction and composition, we learn a humanoid policy that can consistently strike incoming balls under a wide range of conditions and return them to target locations, while preserving natural motion styles. We also propose a series of designs for robust sim-to-real transfer and deploy our policy on the Unitree G1 humanoid robot. Our method achieves surprising results in the real world and can stably sustain multi-shot rallies with human players. Project page: https://zzk273.github.io/LATENT/
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。