MobileH2R:仅从可扩展且多样化的合成数据中学习可泛化的人到移动机器人交接
MobileH2R: Learning Generalizable Human to Mobile Robot Handover Exclusively from Scalable and Diverse Synthetic Data
AI总结:
提出 MobileH2R 框架,通过可扩展的多样化合成人体运动、安全演示生成与 4D 模仿学习,训练移动机器人闭环交接策略,无需真实演示且成功率较基线至少提升 15%。
摘要:
本文介绍了 MobileH2R,这是一个用于学习可泛化的、基于视觉的人到移动机器人(H2MR)交接技能的框架。与传统的固定基座交接不同,该任务要求移动机器人借助其移动能力,在较大的工作空间内可靠地接收物体。我们的核心洞见是:可泛化的交接技能可以在仿真器中利用高质量合成数据培养,而无需真实世界演示。为此,我们提出了一条用于生成多样化合成全身人体运动数据的可扩展流程、一种用于创建安全且易于模仿的演示的自动化方法,以及一种高效的 4D 模仿学习方法,用于将大规模演示蒸馏为具有底盘-机械臂协调能力的闭环策略。在仿真器和真实世界中的实验评估表明,在所有情况下,相较基线方法均有显著提升(成功率至少提高 15%)。实验还验证了大规模且多样化的合成数据可极大增强机器人学习,凸显了我们可扩展框架的价值。
英文摘要:
This paper introduces MobileH2R, a framework for learning generalizable vision-based human-to-mobile-robot (H2MR) handover skills. Unlike traditional fixed-base handovers, this task requires a mobile robot to reliably receive objects in a large workspace enabled by its mobility. Our key insight is that generalizable handover skills can be developed in simulators using high-quality synthetic data, without the need for real-world demonstrations. To achieve this, we propose a scalable pipeline for generating diverse synthetic full-body human motion data, an automated method for creating safe and imitation-friendly demonstrations, and an efficient 4D imitation learning method for distilling large-scale demonstrations into closed-loop policies with base-arm coordination. Experimental evaluations in both simulators and the real world show significant improvements (at least +15% success rate) over baseline methods in all cases. Experiments also validate that large-scale and diverse synthetic data greatly enhances robot learning, highlighting our scalable framework.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。