世界在你手中:一个大规模且开源的生态系统,用于在真实世界中学习以人类为中心的操纵
World In Your Hands: A Large-Scale and Open-Source Ecosystem for Learning Human-Centric Manipulation in the Wild
AI总结:
本文提出World In Your Hands,一个包含1000小时真实人类操纵数据的开源生态系统,通过高精度运动捕捉和多模态数据提升机器人在杂乱环境中的操作成功率。
摘要:
我们介绍了World In Your Hands (WIYH),一个大规模开源生态系统,包含超过1000小时在真实环境中采集的人类操纵数据,具有毫米级运动精度。具体而言,WIYH包括(1)Oracle套件,一种带有自动标注管道的可穿戴数据采集套件,用于精确的运动捕捉;(2)WIYH数据集,涵盖数百种技能的多模态操纵数据,在多样化的现实场景中总计超过1000小时;以及(3)支持从感知到行动任务的广泛注释和基准测试。此外,基于WIYH生态系统的实验表明,整合WIYH的人类中心数据将机器人在杂乱场景中的操作成功率从8%提升到60%。World In Your Hands为推进人类中心数据收集和跨身体政策学习提供了基础。所有数据和硬件设计都将开源。
英文摘要:
We introduce World In Your Hands (WIYH), a large-scale open-source ecosystem comprising over 1,000 hours of human manipulation data collected in-the-wild with millimeter-scale motion accuracy. Specifically, WIYH includes (1) the Oracle Suite, a wearable data collection kit with an auto-labeling pipeline for accurate motion capture; (2) the WIYH Dataset, featuring over 1,000 hours of multimodal manipulation data across hundreds of skills in diverse real-world scenarios; and (3) extensive annotations and benchmarks supporting tasks from perception to action. Furthermore, experiments based on the WIYH ecosystem show that integrating WIYH's human-centric data improves robotic manipulation success rates from 8% to 60% in cluttered scenes. World In Your Hands provides a foundation for advancing human-centric data collection and cross-embodiment policy learning. All data and hardware design will be open-source.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。