arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.14944cs.ROcs.CV

HRDexDB:用于跨本体灵巧抓取的配对人机数据集

HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments

Seoul National University(首尔国立大学);RLWRLD(RLWRLD实验室)

Jongbin Lim, Taeyun Ha, Seongho Cha, Kanghyeon Cho, Mingi Choi, Subin Jeon, Jisoo Kim, Byungjun Kim, Hanbyul Joo

AI总结:

提出HRDexDB,一个包含人类和多种机器人手的高保真灵巧抓取轨迹配对数据集,涵盖100种物体,提供高精度时空3D真值,作为跨本体灵巧操作的基础基准。

摘要:

我们提出了HRDexDB,一个配对的跨本体灵巧抓取数据集,包含高保真的灵巧抓取序列,涉及人类和多种机器人手。与现有数据集不同,HRDexDB提供了跨人类手和多种机器人手本体的全面抓取轨迹集合,涵盖100种不同物体。利用最先进的视觉方法和专用多相机系统,HRDexDB为操作者和被操作物体提供了高精度的时空3D地面真值运动。该数据集包含2.1K次抓取试验,每次试验都配有同步的视觉和运动学模态,并且触觉机器人手还提供了接触力信号。通过在同一目标物体上、在可比的抓取运动下提供人类灵巧性和机器人执行的紧密对齐捕捉,HRDexDB成为跨本体灵巧操作的基础基准。

英文摘要:

We present HRDexDB, a real-world 4D dexterous grasping dataset capturing 3D hand-object interaction trajectories over time across five embodiments. The dataset comprises 3.2K trials over 100 diverse objects. Using a synchronized multi-camera system and an integrated reconstruction pipeline, HRDexDB provides multi-view and egocentric RGB observations, 3D hand geometry, robot states, and object 6D pose trajectories, together with success/failure annotations. Human and robotic hands interact with shared objects, enabling the study of embodiment-dependent grasp strategies and contact patterns. We demonstrate the dataset's utility through human-to-robot contact map transfer, visual robot-object contact estimation, and retrieval-assisted grasping. Together, these results establish HRDexDB as a resource for studying and learning dexterous interactions across human and robotic embodiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑