通过人体运动重定向实现20自由度ByteDexter机械手的灵巧遥操作
Dexterous Teleoperation of 20-DoF ByteDexter Hand via Human Motion Retargeting
AI总结:
本文提出一个手-臂遥操作系统,结合20自由度连杆驱动拟人机械手和基于优化的运动重定向方法,实现实时高保真复现人类手部运动,并通过灵巧操作和长时程整理任务验证其生成高质量演示数据的能力。
摘要:
复现人类水平的灵巧性仍然是机器人学的一项根本性挑战,需要从机电一体化设计到高自由度(DoF)机械手控制的集成解决方案。虽然模仿学习在将人类灵巧性迁移到机器人方面展现出前景,但训练策略的有效性依赖于人类演示数据的质量。我们通过一个手-臂遥操作系统弥合这一差距,该系统具备:(1)一个20自由度连杆驱动的拟人机械手,用于仿生灵巧性;以及(2)基于优化的运动重定向,用于实时、高保真地复现复杂的人类手部运动,并实现无缝的手-臂协调。我们通过大量实证评估验证了该系统,包括灵巧的手内操作任务,以及一个长时程任务,该任务要求整理一个杂乱摆放着九个物体的化妆台。实验结果表明,该系统具有直观的遥操作界面、实时控制能力,并能够生成高质量的演示数据。更多细节请参阅随附视频。
英文摘要:
Replicating human--level dexterity remains a fundamental robotics challenge, requiring integrated solutions from mechatronic design to the control of high degree--of--freedom (DoF) robotic hands. While imitation learning shows promise in transferring human dexterity to robots, the efficacy of trained policies relies on the quality of human demonstration data. We bridge this gap with a hand--arm teleoperation system featuring: (1) a 20--DoF linkage--driven anthropomorphic robotic hand for biomimetic dexterity, and (2) an optimization--based motion retargeting for real--time, high--fidelity reproduction of intricate human hand motions and seamless hand--arm coordination. We validate the system via extensive empirical evaluations, including dexterous in-hand manipulation tasks and a long--horizon task requiring the organization of a cluttered makeup table randomly populated with nine objects. Experimental results demonstrate its intuitive teleoperation interface with real--time control and the ability to generate high--quality demonstration data. Please refer to the accompanying video for further details.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。