几何重定向:一种有原则的超快神经手部重定向算法
Geometric Retargeting: A Principled, Ultrafast Neural Hand Retargeting Algorithm
AI总结:
本文提出GeoRT,一种无监督、1KHz超快神经手部重定向算法,通过新颖几何目标函数在保证运动保真、C-space覆盖和防自碰撞的同时实现最先进速度与精度,并支持DexGen等基础控制器进行灵活后处理。
摘要:
我们提出几何重定向(GeoRT),一种用于遥操作的超快且有原则的神经手部重定向算法,作为我们近期Dexterity Gen(DexGen)系统的一部分开发。GeoRT以1KHz的频率将人类手指关键点转换为机器人手部关键点,以显著更少的超参数实现了最先进的速度和精度。这种高速能力支持灵活的后处理,例如利用基础控制器进行动作校正,如DexGen。GeoRT以无监督方式训练,无需对手部配对进行人工标注。GeoRT的核心在于新颖的几何目标函数,这些函数捕捉了重定向的本质:保持运动保真度、确保配置空间(C-space)覆盖、通过高平坦度维持均匀响应、捏合对应关系以及防止自碰撞。该方法无需密集的测试时优化,为实时手部重定向提供了更具可扩展性和实用性的解决方案。
英文摘要:
We introduce Geometric Retargeting (GeoRT), an ultrafast, and principled neural hand retargeting algorithm for teleoperation, developed as part of our recent Dexterity Gen (DexGen) system. GeoRT converts human finger keypoints to robot hand keypoints at 1KHz, achieving state-of-the-art speed and accuracy with significantly fewer hyperparameters. This high-speed capability enables flexible postprocessing, such as leveraging a foundational controller for action correction like DexGen. GeoRT is trained in an unsupervised manner, eliminating the need for manual annotation of hand pairs. The core of GeoRT lies in novel geometric objective functions that capture the essence of retargeting: preserving motion fidelity, ensuring configuration space (C-space) coverage, maintaining uniform response through high flatness, pinch correspondence and preventing self-collisions. This approach is free from intensive test-time optimization, offering a more scalable and practical solution for real-time hand retargeting.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。