DeXtreme:从仿真到现实的敏捷灵巧操作迁移
DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Reality
AI总结:
本文提出一种基于深度强化学习的鲁棒灵巧操作策略和姿态估计器,通过仿真到现实迁移,使拟人化机器人手在视觉引导下实现敏捷操作,性能优于现有视觉策略。
摘要:
近期的研究表明,深度强化学习(RL)算法能够在仿真中学习复杂的机器人行为,包括多指操作领域。然而,由于仿真与现实之间的差距,此类模型在向现实世界迁移时可能面临挑战。在本文中,我们提出了我们的技术来训练:a)一种能够在拟人化机器人手上执行鲁棒灵巧操作的策略,以及b)一种鲁棒的姿态估计器,适合提供关于被操作物体状态的可靠实时信息。我们的策略经过训练,能够适应仿真中的各种条件。因此,在相同的重新定向任务上,我们基于视觉的策略显著优于文献中的最佳视觉策略,并且与通过动作捕捉系统获得特权状态信息的策略具有竞争力。我们的工作再次证实了在不同类型的硬件和仿真器设置下,特别是我们使用的Allegro Hand和Isaac Gym基于GPU的仿真器,进行灵巧操作仿真到现实迁移的可能性。此外,它还为研究人员使用常见且经济实惠的机器人手和相机实现此类结果开辟了可能性。所得策略的视频和补充信息,包括实验和演示,可在 https://dextreme.org/ 找到。
英文摘要:
Recent work has demonstrated the ability of deep reinforcement learning (RL) algorithms to learn complex robotic behaviours in simulation, including in the domain of multi-fingered manipulation. However, such models can be challenging to transfer to the real world due to the gap between simulation and reality. In this paper, we present our techniques to train a) a policy that can perform robust dexterous manipulation on an anthropomorphic robot hand and b) a robust pose estimator suitable for providing reliable real-time information on the state of the object being manipulated. Our policies are trained to adapt to a wide range of conditions in simulation. Consequently, our vision-based policies significantly outperform the best vision policies in the literature on the same reorientation task and are competitive with policies that are given privileged state information via motion capture systems. Our work reaffirms the possibilities of sim-to-real transfer for dexterous manipulation in diverse kinds of hardware and simulator setups, and in our case, with the Allegro Hand and Isaac Gym GPU-based simulation. Furthermore, it opens up possibilities for researchers to achieve such results with commonly-available, affordable robot hands and cameras. Videos of the resulting policy and supplementary information, including experiments and demos, can be found at https://dextreme.org/
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。