arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.02243cs.RO
收藏

Mixline:一种混合强化学习框架在长时间双手搅拌咖啡任务中的应用

Mixline: A Hybrid Reinforcement Learning Framework for Long-horizon Bimanual Coffee Stirring Task

The Chinese University of Hong Kong(香港中文大学);Wuhan University(武汉大学)

Zheng Sun, Zhiqi Wang, Junjia Liu, Miao Li, Fei Chen

摘要:

像搅拌咖啡这样需要双臂协调的双手活动在日常生活中很常见,机器人很难学习。采用强化学习来学习这些任务是一个很有前途的课题,因为它使机器人能够探索双臂如何协调在一起完成同一任务。然而,这一领域有两个主要的挑战:协调机制和长期的任务分解。因此,我们提出了Mixline方法,通过在线算法分别学习子任务,然后通过离线算法根据生成的数据将它们组合在一起。我们构建了一个基于GPU加速的Isaac Gym的学习环境。在我们的工作中,双手机器人成功地学会了抓住,握住和举起勺子和杯子,将它们插入并搅拌咖啡。所提出的方法有可能被扩展到其他长期的双手任务。

英文摘要:

Bimanual activities like coffee stirring, which require coordination of dual arms, are common in daily life and intractable to learn by robots. Adopting reinforcement learning to learn these tasks is a promising topic since it enables the robot to explore how dual arms coordinate together to accomplish the same task. However, this field has two main challenges: coordination mechanism and long-horizon task decomposition. Therefore, we propose the Mixline method to learn sub-tasks separately via the online algorithm and then compose them together based on the generated data through the offline algorithm. We constructed a learning environment based on the GPU-accelerated Isaac Gym. In our work, the bimanual robot successfully learned to grasp, hold and lift the spoon and cup, insert them together and stir the coffee. The proposed method has the potential to be extended to other long-horizon bimanual tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑