arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.11292cs.RO
收藏

基于几何表示的挖掘式强化学习

Excavation Reinforcement Learning Using Geometric Representation

Baidu Research(百度研究院);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Qingkai Lu, Yifan Zhu, Liangjun Zhang

摘要:

在杂乱的环境中挖掘不规则的刚性物体,如破碎的岩石和木块,由于其复杂的相互作用动力学和高度可变的几何形状,非常具有挑战性。在本文中,我们采用强化学习(RL)来应对这一挑战,并学习策略,以规划一系列的挖掘轨迹不规则的刚性物体,挖掘场景的点云。此外,我们单独学习不需要人工标记的几何任务上的点云的紧凑表示。我们表明,使用该表示减少了RL的训练时间,同时实现了与端到端RL算法相似的渐近性能。当直接在真实场景中使用模拟训练的策略时,我们表明使用表示训练的策略优于端到端RL。据我们所知,本文提出了RL的第一个应用程序,规划一系列的挖掘轨迹的不规则刚性物体在混乱。

英文摘要:

Excavation of irregular rigid objects in clutter, such as fragmented rocks and wood blocks, is very challenging due to their complex interaction dynamics and highly variable geometries. In this paper, we adopt reinforcement learning (RL) to tackle this challenge and learn policies to plan for a sequence of excavation trajectories for irregular rigid objects, given point clouds of excavation scenes. Moreover, we separately learn a compact representation of the point cloud on geometric tasks that do not require human labeling. We show that using the representation reduces training time for RL, while achieving similar asymptotic performance compare to an end-to-end RL algorithm. When using a policy trained in simulation directly on a real scene, we show that the policy trained with the representation outperforms end-to-end RL. To our best knowledge, this paper presents the first application of RL to plan a sequence of excavation trajectories of irregular rigid objects in clutter.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑