arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.06887cs.RO
收藏

基于深度强化学习的视觉不规则避障框架

A Vision-based Irregular Obstacle Avoidance Framework via Deep Reinforcement Learning

Dalian University of Technology(大连理工大学);Fuzhou University(福州大学);Northwestern Polytechnical University(西北工业大学)

Lingping Gao, Jianchuan Ding, Wenxi Liu, Haiyin Piao, Yuxin Wang, Xin Yang, Baocai Yin

摘要:

深度强化学习在基于激光的避碰工作中取得了巨大的成功,因为激光能够感知到准确的深度信息,没有太多的冗余数据,这可以保持算法从仿真环境迁移到现实世界时的鲁棒性。然而,高成本的激光装置不仅难以大规模应用,而且对不规则物体(例如,在本文中,我们提出了一个基于视觉的碰撞避免框架来解决这个具有挑战性的问题。我们的方法试图估计的深度,并结合从RGB数据的语义信息,以获得一种新的数据形式,伪激光数据,它结合了视觉信息和激光信息的优点。与传统激光数据只包含在一定高度捕获的一维距离信息相比,我们提出的伪激光数据编码了图像中的深度信息和语义信息,这使得我们的方法对不规则障碍物更有效。此外,由于估计的深度信息不准确,我们在训练阶段自适应地向激光数据添加噪声,以增加我们的模型在现实世界中的鲁棒性。实验结果表明,我们的框架在几个看不见的虚拟和现实世界的情况下,达到了最先进的性能。

英文摘要:

Deep reinforcement learning has achieved great success in laser-based collision avoidance work because the laser can sense accurate depth information without too much redundant data, which can maintain the robustness of the algorithm when it is migrated from the simulation environment to the real world. However, high-cost laser devices are not only difficult to apply on a large scale but also have poor robustness to irregular objects, e.g., tables, chairs, shelves, etc. In this paper, we propose a vision-based collision avoidance framework to solve the challenging problem. Our method attempts to estimate the depth and incorporate the semantic information from RGB data to obtain a new form of data, pseudo-laser data, which combines the advantages of visual information and laser information. Compared to traditional laser data that only contains the one-dimensional distance information captured at a certain height, our proposed pseudo-laser data encodes the depth information and semantic information within the image, which makes our method more effective for irregular obstacles. Besides, we adaptively add noise to the laser data during the training stage to increase the robustness of our model in the real world, due to the estimated depth information is not accurate. Experimental results show that our framework achieves state-of-the-art performance in several unseen virtual and real-world scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑