arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1901.04782cs.RO
收藏

语义视野下的自主探索与制图学习

Learning Autonomous Exploration and Mapping with Semantic Vision

ShanghaiTech University(上海科技大学)

Xiangyang Zhi, Xuming He, Sören Schwertfeger

摘要:

我们解决的问题,自主探索和地图的移动机器人使用视觉输入。探索和地图绘制是机器人领域的一个重要问题,其目标是使机器人能够自主地探索新的环境并创建地图以供将来使用。与经典的方法不同,我们提出了一种基于学习的方法,这项工作的基础上的语义解释的视觉场景。我们的方法是基于一个由三个模块组成的深度网络:语义分割网络,使用相机几何和探索行动网络映射。所有模块都是可区分的,因此整个管道都是基于演员-评论家框架进行端到端训练的。我们的网络一步一步地做出行动决策,同时生成自由空间地图。据我们所知,这是第一个将探索和映射公式化为学习框架的算法。我们验证我们的方法在模拟现实世界的环境中,并证明了竞争力的基线方法的性能增益。

英文摘要:

We address the problem of autonomous exploration and mapping for a mobile robot using visual inputs. Exploration and mapping is a well-known and key problem in robotics, the goal of which is to enable a robot to explore a new environment autonomously and create a map for future usage. Different to classical methods, we propose a learning-based approach this work based on semantic interpretation of visual scenes. Our method is based on a deep network consisting of three modules: semantic segmentation network, mapping using camera geometry and exploration action network. All modules are differentiable, so the whole pipeline is trained end-to-end based on actor-critic framework. Our network makes action decision step by step and generates the free space map simultaneously. To our best knowledge, this is the first algorithm that formulate exploration and mapping into learning framework. We validate our approach in simulated real world environments and demonstrate performance gains over competitive baseline approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑