arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.09531cs.AI
收藏

基于场景先验知识的多Agent视觉语义导航

Multi-Agent Embodied Visual Semantic Navigation with Scene Prior Knowledge

Tsinghua University(清华大学)

Xinzhu Liu, Di Guo, Huaping Liu, Fuchun Sun

摘要:

在视觉语义导航中,机器人以自我为中心的视觉观察导航到目标对象,并给出目标的类别标签。这是一项有意义的任务,激发了相关研究的热潮。然而,现有的模型大多只对单个智能体导航有效,单个智能体在完成较复杂任务时效率低、容错能力差。多智能体协作可以提高系统的效率,具有很强的应用潜力。在本文中,我们提出了多智能体视觉语义导航,其中多个智能体与其他合作,以找到多个目标对象。这是一个具有挑战性的任务,需要智能体学习合理的合作策略,在通信带宽的限制下进行有效的探索。我们开发了一个层次化的决策框架,基于语义映射,场景先验知识,和通信机制来解决这个任务。在未知场景和已知场景下的实验结果表明,该模型比单智能体模型具有更高的准确性和效率。

英文摘要:

In visual semantic navigation, the robot navigates to a target object with egocentric visual observations and the class label of the target is given. It is a meaningful task inspiring a surge of relevant research. However, most of the existing models are only effective for single-agent navigation, and a single agent has low efficiency and poor fault tolerance when completing more complicated tasks. Multi-agent collaboration can improve the efficiency and has strong application potentials. In this paper, we propose the multi-agent visual semantic navigation, in which multiple agents collaborate with others to find multiple target objects. It is a challenging task that requires agents to learn reasonable collaboration strategies to perform efficient exploration under the restrictions of communication bandwidth. We develop a hierarchical decision framework based on semantic mapping, scene prior knowledge, and communication mechanism to solve this task. The results of testing experiments in unseen scenes with both known objects and unknown objects illustrate the higher accuracy and efficiency of the proposed model compared with the single-agent model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑