arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.08803cs.ROcs.CV
收藏

Zero-shot主动视觉搜索(ZAVIS):机器人助手的智能目标搜索

Zero-shot Active Visual Search (ZAVIS): Intelligent Object Search for Robotic Assistants

Korea University(高丽大学);Allen Institute for AI(艾伦人工智能研究所);Queens University(皇后大学)

Jeongeun Park, Taerim Yoon, Jejoon Hong, Youngjae Yu, Matthew Pan, Sungjoon Choi

摘要:

在本文中,我们专注于使用配备有视觉传感器的移动机器人(例如,RGBD相机)。传统的主动视觉搜索预先定义了一组要搜索的对象,使得这些技术在实践中受到限制。为了提供更多的灵活性,在主动视觉搜索,我们提出了一个系统,用户可以输入目标命令使用自由形式的语言,我们称之为这个系统的主动视觉搜索在野外(AVSW)。AVSW通过由静态地标(例如,书桌或床)。为了有效地规划目标搜索模式,AVSW在决定首先访问哪些地标时考虑基于常识知识的同现和预测不确定性。我们验证了所提出的方法相对于SR(成功率)和SPL(成功加权路径长度)在模拟和现实世界的环境。在模拟场景中,所提出的方法在SPL方面优于以前的方法,平均差距为0.283。我们进一步证明AVSW与先锋-3AT机器人在现实世界中的研究。

英文摘要:

In this paper, we focus on the problem of efficiently locating a target object described with free-form language using a mobile robot equipped with vision sensors (e.g., an RGBD camera). Conventional active visual search predefines a set of objects to search for, rendering these techniques restrictive in practice. To provide added flexibility in active visual searching, we propose a system where a user can enter target commands using free-form language; we call this system Active Visual Search in the Wild (AVSW). AVSW detects and plans to search for a target object inputted by a user through a semantic grid map represented by static landmarks (e.g., desk or bed). For efficient planning of object search patterns, AVSW considers commonsense knowledge-based co-occurrence and predictive uncertainty while deciding which landmarks to visit first. We validate the proposed method with respect to SR (success rate) and SPL (success weighted by path length) in both simulated and real-world environments. The proposed method outperforms previous methods in terms of SPL in simulated scenarios with an average gap of 0.283. We further demonstrate AVSW with a Pioneer-3AT robot in real-world studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑