arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.02308cs.RO
收藏

语言引导的受限杂乱环境主动感知:基于物体重排规划

Language-guided Active Sensing of Confined, Cluttered Environments via Object Rearrangement Planning

Purdue University(普渡大学)

Weihan Chen, Hanwen Ren, Ahmed H. Qureshi

AI总结:

本文提出首个语言引导的主动感知方法,通过物体重排规划实现受限杂乱环境中特定区域的密集感知,在仿真和真实柜式环境中验证了其优越性能与泛化能力。

摘要:

语言引导的主动感知是机器人学的一个子任务,其中搭载传感器的机器人根据给定的语言指令,通过物体操作与环境高效交互,以最大化感知信息。这类任务出现在多种实际机器人应用中,如家庭服务、搜索救援和环境监测。尽管应用广泛,现有工作未考虑语言指令,且主要聚焦于表面感知,即从外部感知环境而不对其进行重排以实现密集感知。因此,本文首次提出一种语言引导的主动感知方法,允许用户通过物体操作观察环境的特定部分。我们的方法将环境与语言指令进行空间关联,确定最佳感知相机视点,然后迭代选择并重新定位最遮挡视线的物体,以提供感兴趣区域的密集感知。我们在仿真中针对不同基线算法评估了该方法,并在包含多个未知物体的真实受限柜式环境中进行了演示。结果表明,所提方法在不同指标上表现更优,并成功泛化到真实世界的复杂场景。

英文摘要:

Language-guided active sensing is a robotics subtask where a robot with an onboard sensor interacts efficiently with the environment via object manipulation to maximize perceptual information, following given language instructions. These tasks appear in various practical robotics applications, such as household service, search and rescue, and environment monitoring. Despite many applications, the existing works do not account for language instructions and have mainly focused on surface sensing, i.e., perceiving the environment from the outside without rearranging it for dense sensing. Therefore, in this paper, we introduce the first language-guided active sensing approach that allows users to observe specific parts of the environment via object manipulation. Our method spatially associates the environment with language instructions, determines the best camera viewpoints for perception, and then iteratively selects and relocates the best view-blocking objects to provide the dense perception of the region of interest. We evaluate our method against different baseline algorithms in simulation and also demonstrate it in real-world confined cabinet-like settings with multiple unknown objects. Our results show that the proposed method exhibits better performance across different metrics and successfully generalizes to real-world complex scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑