arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.03809cs.ROcs.HCcs.MA
收藏

基于自然语言的风险感知多机器人SaR规划

Exploiting Natural Language for Efficient Risk-Aware Multi-robot SaR Planning

Cornell University(康奈尔大学)

Vikram Shree, Beatriz Asfora, Rachel Zheng, Samantha Hong, Jacopo Banfi, Mark Campbell

摘要:

开发对场景的高层次理解的能力,例如感知危险级别,可以证明在规划多机器人搜索和救援(SaR)任务中是有价值的。在这项工作中,我们建议独特地利用自然语言描述的任务总指挥官和图像数据捕获的机器人来估计现场的危险。给定描述和图像,使用最先进的深度神经网络来评估相应的相似性分数,然后将其转换为危险级别的概率分布。由于常用的非语言数据集不能很好地代表SaR任务,我们从现实灾难场景中拍摄的合成图像中收集了一个大规模的图像描述数据集,并用它来训练我们的机器学习模型。一个风险意识的变体的多机器人高效搜索路径规划(MESPP)的问题,然后制定使用的危险估计,以占高风险的位置,在环境中规划搜索路径。该问题通过基于混合线性规划的分布式方法来解决。我们的实验表明,我们的框架允许规划更安全但非常成功的搜索任务,遵守SaR任务的两个最重要的方面:确保搜索者和受害者的安全。

英文摘要:

The ability to develop a high-level understanding of a scene, such as perceiving danger levels, can prove valuable in planning multi-robot search and rescue (SaR) missions. In this work, we propose to uniquely leverage natural language descriptions from the mission commander in chief and image data captured by robots to estimate scene danger. Given a description and an image, a state-of-the-art deep neural network is used to assess a corresponding similarity score, which is then converted into a probabilistic distribution of danger levels. Because commonly used visio-linguistic datasets do not represent SaR missions well, we collect a large-scale image-description dataset from synthetic images taken from realistic disaster scenes and use it to train our machine learning model. A risk-aware variant of the Multi-robot Efficient Search Path Planning (MESPP) problem is then formulated to use the danger estimates in order to account for high-risk locations in the environment when planning the searchers' paths. The problem is solved via a distributed approach based on Mixed-Integer Linear Programming. Our experiments demonstrate that our framework allows to plan safer yet highly successful search missions, abiding to the two most important aspects of SaR missions: to ensure both searchers' and victim safety.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑