arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.00047cs.ROcs.HC
收藏

SocNavBench:一个用于评估社会导航的接地模拟测试框架

SocNavBench: A Grounded Simulation Testing Framework for Evaluating Social Navigation

Carnegie Mellon University(卡内基梅隆大学)

Abhijat Biswas, Allan Wang, Gustavo Silvera, Aaron Steinfeld, Henny Admoni

摘要:

人机交互(HRI)社区已经开发了许多方法,让机器人与人类一起安全地进行社交导航。然而,评估这些作品的实验程序通常是基于每种方法构建的。这种不同的评价使得很难在文献中比较这些方法的性能。为了弥合这一差距,我们引入了SocNavBench,一个用于评估社交导航算法的模拟框架。SocNavBench包括一个模拟器,具有照片般逼真的功能和基于真实世界行人数据的策划社交导航场景。我们还提供了一套指标来量化这些情况下的导航算法的性能的实现。总而言之,SocNavBench提供了一个测试框架,用于以一致和可解释的方式评估不同的社交导航方法。为了说明它的使用,我们演示了测试三个现有的社会导航方法和SocNavBench的基线方法,显示如何套指标有助于推断他们的性能权衡。我们的代码是开源的,允许社区添加新的场景和指标,以帮助发展SocNavBench,以反映我们对社交导航理解的进步。

英文摘要:

The human-robot interaction (HRI) community has developed many methods for robots to navigate safely and socially alongside humans. However, experimental procedures to evaluate these works are usually constructed on a per-method basis. Such disparate evaluations make it difficult to compare the performance of such methods across the literature. To bridge this gap, we introduce SocNavBench, a simulation framework for evaluating social navigation algorithms. SocNavBench comprises a simulator with photo-realistic capabilities and curated social navigation scenarios grounded in real-world pedestrian data. We also provide an implementation of a suite of metrics to quantify the performance of navigation algorithms on these scenarios. Altogether, SocNavBench provides a test framework for evaluating disparate social navigation methods in a consistent and interpretable manner. To illustrate its use, we demonstrate testing three existing social navigation methods and a baseline method on SocNavBench, showing how the suite of metrics helps infer their performance trade-offs. Our code is open-source, allowing the addition of new scenarios and metrics by the community to help evolve SocNavBench to reflect advancements in our understanding of social navigation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑