arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.11174cs.AIcs.MA
收藏

TanksWorld:一个用于AI安全性研究的多Agent环境

TanksWorld: A Multi-Agent Environment for AI Safety Research

Intelligent Systems Center(智能系统中心);Johns Hopkins Applied Physics Lab(约翰斯·霍普金斯应用物理实验室)

Corban G. Rivera, Olivia Lyons, Arielle Summitt, Ayman Fatima, Ji Pak, William Shao, Robert Chalmers, Aryeh Englander, Edward W. Staley, I-Jeng Wang, Ashley J. Llorens

摘要:

创建能够执行复杂任务的人工智能(AI)的能力正在迅速超过我们确保AI系统安全可靠运行的能力。幸运的是,针对这种不对称性,人工智能安全研究正在兴起,但还有很长的路要走。特别是,最近为说明人工智能安全风险而创建的模拟环境相对简单,或者只关注特定问题。因此,我们迫切需要人工智能安全研究环境,以抽象复杂现实世界应用的基本方面。在这项工作中,我们介绍了人工智能安全坦克世界作为人工智能安全研究的环境,有三个基本方面:竞争性能目标,人机合作和多智能体竞争。AI安全坦克世界旨在通过提供一个软件框架来支持具有系统性能和安全目标的比赛,从而加速安全多智能体决策算法的进步。作为一项正在进行的工作,本文介绍了我们的研究目标和学习环境与参考代码和基线性能指标,以遵循在未来的工作。

英文摘要:

The ability to create artificial intelligence (AI) capable of performing complex tasks is rapidly outpacing our ability to ensure the safe and assured operation of AI-enabled systems. Fortunately, a landscape of AI safety research is emerging in response to this asymmetry and yet there is a long way to go. In particular, recent simulation environments created to illustrate AI safety risks are relatively simple or narrowly-focused on a particular issue. Hence, we see a critical need for AI safety research environments that abstract essential aspects of complex real-world applications. In this work, we introduce the AI safety TanksWorld as an environment for AI safety research with three essential aspects: competing performance objectives, human-machine teaming, and multi-agent competition. The AI safety TanksWorld aims to accelerate the advancement of safe multi-agent decision-making algorithms by providing a software framework to support competitions with both system performance and safety objectives. As a work in progress, this paper introduces our research objectives and learning environment with reference code and baseline performance metrics to follow in a future work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑