arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.09800cs.AIcs.LG
收藏

AI独特协作团队成员决策模型的强化学习

Reinforcement Learning on Human Decision Models for Uniquely Collaborative AI Teammates

Johns Hopkins University Applied Physics Laboratory(约翰斯·霍普金斯大学应用物理实验室)

Nicholas Kantack

摘要:

2021年,约翰霍普金斯大学应用物理实验室举办了一项内部挑战赛,旨在开发能够在协作纸牌游戏Hanabi中表现出色的人工智能(AI)代理。代理人被评估他们与以前从未遇到过的人类玩家一起玩的能力。这项研究详细介绍了通过实现16.5的人类游戏平均得分赢得挑战的代理的开发,超过了目前最先进的人类机器人Hanabi得分。获胜的代理的开发包括观察和准确建模作者在Hanabi中的决策,然后用作者的行为克隆进行训练。值得注意的是,智能体发现了一种与人类互补的游戏风格,首先模仿人类的决策,然后探索类似人类的策略的变化,从而获得更高的模拟人类机器人得分。这项工作详细研究了这个与人类兼容的Hanabi队友的设计和实现,以及人类互补策略的存在和影响,以及如何探索它们,以便在人机团队中更成功地应用AI。

英文摘要:

In 2021 the Johns Hopkins University Applied Physics Laboratory held an internal challenge to develop artificially intelligent (AI) agents that could excel at the collaborative card game Hanabi. Agents were evaluated on their ability to play with human players whom the agents had never previously encountered. This study details the development of the agent that won the challenge by achieving a human-play average score of 16.5, outperforming the current state-of-the-art for human-bot Hanabi scores. The winning agent's development consisted of observing and accurately modeling the author's decision making in Hanabi, then training with a behavioral clone of the author. Notably, the agent discovered a human-complementary play style by first mimicking human decision making, then exploring variations to the human-like strategy that led to higher simulated human-bot scores. This work examines in detail the design and implementation of this human compatible Hanabi teammate, as well as the existence and implications of human-complementary strategies and how they may be explored for more successful applications of AI in human machine teams.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑