arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.10086cs.AIcs.CYcs.LG
收藏

国际象棋个体行为的学习模型

Learning Models of Individual Behavior in Chess

University of Toronto(多伦多大学);Microsoft Research(微软研究院);Cornell University(康奈尔大学)

Reid McIlroy-Young, Russell Wang, Siddhartha Sen, Jon Kleinberg, Ashton Anderson

摘要:

能够捕捉类人行为的人工智能系统在人类可能希望从这些系统中学习、与它们合作或作为合作伙伴与它们进行长时间接触的情况下变得越来越有用。为了开发以人为本的人工智能系统,预测人类行为的问题-而不是预测最佳行为-已经受到了相当大的关注。现有的工作集中在从整体意义上捕捉人类行为,这可能会限制任何特定个人从与这些系统的交互中获得的好处。我们通过开发高度准确的国际象棋个人行为预测模型来扩展这一工作。国际象棋是探索人类与人工智能互动的一个丰富领域,因为它结合了一系列独特的属性:人工智能系统在许多年前就取得了超人的表现,但人类仍然与它们密切互动,无论是作为对手还是作为准备工具,并且有大量关于个人玩家游戏的记录数据。从Maia开始,这是一个在人类玩家群体上训练的AlphaZero的开源版本,我们证明了我们可以通过应用一系列微调方法来显着提高特定玩家移动的预测准确性。此外,我们的个性化模型可用于执行风格测量-预测谁做出了一组给定的动作-表明它们在个人层面上捕获了人类决策。我们的工作展示了一种使人工智能系统更好地与个人行为保持一致的方法,这可能会大大改善人类与人工智能的互动。

英文摘要:

AI systems that can capture human-like behavior are becoming increasingly useful in situations where humans may want to learn from these systems, collaborate with them, or engage with them as partners for an extended duration. In order to develop human-oriented AI systems, the problem of predicting human actions -- as opposed to predicting optimal actions -- has received considerable attention. Existing work has focused on capturing human behavior in an aggregate sense, which potentially limits the benefit any particular individual could gain from interaction with these systems. We extend this line of work by developing highly accurate predictive models of individual human behavior in chess. Chess is a rich domain for exploring human-AI interaction because it combines a unique set of properties: AI systems achieved superhuman performance many years ago, and yet humans still interact with them closely, both as opponents and as preparation tools, and there is an enormous corpus of recorded data on individual player games. Starting with Maia, an open-source version of AlphaZero trained on a population of human players, we demonstrate that we can significantly improve prediction accuracy of a particular player's moves by applying a series of fine-tuning methods. Furthermore, our personalized models can be used to perform stylometry -- predicting who made a given set of moves -- indicating that they capture human decision-making at an individual level. Our work demonstrates a way to bring AI systems into better alignment with the behavior of individual people, which could lead to large improvements in human-AI interaction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑