arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1709.03480cs.AI
收藏

实时的策略游戏中策略学习与战术搜索的结合

Combining Strategic Learning and Tactical Search in Real-Time Strategy Games

University of Alberta(阿尔伯塔大学)

Nicolas A. Barriga, Marius Stanescu, Michael Buro

摘要:

在实时的【形】策略(RTS)游戏中管理AI复杂性的一种常用技术是使用动作和/或状态抽象。高层次的抽象通常可以导致良好的战略决策,但战术决策质量可能会受到损失的细节。一种竞争性的方法是对搜索空间进行采样,这通常会导致在简单场景中具有良好的战术性能,但高层规划较差。我们建议使用深度卷积神经网络(CNN)在有限的抽象动作选择中进行选择,并利用剩余的计算时间进行游戏树搜索来改进低级策略。CNN通过监督学习对Puppet Search标记的游戏状态进行训练,Puppet Search是一种使用动作抽象的策略搜索算法。然后,网络被用来选择一个脚本--一个抽象的动作--为所有单元产生低层次的动作。随后,游戏树搜索算法使用仅考虑接近对手单位的单位的游戏状态的有限视图来改进单位子集的战术动作。在microRTS游戏中的实验表明,该组合算法的结果在更高的胜率比它的两个独立的组件和其他国家的最先进的microRTS代理。据我们所知,这是卷积网络在标准游戏地图上玩完整RTS游戏的第一个成功应用,因为以前的工作主要集中在子问题上,例如战斗或非常小的地图。

英文摘要:

A commonly used technique for managing AI complexity in real-time strategy (RTS) games is to use action and/or state abstractions. High-level abstractions can often lead to good strategic decision making, but tactical decision quality may suffer due to lost details. A competing method is to sample the search space which often leads to good tactical performance in simple scenarios, but poor high-level planning. We propose to use a deep convolutional neural network (CNN) to select among a limited set of abstract action choices, and to utilize the remaining computation time for game tree search to improve low level tactics. The CNN is trained by supervised learning on game states labelled by Puppet Search, a strategic search algorithm that uses action abstractions. The network is then used to select a script --- an abstract action --- to produce low level actions for all units. Subsequently, the game tree search algorithm improves the tactical actions of a subset of units using a limited view of the game state only considering units close to opponent units. Experiments in the microRTS game show that the combined algorithm results in higher win-rates than either of its two independent components and other state-of-the-art microRTS agents. To the best of our knowledge, this is the first successful application of a convolutional network to play a full RTS game on standard game maps, as previous work has focused on sub-problems, such as combat, or on very small maps.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑