A commonly used technique for managing AI complexity in real-time strategy (RTS) games is to use action and/or state abstractions. High-level abstractions can often lead to good strategic decision making, but tactical decision quality may suffer due to lost details. A competing method is to sample the search space which often leads to good tactical performance in simple scenarios, but poor high-level planning.
We propose to use a deep convolutional neural network (CNN) to select among a limited set of abstract action choices, and to utilize the remaining computation time for game tree search to improve low level tactics. The CNN is trained by supervised learning on game states labelled by Puppet Search, a strategic search algorithm that uses action abstractions. The network is then used to select a script --- an abstract action --- to produce low level actions for all units. Subsequently, the game tree search algorithm improves the tactical actions of a subset of units using a limited view of the game state only considering units close to opponent units.
Experiments in the microRTS game show that the combined algorithm results in higher win-rates than either of its two independent components and other state-of-the-art microRTS agents.
To the best of our knowledge, this is the first successful application of a convolutional network to play a full RTS game on standard game maps, as previous work has focused on sub-problems, such as combat, or on very small maps.
SAT-RTS: A systematic framework for tactical knowledge extraction and visualization-based analysis in real-time strategy games
School of Artificial Intelligence and Automation, China University of Geosciences(中国地质大学(武汉)人工智能与自动化学院);State Key Laboratory of Digital Intelligent Technology for Unmanned Coal Mining, Anhui University of Science & Technology(安徽理工大学无人开采数字智能技术重点实验室);Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems(湖北省复杂系统先进控制与智能自动化重点实验室);Engineering Research Center of Intelligent Technology for Geo-Exploration, Ministry of Education(地质探测智能技术工程研究中心,教育部);School of Artificial Intelligence, Anhui University of Science & Technology(安徽理工大学人工智能学院)
Tactical Decision for Multi-UGV Confrontation with a Vision-Language Model-Based Commander
Yangtze Delta Region Academy(扬子江地区学院);Beijing Institute of Technology(北京理工大学);School of Automation(自动化学院);Beihang University(北航大学);Advanced Research Institute of Multidisciplinary Sciences(多学科科学高级研究机构)
TacticCraft: Natural Language-Driven Tactical Adaptation for StarCraft II
Institute of Automation, Chinese Academy of Sciences, China(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences, China(中国科学院大学人工智能学院);Tencent AI Lab, Shenzhen, China(腾讯AI实验室);Nanjing Artificial Intelligence Research of IA, China(南京人工智能研究院)
BoxMind: Closed-loop AI strategy optimization for elite boxing validated in the 2024 Olympics
Department of Electronic Engineering, Tsinghua University(清华大学电子工程系);Tsinghua University(清华大学);Beijing Sport University(北京体育大学);Beijing National Research Center for Information Science and Technology(北京国家信息科学与技术研究中心)
Tactical Reward Shaping: Bypassing Reinforcement Learning with Strategy-Based Goals
ShanghaiTech University(上海科技大学)
深度强化学习(DRL)已经显示出其有前途的能力,可以直接从试错中学习最优策略。然而,如果奖励函数定义的学习目标“不是最佳”,学习可能会受到阻碍。我们证明,通过以一种反直觉但智能的方式设置竞争的目标/目标,而不是通过许多小时的DRL模拟来尝试解决方案,可以快速收敛到一个获胜的策略。ICRA-DJI RoboMaster AI Challenge是一款在部分可观察环境中进行机器人之间合作和竞争的游戏,与Counter-Strike游戏非常相似。与传统的游戏方法不同,奖励是在赢得比赛或击中敌人时给予的,我们的DRL算法在处于几何战略优势时奖励我们的机器人,这隐含地增加了获胜的机会。此外,我们使用深度Q学习(DQL)来生成移动的多智能体路径,通过避免碰撞来改善两个机器人之间的合作。最后,我们实现了一个变种A* 算法与DQL相同的隐式几何目标和比较结果。我们的结论是,一个良好的设定的目标可以提出问题的需要学习算法,与几何为基础的搜索优于DQL在许多数量级。
Do Persona-Infused LLMs Affect Performance in a Strategic Reasoning Game?
Bellini College of Artificial Intelligence, Cybersecurity and Computing(人工智能、网络安全与计算学院);University of South Florida(佛罗里达州立大学);Information Directorate(信息 Directorate);Air Force Research Library(空军研究图书馆)
Strategic Counterfactual Modeling of Deep-Target Airstrike Systems via Intervention-Aware Spatio-Causal Graph Networks
Dhurakij Pundit University(泰国易三仓大学);The University of Western Australia(西澳大利亚大学);Association for Computing Machinery(美国计算机协会);Royal Anthropological Institute(皇家人类学学会)
GameBench: Evaluating Strategic Reasoning Abilities of LLM Agents
Olin College of Engineering(奥林工程学院);University of Texas at Dallas(德克萨斯大学达拉斯分校);University of Oxford(牛津大学);University College London(伦敦大学学院);ShanghaiTech University(上海科技大学);Columbia University(哥伦比亚大学);University of Manchester(曼彻斯特大学)
From Images to Connections: Can DQN with GNNs learn the Strategic Game of Hex?
TU Darmstadt(达姆施塔特工业大学);Hessian Center for Artificial Intelligence (hessian.AI)(黑森人工智能中心);Centre for Cognitive Science, TU Darmstadt(达姆施塔特工业大学认知科学中心);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心)