Cross-platform strategy game automation remains a challenge due to diverse user interfaces and dynamic battlefield environments. Existing Vision--Language Models (VLMs) struggle with generalization across heterogeneous platforms and lack precision in interface understanding and action execution. We introduce Yanyun-3, a VLM-based agent that integrates Qwen2.5-VL for visual reasoning and UI-TARS for interface execution. We propose a novel data organization principle -- combination granularity -- to distinguish intra-sample fusion and inter-sample mixing of multimodal data (static images, multi-image sequences, and videos). The model is fine-tuned using QLoRA on a curated dataset across three strategy game platforms. The optimal strategy (M*V+S) achieves a 12.98x improvement in BLEU-4 score and a 63% reduction in inference time compared to full fusion. Yanyun-3 successfully executes core tasks (e.g., target selection, resource allocation) across platforms without platform-specific tuning. Our findings demonstrate that structured multimodal data organization significantly enhances VLM performance in embodied tasks. Yanyun-3 offers a generalizable framework for GUI automation, with broader implications for robotics and autonomous systems.
AI GameStore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Games
MIT(麻省理工学院);Harvard University(哈佛大学);University of British Columbia(不列颠哥伦比亚大学);Princeton University(普林斯顿大学);University of Cambridge(剑桥大学);Universitat Politècnica de València(瓦伦西亚理工大学)
World of Bugs: A Platform for Automated Bug Detection in 3D Video Games
Royal Holloway University of London(伦敦大学皇家霍洛威学院)
我们介绍了World of Bugs(WOB),一个旨在支持视频游戏中自动错误检测(ABD)研究的开放平台。我们讨论了ABD中的一些悬而未决的问题以及它们与平台设计的关系,并认为如果要取得进一步的进展,就需要基于学习的解决方案。该平台的主要功能是越来越多的常见视频游戏错误,可用于训练和评估ABD方法。
Games for Artificial Intelligence Research: A Review and Perspectives
Research Institute of Trustworthy Autonomous System, Southern University of Science and Technology (SUSTech)(南方科技大学可信自主系统研究院);Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation(广东省类脑智能计算重点实验室);Department of Computer Science and Engineering of SUSTech(南方科技大学计算机科学与工程系);LightSpeed Studios, Tencent(腾讯天美工作室)
GraphChase: A Platform and Benchmark for Urban Network Security Games
City University of Hong Kong(香港城市大学);CAIR, Hong Kong Institute of Science & Innovation, CAS(中国科学院香港创新研究院人工智能与机器人创新中心);Nanyang Technological University(南洋理工大学);Georgia Institute of Technology(佐治亚理工学院);University of Toronto(多伦多大学);The University of Hong Kong(香港大学)
A Platform for Generating Educational Activities to Teach English as a Second Language
Facultad de Ingeniería, Universidad de la República(工程学院,乌拉圭共和国大学);Facultad de Información y Comunicación, Universidad de la República(信息与通信学院,乌拉圭共和国大学);Indiana University of Pennsylvania(宾夕法尼亚大学)
Arena: A General Evaluation Platform and Building Toolkit for Multi-Agent Intelligence
University of Oxford(牛津大学);Lighthouse(灯塔公司);Beihang University(北京航空航天大学);Hebei University of Technology(河北工业大学);Imperial College London(帝国理工学院);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)
Copiloting Autonomous Multi-Robot Missions: A Game-inspired Supervisory Control Interface
Polytechnique Montreal(蒙特利尔理工学院);NASA Jet Propulsion Laboratory, California Institute of Technology(美国国家航空航天局喷气推进实验室,加州理工学院);University of Southern California(南加州大学);University of California, Riverside(加州大学河滨分校)