Position Paper: Agent AI Towards a Holistic Intelligence
Stanford University（斯坦福大学）；University of California, Los Angeles（加利福尼亚大学洛杉矶分校）；Microsoft Gaming US（美国微软游戏部门）；MSR Accelerator（微软研究院加速器）；MSR AI Frontiers（微软研究院人工智能前沿部门）；Microsoft Research Core（微软研究院核心部门）；Microsoft Applied Robotics Research（微软应用机器人研究院）
本文倡导从还原论转向整体智能，提出整合大型基础模型与智能体行动的 Agent AI 及 Agent Foundation Model，并探讨其跨领域能力与认知意识意义。
摘要：
大型基础模型的最新进展显著增强了我们对开放世界环境中感官信息的理解。在利用基础模型能力时，AI研究必须摆脱过度还原论，转而强调作为凝聚整体发挥作用的系统。具体而言，我们强调发展 Agent AI——一种将大型基础模型整合到智能体行动中的具身系统。Agent AI 这一新兴领域涵盖广泛的现有具身与基于智能体的多模态交互，包括机器人、游戏和医疗保健系统等。本文提出一种用于实现具身智能行为的新型大型行动模型，即 Agent Foundation Model。在这一思想之上，我们讨论 Agent AI 如何在多种领域和任务中展现卓越能力，挑战我们对学习与认知的理解。此外，我们从跨学科视角探讨 Agent AI 的潜力，在科学论述中强调 AI 认知与意识。我们相信这些讨论可为未来研究方向奠定基础，并鼓励更广泛的社会参与。
英文摘要：
Recent advancements in large foundation models have remarkably enhanced our understanding of sensory information in open-world environments. In leveraging the power of foundation models, it is crucial for AI research to pivot away from excessive reductionism and toward an emphasis on systems that function as cohesive wholes. Specifically, we emphasize developing Agent AI -- an embodied system that integrates large foundation models into agent actions. The emerging field of Agent AI spans a wide range of existing embodied and agent-based multimodal interactions, including robotics, gaming, and healthcare systems, etc. In this paper, we propose a novel large action model to achieve embodied intelligent behavior, the Agent Foundation Model. On top of this idea, we discuss how agent AI exhibits remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. Furthermore, we discuss the potential of Agent AI from an interdisciplinary perspective, underscoring AI cognition and consciousness within scientific discourse. We believe that those discussions serve as a basis for future research directions and encourage broader societal engagement.
MMSI-Video-Bench: A Holistic Benchmark for Video-Based Spatial Intelligence
Shanghai AI Laboratory（上海人工智能实验室）；Shanghai Jiaotong University（上海交通大学）；The Chinese University of Hong Kong（香港中文大学）；Zhejiang University（浙江大学）；Beihang University（北京航空航天大学）；Xi’an Jiaotong University（西安交通大学）；University of Hong Kong（香港大学）；Fudan University（复旦大学）；University of California, Los Angeles（加州大学洛杉矶分校）
MME-Emotion: A Holistic Evaluation Benchmark for Emotional Intelligence in Multimodal Large Language Models
The Chinese University of Hong Kong（香港中文大学）；Tongyi Lab（通义实验室）；SZTU（深圳技术大学）；Peking University（北京大学）；Tongji University（同济大学）；CASIA（中国科学院自动化所）；Tencent（腾讯）；UCLA（加州大学洛杉矶分校）；Westlake University（西湖大学）；NTU（国立大学）
Position: Artificial Intelligence Needs Meta Intelligence -- the Case for Metacognitive AI
University of Texas Rio Grande Valley, Edinburg, TX, USA（德克萨斯大学里奥格兰德谷分校）；Rochester Institute of Technology, Rochester, NY, USA（罗切斯特理工学院）；Syracuse University, Syracuse, NY, USA（锡拉库萨大学）
A Survey of Hybrid Human-Artificial Intelligence for Social Computing
University of Science and Technology Beijing（北京科技大学）；Beijing Engineering Research Center for Cyberspace Data Analysis and Applications（北京网络空间数据分析与应用工程研究中心）；China University of Petroleum（中国石油大学）；Ulster University（阿尔斯特大学）
Intelligent Agents with Emotional Intelligence: Current Trends, Challenges, and Future Prospects
School of Computer Engineering, Iran University of Science and Technology（伊朗科学技术大学计算机工程学院）；College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算机与数据科学学院）
AnyECG: Evolved ECG Foundation Model for Holistic Health Profiling
National Institute of Health Data Science, Peking University（北京大学健康数据科学国家研究院）；Institute of Medical Technology, Health Science Center of Peking University（北京大学医学技术研究所）；Department of Internal Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology（同济大学同济医学院内科部）；Department of Cardiology, Peking University People’s Hospital（北京大学人民医院心内科）；Department of Epidemiology and Biostatistics, School of Public Health, Peking University（北京大学公共卫生学院流行病与生物统计学系）；Peking University Center for Public Health and Epidemic Preparedness & Response（北京大学公共卫生与突发卫生事件应对中心）；Key Laboratory of Epidemiology of Major Diseases (Peking University), Ministry of Education（北京大学主要疾病流行病学重点实验室）；School of Intelligence Science and Technology, Peking University（北京大学智能科学与技术学院）；HeartVoice Medical Technology（心声医疗技术）
Concurrent validity of computer-vision artificial intelligence player tracking software using broadcast footage
Australian Catholic University（澳大利亚天主教大学）；Leeds Beckett University（利兹贝克特大学）；Fédération Internationale de Football Association (FIFA)（国际足球联合会（FIFA））；Sheffield Hallam University（谢菲尔德哈勒姆大学）；Victoria University（维多利亚大学）
History of generative Artificial Intelligence (AI) chatbots: past, present, and future development
University of Massachusetts Lowell（马萨诸塞大学洛厄尔分校）；Asian University of Bangladesh（亚洲孟加拉大学）；Sonargaon University（索纳尔冈大学）；Babes-Bolyai University（巴比什-博雅依大学）；Islamic University（伊斯兰大学）；University of Chittagong（吉大港大学）
