AI Agent

Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation

Sayash Kapoor, Benedikt Stroebl, Peter Kirgis, Nitya Nadgir, Zachary S Siegel, Boyi Wei, Tianci Xue, Ziru Chen, Felix Chen, Saiteja Utpala, Franck Ndzomga, Dheeraj Oruganty, Sophie Luskin, Kangheng Liu, Botao Yu, Amit Arora, Dongyoon Hahm, Harsh Trivedi, Huan Sun, Juyong Lee, Tengjun Jin, Yifan Mai, Yifei Zhou, Yuxuan Zhu, Rishi Bommasani, Daniel Kang, Dawn Song, Peter Henderson, Yu Su, Percy Liang, Arvind Narayanan

专题命中 Agent评测 ：agent(title,abstract)；AI agent(title,abstract)；分类 cs.AI、cs.CL

AI Agents for the Dhumbal Card Game: A Comparative Study

Sahaj Raj Malla

机构 * Department of Mathematics, Kathmandu University（数学系，加德满都大学） 纠错

专题命中 Agent评测 ：AI agent(title)；agent(abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 7 figures, 6 tables

Agent-Based Simulation of a Financial Market with Large Language Models

Ryuji Hashimoto, Takehiro Takayanagi, Masahiro Suzuki, Kiyoshi Izumi

专题命中 Agent评测 ：agent(title,abstract)

CausalTrace: A Neurosymbolic Causal Analysis Agent for Smart Manufacturing

Chathurangi Shyalika, Aryaman Sharma, Fadi El Kalach, Utkarshani Jaimini, Cory Henson, Ramy Harik, Amit Sheth

机构 * University of South Carolina（南卡罗来纳大学） 纠错

专题命中 Agent评测 ：agent(title)；分类 cs.AI

Comments 8 pages, 4 figures, 3 tables, Accepted at AAAI 2026: IAAI - Innovative Applications of AI Conference

VQArt-Bench: A semantically rich VQA Benchmark for Art and Cultural Heritage

A. Alfarano, L. Venturoli, D. Negueruela del Castillo

机构 * University of Zurich, Max Planck Society（苏黎世大学、马克斯·普朗克研究所） 纠错

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.LG

A Longitudinal Randomized Control Study of Companion Chatbot Use: Anthropomorphism and Its Mediating Role on Social Impacts

Rose E. Guingrich, Michael S. A. Graziano

机构 * Princeton University Department of Psychology（普林斯顿大学心理学系） ； Princeton School of Public & International Affairs（普林斯顿公共与国际事务学院） ； Princeton Neuroscience Institute（普林斯顿神经科学研究所） 纠错

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI

ChatThero: An LLM-Supported Chatbot for Behavior Change and Therapeutic Support in Addiction Recovery

Junda Wang, Zonghai Yao, Lingxi Li, Junhui Qian, Zhichao Yang, Hong Yu

机构 * Center for Healthcare Organization and Implementation Research, VA Bedford Health Care（VA Bedford Health Care 医疗组织与实施研究中心） ； Manning College of Information and Computer Sciences, University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校信息与计算机科学学院） ； Miner School of Computer and Information Sciences, University of Massachusetts Lowell（马萨诸塞大学洛厄尔分校计算机与信息科学学院） 纠错

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI

Time Travel is Cheating: Going Live with DeepFund for Real-Time Fund Investment Benchmarking

Changlun Li, Yao Shi, Chen Wang, Qiqi Duan, Runke Ruan, Weijie Huang, Haonan Long, Lijun Huang, Nan Tang, Yuyu Luo

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港理工大学（广州）） ； Paradoox AI Research（Paradoox AI研究院） 纠错

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI

Comments NeurIPS 2025 Datasets and Benchmarks Track

PPA-Game: Characterizing and Learning Competitive Dynamics Among Online Content Creators

Renzhe Xu, Haotian Wang, Xingxuan Zhang, Bo Li, Peng Cui

机构 * MoE Key Laboratory of Interdisciplinary Research of Computation and Economics, Institute for Theoretical Computer Science, Shanghai University of Finance and Economics（交叉学科计算与经济学联合实验室，理论计算机科学研究院，上海财经大学） ； College of Computer Science and Technology, National University of Defense Technology（计算机科学与技术学院，国防科技大学） ； Department of Computer Science and Technology, Tsinghua University（计算机科学与技术系，清华大学） ； School of Economics and Management, Tsinghua University（经济管理学院，清华大学） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.LG

Comments KDD 2025

MedKGEval: A Knowledge Graph-Based Multi-Turn Evaluation Framework for Open-Ended Patient Interactions with Clinical LLMs

Yuechun Yu, Han Ying, Haoan Jin, Wenjian Jiang, Dong Xian, Binghao Wang, Zhou Yang, Mengyue Wu

机构 * Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI

AgentAda: Skill-Adaptive Data Analytics for Tailored Insight Discovery

Amirhossein Abaskohi, Amrutha Varshini Ramesh, Shailesh Nanisetty, Chirag Goel, David Vazquez, Christopher Pal, Spandana Gella, Giuseppe Carenini, Issam H. Laradji

机构 * ServiceNow Research（ServiceNow 研究所） ； University of British Columbia（不列颠哥伦比亚大学） ； University of Toronto（多伦多大学） ； University of Montreal（蒙特利尔大学） ； Mila（Mila 研究所） ； CIFAR AI Chair（CIFAR 人工智能主席职位） ； Polytechnique Montréal（蒙特利尔理工学院） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.CL

UrbanTwin: Building High-Fidelity Digital Twins for Sim2Real LiDAR Perception and Evaluation

Muhammad Shahbaz, Shaurya Agarwal

机构 * Department of Civil, Environmental and Construction Engineering, University of Central Florida（土木、环境与建设工程系，中央佛罗里达大学） 纠错

专题命中 Agent评测 ：workflow(abstract)

Single-Deviation Stability in Additively Separable Hedonic Games with Constrained Coalition Sizes

Martin Bullinger, Adam Dunajski, Edith Elkind, Matan Gilboa

专题命中 Agent评测 ：agent(abstract)

Fair Division of Indivisible Items

Kevin Hsu

专题命中 Agent评测 ：agent(abstract)

Comments 105 pages, PhD dissertation

Generative Multi-Sensory Meditation: Exploring Immersive Depth and Activation in Virtual Reality

Yuyang Jiang, Binzhu Xie, Lina Xu, Xiaokang Lei, Shi Qiu, Luwen Yu, Pan Hui

专题命中 Agent评测 ：agent(abstract)

Comments Accepted in MM 2025

Visual Affordance Prediction: Survey and Reproducibility

Tommaso Apicella, Alessio Xompero, Andrea Cavallaro

机构 * Istituto Italiano di Tecnologia（意大利理工研究院） ； Centre for Intelligent Sensing（智能感知中心） ； Queen Mary University of London（伦敦女王学院） ； Idiap Research Institute（Idiap研究 institute） ； EPFL（瑞士联邦理工学院） 纠错

专题命中 Agent评测 ：agent(abstract)

Comments 18 pages, 3 figures, 13 tables. Project website at https://apicis.github.io/aff-survey/

EFX Orientations of Multigraphs

Kevin Hsu

专题命中 Agent评测 ：agent(abstract)

Comments 8 pages, to appear in ECAI 2025

Dynamics of systems with varying number of particles: from Liouville equations to general master equations for open systems

Mauricio J. del Razo, Luigi Delle Site

专题命中 Agent评测 ：agent(abstract)

Journal ref SciPost Phys. 18, 001 (2025)