AI Agent

MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Research

Hui Chen, Miao Xiong, Yujie Lu, Wei Han, Ailin Deng, Yufei He, Jiaying Wu, Yibo Li, Yue Liu, Bryan Hooi

机构 * National University of Singapore（新加坡国立大学） ； University of California, Santa Barbara（加州大学圣巴巴拉分校） ； Singapore University of Technology and Design（新加坡科技设计大学） 纠错

专题命中 Agent评测 ：AI agent(title,abstract)；agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments 49 pages, 9 figures. Accepted by NeurIPS 2025 D&B Track

GeoBenchX: Benchmarking LLMs in Agent Solving Multistep Geospatial Tasks

Varvara Krechetova, Denis Kochedykov

机构 * World Bank（世界银行） ； JP Morgan Chase & Co（摩根大通公司） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI、cs.CL

Comments Github with code and benchmark set: https://github.com/Solirinai/GeoBenchX

Vahana.jl -- A framework (not only) for large-scale agent-based models

Steffen Fürst, Tim Conrad, Carlo Jaeger, Sarah Wolf

专题命中 Agent评测 ：agent(title,abstract)

SORA-ATMAS: Adaptive Trust Management and Multi-LLM Aligned Governance for Future Smart Cities

Usama Antuley, Shahbaz Siddiqui, Sufian Hameed, Waqas Arif, Subhan Shah, Syed Attique Shah

机构 * organization= Department of Computer Science, National University of Computer \& Emerging Sciences , addressline= St-4 Sector 17-D On National Highway , city= Karachi , postcode= 75160 , state= , country= Pakistan ； organization= Balochistan University of Information Technology, Engineering ； organization= Department of Computer Science, Birmingham City University , addressline= STEAMhouse, Belmont Row , city= Birmingham , postcode= B4 7RQ , country= United Kingdom 纠错

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI

SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Tasks

Hwiwon Lee, Ziqi Zhang, Hanxiao Lu, Lingming Zhang

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.LG

HSCodeComp: A Realistic and Expert-level Benchmark for Deep Search Agents in Hierarchical Rule Application

Yiqian Yang, Tian Lan, Qianghuai Jia, Li Zhu, Hui Jiang, Hang Zhu, Longyue Wang, Weihua Luo, Kaifu Zhang

机构 * Alibaba International Digital Commerce（阿里巴巴国际数字商业） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.CL

NAACL2025 Tutorial: Adaptation of Large Language Models

Zixuan Ke, Yifei Ming, Shafiq Joty

机构 * Salesforce AI Research（Salesforce人工智能研究） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.CL

Comments NAACL2025 Tutorial

WebGraphEval: Multi-Turn Trajectory Evaluation for Web Agents using Graph Representation

Yaoyao Qian, Yuanli Wang, Jinda Zhang, Yun Zong, Meixu Chen, Hanhan Zhou, Jindan Huang, Yifan Zeng, Xinyu Hu, Chan Hee Song, Danqing Zhang

机构 * Northeastern University（东北大学） ； Boston University（波士顿大学） ； University of Victoria（维多利亚大学） ； University of Minnesota（明尼苏达大学） ； George Washington University（乔治华盛顿大学） ； Tufts University（塔夫茨大学） ； Oregon State University（俄勒冈州立大学） ； University of Texas at San Antonio（德克萨斯大学圣安东尼奥分校） ； The Ohio State University（俄亥俄州立大学） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI

Comments 39th Conference on Neural Information Processing Systems (NeurIPS 2025) Workshop: Multi-Turn Interactions in Large Language Models

Presenting a Paper is an Art: Self-Improvement Aesthetic Agents for Academic Presentations

Chengzhi Liu, Yuzhe Yang, Kaiwen Zhou, Zhen Zhang, Yue Fan, Yanan Xie, Peng Qi, Xin Eric Wang

专题命中 Agent评测 ：agent(abstract)；分类 cs.CL

Open-World Drone Active Tracking with Goal-Centered Rewards

Haowei Sun, Jinwu Hu, Zhirui Zhang, Haoyuan Tian, Xinze Xie, Yufeng Wang, Xiaohua Xie, Yun Lin, Zhuliang Yu, Mingkui Tan

机构 * South China University of Technology（华南理工大学） ； Institute for Super Robotics (Huangpu)（超机器人研究所） ； Pazhou Laboratory（琶洲实验室） ； Key Laboratory of Big Data and Intelligent Robot, Ministry of Education（大数据与智能机器人重点实验室） ； Peng Cheng Laboratory（鹏城实验室） ； Sun Yat-sen University（中山大学） ； Harbin Engineering University（哈尔滨工程大学） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI

Comments NeurIPS 2025

LLM Bazaar: A Service Design for Supporting Collaborative Learning with an LLM-Powered Multi-Party Collaboration Infrastructure

Zhen Wu, Jiaxin Shi, R. Charles Murray, Carolyn Rosé, Micah San Andres

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI

Comments https://repository.isls.org//handle/1/11832

Journal ref Proceedings of the 18th International Conference on Computer-Supported Collaborative Learning - CSCL 2025 (pp. 108-115). International Society of the Learning Sciences

Robust Popular Matchings

Martin Bullinger, Gergely Csáji, Rohith Reddy Gangam, Parnian Shahkar

专题命中 Agent评测 ：agent(abstract)；autonomous agent(comments)

Comments Appears in: Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2024)

Stop Playing the Guessing Game! Target-free User Simulation for Evaluating Conversational Recommender Systems

Sunghwan Kim, Kwangwook Seo, Tongyoung Kim, Jinyoung Yeo, Dongha Lee

专题命中 Agent评测 ：agent(abstract)

Comments Accepted to EMNLP 2025 Findings