AI Agent

Flex-TravelPlanner: A Benchmark for Flexible Planning with Language Agents

Juhyun Oh, Eunsu Kim, Alice Oh

机构 * School of Computing（计算机学院） ； KAIST（韩国科学技术院） 纠错

专题命中 Agent评测 ：planning(title,abstract)；分类 cs.CL

ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Consensus Enforcement, and Column Exploration

Minghang Deng, Ashwin Ramachandran, Canwen Xu, Lanxiang Hu, Zhewei Yao, Anupam Datta, Hao Zhang

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

Comments 33 pages, 3 figures

Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation

Yucheng Zhou, Jiahao Yuan, Qianning Wang

机构 * University of Macau China（澳门大学） ； East China Normal University China（华东师范大学） ； Auckland University of Technology New Zealand（技术大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

Agent Security Bench (ASB): Formalizing and Benchmarking Attacks and Defenses in LLM-based Agents

Hanrong Zhang, Jingyuan Huang, Kai Mei, Yifei Yao, Zhenting Wang, Chenlu Zhan, Hongwei Wang, Yongfeng Zhang

机构 * Zhejiang University（浙江大学） ； Rutgers University（罗格斯大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

Comments Accepted by ICLR 2025

iAgent: LLM Agent as a Shield between User and Recommender Systems

Wujiang Xu, Yunxiao Shi, Zujie Liang, Xuying Ning, Kai Mei, Kun Wang, Xi Zhu, Min Xu, Yongfeng Zhang

机构 * Rutgers University（罗格斯大学） ； University of Technology Sydney（悉尼技术大学） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； Nanyang Technological University（南洋理工大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

Comments Findings of ACL 2025 and WWW2025@HCRS

AgentRecBench: Benchmarking LLM Agent-based Personalized Recommender Systems

Yu Shang, Peijie Liu, Yuwei Yan, Zijing Wu, Leheng Sheng, Yuanqing Yu, Chumeng Jiang, An Zhang, Fengli Xu, Yu Wang, Min Zhang, Yong Li

机构 * Tsinghua University（清华大学） ； The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州）） ； University of Science and Technology of China（中国科学技术大学） ； National University of Singapore（新加坡国立大学） 纠错

专题命中 Agent评测 ：agent(title)；agentic(abstract)；分类 cs.AI

Comments 15 pages, 6 figures

AutoJudger: An Agent-Driven Framework for Efficient Benchmarking of MLLMs

Xuanwen Ding, Chengjun Pan, Zejun Li, Jiwen Zhang, Siyuan Wang, Zhongyu Wei

机构 * Fudan University（复旦大学） ； University of Southern California（南加州大学） ； Shanghai Innovation Institute（上海创新研究院） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments

Samuel Schmidgall, Rojin Ziaei, Carl Harris, Eduardo Reis, Jeffrey Jopling, Michael Moor

机构 * Stanford University（斯坦福大学） ； Johns Hopkins University（约翰霍普金斯大学） ； Stanford University Hospital Israelita Albert Einstein（斯坦福大学医院以色列阿尔伯特·爱因斯坦医院） ； ETH Zurich（苏黎世联邦理工学院） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

PersonaX: A Recommendation Agent Oriented User Modeling Framework for Long Behavior Sequence

Yunxiao Shi, Wujiang Xu, Zeqi Zhang, Xing Zi, Qiang Wu, Min Xu

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

Comments 2025 ACL Findings

Rethinking Agent Design: From Top-Down Workflows to Bottom-Up Skill Evolution

Jiawei Du, Jinlong Wu, Yuzheng Chen, Yucheng Hu, Bing Li, Joey Tianyi Zhou

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

EcomScriptBench: A Multi-task Benchmark for E-commerce Script Planning via Step-wise Intention-Driven Product Association

Weiqi Wang, Limeng Cui, Xin Liu, Sreyashi Nag, Wenju Xu, Chen Luo, Sheikh Muhammad Sarwar, Yang Li, Hansu Gu, Hui Liu, Changlong Yu, Jiaxin Bai, Yifan Gao, Haiyang Zhang, Qi He, Shuiwang Ji, Yangqiu Song

机构 * Department of Computer Science and Engineering, HKUST, Hong Kong SAR, China（香港科技大学计算机科学与工程系） ； Amazon.com Inc（亚马逊公司） ； Department of Computer Science & Engineering, Texas A&M University（德克萨斯农工大学计算机科学与工程系） 纠错

专题命中 Agent评测 ：planning(title,abstract)；分类 cs.CL

Comments ACL2025

Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making

Jacob Kleiman, Kevin Frank, Joseph Voyles, Sindy Campagna

机构 * AI Research and Emerging Technology Group, PwC US（普华永道美国人工智能研究与新兴技术集团） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

MM-Agent: LLM as Agents for Real-world Mathematical Modeling Problem

Fan Liu, Zherui Yang, Cancheng Liu, Tianrui Song, Xiaofeng Gao, Hao Liu

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

The Hidden Dangers of Browsing AI Agents

Mykyta Mudryi, Markiyan Chaklosh, Grzegorz Wójcik

机构 * Polish-Japanese Academy of Information Technology（波兰-日本信息科技学院） ； University of the National Education Commission in Kraków（克拉科夫国家教育委员会大学） ； Maria Curie-Sklodowska University in Lublin（利沃夫玛丽亚·克里沃斯卡大学） 纠错

专题命中 Agent评测 ：AI agent(title)；agent(abstract)；分类 cs.AI

CompileAgent: Automated Real-World Repo-Level Compilation with Tool-Integrated LLM-based Agent System

Li Hu, Guoqiang Chen, Xiuwei Shang, Shaoyin Cheng, Benlong Wu, Gangyang Li, Xu Zhu, Weiming Zhang, Nenghai Yu

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.SE

Comments 12 pages, 4 figures

TutorGym: A Testbed for Evaluating AI Agents as Tutors and Students

Daniel Weitekamp, Momin N. Siddiqui, Christopher J. MacLellan

机构 * Georgia Institute of Technology（佐治亚理工学院） 纠错

专题命中 Agent评测 ：AI agent(title,abstract)；分类 cs.AI

VTS-LLM: Domain-Adaptive LLM Agent for Enhancing Awareness in Vessel Traffic Services through Natural Language

Sijin Sun, Liangbin Zhao, Ming Deng, Xiuju Fu

机构 * Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR IHPC)（高性能计算研究所，科技研究局（A*STAR IHPC）） ； National University of Singapore（国立新加坡大学） ； Shanghai University（上海大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

Comments 8 pages, 5 figures, 7 tablels, submitted to ITSC2025

Talk Before You Retrieve: Agent-Led Discussions for Better RAG in Medical QA

Xuanzhao Dong, Wenhui Zhu, Hao Wang, Xiwen Chen, Peijie Qiu, Rui Yin, Yi Su, Yalin Wang

机构 * Arizona State University（亚利桑那州立大学） ； Clemson University（克莱姆森大学） ； Washington University in St.Louis（圣路易斯华盛顿大学） ； Banner Alzheimer’s Institute（班纳阿尔茨海默病研究所） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

An LLM-Powered Agent for Physiological Data Analysis: A Case Study on PPG-based Heart Rate Estimation

Mohammad Feli, Iman Azimi, Pasi Liljeberg, Amir M. Rahmani

机构 * Department of Computing, University of Turku（图波卡大学计算机系） ； Department of Computer Science, University of California, Irvine（加州大学伊文斯顿分校计算机科学系） ； School of Nursing, University of California, Irvine（加州大学伊文斯顿分校护理学院） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

Optimizing SIA Development: A Case Study in User-Centered Design for Estuary, a Multimodal Socially Interactive Agent Framework

Spencer Lin, Miru Jun, Basem Rizk, Karen Shieh, Scott Fisher, Sharon Mozgai

机构 * University of Southern California（南加州大学） ； University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

X-Guard: Multilingual Guard Agent for Content Moderation

Bibek Upadhayay, Vahid Behzadan, Ph. D

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

Comments 34 pages, 15 figures

Agent-Based Simulations of Online Political Discussions: A Case Study on Elections in Germany

Abdul Sittar, Simon Münker, Fabio Sartori, Andreas Reitenbach, Achim Rettinger, Michael Mäs, Alenka Guček, Marko Grobelnik

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

Comments I forgot to take the consent from all other co authors and they want to withdraw it

Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Making

Zhuoning Xu, Jian Xu, Mingqing Zhang, Peijie Wang, Chao Deng, Cheng-Lin Liu

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

UXAgent: An LLM Agent-Based Usability Testing Framework for Web Design

Yuxuan Lu, Bingsheng Yao, Hansu Gu, Jing Huang, Jessie Wang, Yang Li, Jiri Gesi, Qi He, Toby Jia-Jun Li, Dakuo Wang

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulations

Maik Larooij, Petter Törnberg

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing

Shreya Shankar, Tristan Chambers, Tarak Shah, Aditya G. Parameswaran, Eugene Wu

专题命中 Agent评测 ：agentic(title)；agent(abstract)；分类 cs.AI

Comments 22 pages, 6 figures, 7 tables

SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation

Jingxuan Chen, Derek Yuen, Bin Xie, Yuhao Yang, Gongwei Chen, Zhihao Wu, Li Yixing, Xurui Zhou, Weiwen Liu, Shuai Wang, Kaiwen Zhou, Rui Shao, Liqiang Nie, Yasheng Wang, Jianye Hao, Jun Wang, Kun Shao

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

Comments ICLR 2025 Spotlight

LLM-based Agent Simulation for Maternal Health Interventions: Uncertainty Estimation and Decision-focused Evaluation

Sarah Martinson, Lingkai Kong, Cheol Woo Kim, Aparna Taneja, Milind Tambe

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

OASIS: Open Agent Social Interaction Simulations with One Million Agents

Ziyi Yang, Zaibin Zhang, Zirui Zheng, Yuxian Jiang, Ziyue Gan, Zhiyu Wang, Zijian Ling, Jinsong Chen, Martz Ma, Bowen Dong, Prateek Gupta, Shuyue Hu, Zhenfei Yin, Guohao Li, Xu Jia, Lijun Wang, Bernard Ghanem, Huchuan Lu, Chaochao Lu, Wanli Ouyang, Yu Qiao, Philip Torr, Jing Shao

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

Situational Agency: The Framework for Designing Behavior in Agent-based art

Ary-Yue Huang, Varvara Guljajeva

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

Comments 8 pages,5 figures, accetped by 30th International Symposium on Electronic Art (ISEA)