AI Agent

Security Challenges in AI Agent Deployment: Insights from a Large Scale Public Competition

Andy Zou, Maxwell Lin, Eliot Jones, Micha Nowak, Mateusz Dziemian, Nick Winter, Alexander Grattan, Valent Nathanael, Ayla Croft, Xander Davies, Jai Patel, Robert Kirk, Nate Burnikell, Yarin Gal, Dan Hendrycks, J. Zico Kolter, Matt Fredrikson

专题命中 Agent评测 ：agent(title,abstract)；AI agent(title,abstract)；分类 cs.AI、cs.CL

Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation

Jiaju Chen, Yuxuan Lu, Xiaojie Wang, Huimin Zeng, Jing Huang, Jiri Gesi, Ying Xu, Bingsheng Yao, Dakuo Wang

机构 * Rice University（里士满大学） ； Northeastern University（东北大学） ； Amazon（亚马逊） ； University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； Harvard University（哈佛大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；multi-agent(title,abstract)；分类 cs.CL

MIMII-Agent: Leveraging LLMs with Function Calling for Relative Evaluation of Anomalous Sound Detection

Harsh Purohit, Tomoya Nishida, Kota Dohi, Takashi Endo, Yohei Kawaguchi

机构 * Hitachi Ltd., R\&D Group, Tokyo, Japan 纠错

专题命中 Agent评测 ：agent(title)；function calling(title)；分类 cs.AI、cs.LG

MIRAGE-Bench: LLM Agent is Hallucinating and Where to Find Them

Weichen Zhang, Yiyou Sun, Pohao Huang, Jiayue Pu, Heyue Lin, Dawn Song

专题命中 Agent评测 ：agent(title,abstract)；agentic(abstract)；分类 cs.AI

Comments Code and data: https://github.com/sunblaze-ucb/mirage-bench.git

SciToolAgent: A Knowledge Graph-Driven Scientific Agent for Multi-Tool Integration

Keyan Ding, Jing Yu, Junjie Huang, Yuchen Yang, Qiang Zhang, Huajun Chen

机构 * College of Computer Science and Technology（计算机科学与技术学院） ； Zhejiang University（浙江大学） ； Zhejiang Key Laboratory of Intelligent Manufacturing for Functional Chemicals（功能化学品智能制造重点实验室） ； ZJU-Hangzhou Global Scientific and Technological Innovation Center（浙大杭州国际科学技术创新中心） ； ZJU-UIUC Institute（浙大UIUC研究院） ； The Polytechnic Institute（技术学院） ； State Key Laboratory of Ocean Sensing（海洋感知国家重点实验室） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI、cs.CL

Comments 21 pages, 6 figures

Large Language Model Agent for Structural Drawing Generation Using ReAct Prompt Engineering and Retrieval Augmented Generation

Xin Zhang, Lissette Iturburu, Juan Nicolas Villamizar, Xiaoyu Liu, Manuel Salmeron, Shirley J. Dyke, Julio Ramirez

机构 * Lyles School of Civil and Construction Engineering（莱尔斯土木与建设工程学院） ； Purdue University（普渡大学） ； School of Mechanical Engineering（机械工程学院） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI、cs.LG

Simulating Human Behavior with the Psychological-mechanism Agent: Integrating Feeling, Thought, and Action

Qing Dong, Pengyuan Liu, Dong Yu, Chen Kang

机构 * Beijing Language and Culture University（北京语言大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

TN-AutoRCA: Benchmark Construction and Agentic Framework for Self-Improving Alarm-Based Root Cause Analysis in Telecommunication Networks

Keyu Wu, Qianjin Yu, Manlin Mei, Ruiting Liu, Jun Wang, Kailai Zhang, Yelun Bao

专题命中 Agent评测 ：agentic(title)；分类 cs.CL

Comments 10 pages

AQUA: A Large Language Model for Aquaculture & Fisheries

Praneeth Narisetty, Uday Kumar Reddy Kattamanchi, Lohit Akshant Nimma, Sri Ram Kaushik Karnati, Shiva Nagendra Babu Kore, Mounika Golamari, Tejashree Nageshreddy

专题命中 Agent评测 ：agentic(abstract)；分类 cs.AI、cs.CL、cs.LG

PhysVarMix: Physics-Informed Variational Mixture Model for Multi-Modal Trajectory Prediction

Haichuan Li, Tomi Westerlund

机构 * Turku Intelligent Embedded and Robotics Systems lab, Faculty of Technology University of Turku（图尔库智能嵌入式与机器人系统实验室，技术学院图尔库大学） 纠错

专题命中 Agent评测 ：agent(abstract)；planning(abstract)

AI-Driven Generation of Old English: A Framework for Low-Resource Languages

Rodrigo Gabriel Salazar Alva, Matías Nuñez, Cristian López, Javier Martín Arista

机构 * Universidad de Ingeniería y Tecnología (UTEC)（Ingeniería y Tecnología大学（UTEC）） ； Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET)（国家科学与技术研究理事会（CONICET）） ； Instituto de Investigaciones en Biodiversidad y Medioambiente (INIBIOMA), Universidad Nacional del Comahue（生物多样性与环境研究所（INIBIOMA），Comahue国立大学） ； Universidad de La Rioja（拉里奥ja大学） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.CL

Advanced System Integration: Analyzing OpenAPI Chunking for Retrieval-Augmented Generation

Robin D. Pesl, Jerin G. Mathew, Massimo Mecella, Marco Aiello

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.SE

Comments This preprint has not undergone peer review (when applicable) or any post-submission improvements or corrections. The Version of Record of this contribution is published in Advanced Information Systems Engineering. CAiSE 2025. Lecture Notes in Computer Science, vol 15702. Springer, Cham., and is available online at https://doi.org/10.1007/978-3-031-94571-7_8

Journal ref Advanced Information Systems Engineering. CAiSE 2025. Lecture Notes in Computer Science, vol 15702. Springer, Cham

MazeEval: A Benchmark for Testing Sequential Decision-Making in Language Models

Hafsteinn Einarsson

机构 * University of Iceland（爱沙尼亚大学） 纠错

专题命中 Agent评测 ：autonomous agent(abstract)；分类 cs.AI

Text2Vis: A Challenging and Diverse Benchmark for Generating Multimodal Visualizations from Text

Mizanur Rahman, Md Tahmid Rahman Laskar, Shafiq Joty, Enamul Hoque

机构 * York University（约克大学） ； Dialpad ； Salesforce AI Research（Salesforce人工智能研究） 纠错

专题命中 Agent评测 ：agentic(abstract)；分类 cs.CL

Fairness under Equal-Sized Bundles: Impossibility Results and Approximation Guarantees

Alviona Mancho, Evangelos Markakis, Nicos Protopapas

专题命中 Agent评测 ：agent(abstract)

Comments Accepted at SAGT 2025

A Convex Optimization Approach to Model-Free Inverse Optimal Control with Provable Convergence

Meiling Yu, Lechen Feng, Lei Jiang, Yuan-Hua Ni

专题命中 Agent评测 ：agent(abstract)

Self-protection and self-insurance for general risk models via a BSDE approach

Claudia Ceci, Alessandra Cretarola

专题命中 Agent评测 ：agent(abstract)