AI Agent

REALM-Bench: A Benchmark for Evaluating Multi-Agent Systems on Real-world, Dynamic Planning and Scheduling Tasks

Longling Geng, Edward Y. Chang

机构 * Stanford University（斯坦福大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；planning(title,abstract)；multi-agent(title,abstract)；分类 cs.AI

Comments 24 pages, 8 figures, 28 tables, 7 listings

GEMA-Score: Granular Explainable Multi-Agent Scoring Framework for Radiology Report Evaluation

Zhenxuan Zhang, Kinhei Lee, Peiyuan Jing, Weihang Deng, Huichi Zhou, Zihao Jin, Jiahao Huang, Zhifan Gao, Dominic C Marshall, Yingying Fang, Guang Yang

专题命中 Agent评测 ：agent(title,abstract)；multi-agent(title,abstract)；workflow(abstract)；分类 cs.CL

Inherent and emergent liability issues in LLM-based agentic systems: a principal-agent perspective

Garry A. Gabison, R. Patrick Xian

机构 * Queen Mary University of London（伦敦女王大学） ； UC Berkeley（伯克利大学） ； Certivize AI ； UC San Francisco（旧金山大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；agentic(title,abstract)；分类 cs.CL

Comments 22 pages (incl. appendix), accepted at REALM workshop, ACL2025

When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMs

Fangyi Yu

机构 * Fangyi Yu 纠错

专题命中 Agent评测 ：agent(title,abstract)；AI agent(abstract)；multi-agent(abstract)；分类 cs.AI

Clinically Grounded Agent-based Report Evaluation: An Interpretable Metric for Radiology Report Generation

Radhika Dua, Young Joon, Kwon, Siddhant Dogra, Daniel Freedman, Diana Ruan, Motaz Nashawaty, Danielle Rigau, Daniel Alexander Alber, Kang Zhang, Kyunghyun Cho, Eric Karl Oermann

机构 * New York University（纽约大学） ； NYU Langone Health（纽约大学兰格医学中心） ； Genentech（基因泰克） ； NYU Grossman School of Medicine（纽约大学格罗斯曼医学院） ； Wenzhou Medical University（温州医科大学） ； Macau University of Science and Technology（澳门科学大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；planning(abstract)；分类 cs.AI、cs.CL、cs.LG

Agentic AI in 6G Software Businesses: A Layered Maturity Model

Muhammad Zohaib, Muhammad Azeem Akbar, Sami Hyrynsalmi, Arif Ali Khan

专题命中 Agent评测 ：agentic(title,abstract)；agent(abstract)；分类 cs.AI、cs.SE

Comments 6 pages, 3 figures and FIT'25 Conference

Toward Verifiable Misinformation Detection: A Multi-Tool LLM Agent Framework

Zikun Cui, Tianyi Huang, Chia-En Chiang, Cuiqianhe Du

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI、cs.CL

The influence of persona and conversational task on social interactions with a LLM-controlled embodied conversational agent

Leon O. H. Kroczek, Alexander May, Selina Hettenkofer, Andreas Ruider, Bernd Ludwig, Andreas Mühlberger

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.AI

Comments 11 pages, 5 figures

Efficient Agents: Building Effective Agents While Reducing Cost

Ningning Wang, Xavier Hu, Pai Liu, He Zhu, Yue Hou, Heyuan Huang, Shengyu Zhang, Jian Yang, Jiaheng Liu, Ge Zhang, Changwang Zhang, Jun Wang, Yuchen Eleanor Jiang, Wangchunshu Zhou

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL

Comments Work in progress. For GitHub repository, see https://github.com/OPPO-PersonalAI/OAgents

From Text to Trajectory: Exploring Complex Constraint Representation and Decomposition in Safe Reinforcement Learning

Pusen Dong, Tianchen Zhu, Yue Qiu, Haoyi Zhou, Jianxin Li

机构 * Beihang University（北航大学） ； Zhongguancun Laboratory（中关村实验室） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted by NeurIPS 2024

Strategic Hypothesis Testing

Safwan Hossain, Yatong Chen, Yiling Chen

机构 * Harvard University（哈佛大学） ； MPI for Intellgent Systems（智能系统马克思普朗克研究所） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.LG

Can We Fix Social Media? Testing Prosocial Interventions using Generative Social Simulation

Maik Larooij, Petter Törnberg

专题命中 Agent评测 ：agent(abstract)

A Reinforcement Learning Framework for Mobility Control of gNBs in Dynamic Radio Access Networks

Pedro Duarte, André Coelho, Manuel Ricardo

专题命中 Agent评测 ：agent(abstract)

LMDG: Advancing Lateral Movement Detection Through High-Fidelity Dataset Generation

Anas Mabrouk, Mohamed Hatem, Mohammad Mamun, Sherif Saad

专题命中 Agent评测 ：agent(abstract)