AI Agent

MCPEval: Automatic MCP-based Deep Evaluation for AI Agent Models

Zhiwei Liu, Jielin Qiu, Shiyu Wang, Jianguo Zhang, Zuxin Liu, Roshan Ram, Haolin Chen, Weiran Yao, Shelby Heinecke, Silvio Savarese, Huan Wang, Caiming Xiong

机构 * Salesforce AI Research（Salesforce人工智能研究） 纠错

专题命中 Agent评测 ：agent(title,abstract)；AI agent(title)；分类 cs.AI、cs.CL

Comments https://github.com/SalesforceAIResearch/MCPEval

Polymorphic Combinatorial Frameworks (PCF): Guiding the Design of Mathematically-Grounded, Adaptive AI Agents

David Pearl, Matthew Murphy, James Intriligator

机构 * Department of Mechanical Engineering Tufts University（机械工程系 塔夫茨大学） 纠错

专题命中 Agent评测 ：AI agent(title,abstract)；agent(abstract)；分类 cs.AI

Finance Agent Benchmark: Benchmarking LLMs on Real-world Financial Research Tasks

Antoine Bigeard, Langston Nashold, Rayan Krishnan, Shirley Wu

专题命中 Agent评测 ：agent(title,abstract)；agentic(abstract)

Learning to Incentivize in Repeated Principal-Agent Problems with Adversarial Agent Arrivals

Junyan Liu, Arnab Maiti, Artin Tajdini, Kevin Jamieson, Lillian J. Ratliff

机构 * Paul G. Allen School of Computer Science \& Engineering, University of Washington, Seattle, USA ； Department of Electrical ； Computer Engineering, University of Washington, Seattle, USA 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.LG

Comments To appear at ICML 2025

Agentic Personalized Fashion Recommendation in the Age of Generative AI: Challenges, Opportunities, and Evaluation

Yashar Deldjoo, Nima Rafiee, Mahdyar Ravanbakhsh

专题命中 Agent评测 ：agentic(title,abstract)

Bayes-Entropy Collaborative Driven Agents for Research Hypotheses Generation and Optimization

Shiyang Duan, Yuan Tian, Qi Bing, Xiaowei Shao

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI

Comments Corresponding author: Xiaowei Shao. 12 pages, 4 figures

SketchAgent: Generating Structured Diagrams from Hand-Drawn Sketches

Cheng Tan, Qi Chen, Jingxuan Wei, Gaowei Wu, Zhangyang Gao, Siyuan Li, Bihui Yu, Ruifeng Guo, Stan Z. Li

机构 * Westlake University（西湖大学） ； Zhejiang University（浙江大学） ； University of Chinese Academy of Sciences（中国科学院大学） 纠错

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI

Comments Accepted by IJCAI 2025

Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems

Bang Liu, Xinfeng Li, Jiayi Zhang, Jinlin Wang, Tanjin He, Sirui Hong, Hongzhang Liu, Shaokun Zhang, Kaitao Song, Kunlun Zhu, Yuheng Cheng, Suyuchen Wang, Xiaoqiang Wang, Yuyu Luo, Haibo Jin, Peiyan Zhang, Ollie Liu, Jiaqi Chen, Huan Zhang, Zhaoyang Yu, Haochen Shi, Boyan Li, Dekun Wu, Fengwei Teng, Xiaojun Jia, Jiawei Xu, Jinyu Xiang, Yizhang Lin, Tianming Liu, Tongliang Liu, Yu Su, Huan Sun, Glen Berseth, Jianyun Nie, Ian Foster, Logan Ward, Qingyun Wu, Yu Gu, Mingchen Zhuge, Xinbing Liang, Xiangru Tang, Haohan Wang, Jiaxuan You, Chi Wang, Jian Pei, Qiang Yang, Xiaoliang Qi, Chenglin Wu

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI

Can Tool-augmented Large Language Models be Aware of Incomplete Conditions?

Seungbin Yang, ChaeHun Park, Taehee Kim, Jaegul Choo

专题命中 Agent评测 ：tool-use(abstract)；分类 cs.CL

FECT: Factuality Evaluation of Interpretive AI-Generated Claims in Contact Center Conversation Transcripts

Hagyeong Shin, Binoy Robin Dalal, Iwona Bialynicka-Birula, Navjot Matharu, Ryan Muir, Xingwei Yang, Samuel W. K. Wong

机构 * Cresta, University of Waterloo（Cresta，滑铁卢大学） 纠错

专题命中 Agent评测 ：分类 cs.AI、cs.CL、cs.LG；agentic(comments)

Comments Accepted for an oral presentation at Agentic & GenAI Evaluation KDD 2025: KDD workshop on Evaluation and Trustworthiness of Agentic and Generative AI Models

A Parameter-free Decentralized Algorithm for Composite Convex Optimization

Xiaokai Chen, Ilya Kuruzov, Gesualdo Scutari, Alexander Gasnikov

专题命中 Agent评测 ：agent(abstract)

Comments 9 pages, 3 figures, to appear at the 64th IEEE Conference on Decision and Control (CDC 2025)

Learning Continuum-level Closures For Control of Interacting Active Particles

Titus Quah, Sho C. Takatori, James B. Rawlings

专题命中 Agent评测 ：agent(abstract)

Logarithmic Comparison-Based Query Complexity for Fair Division of Indivisible Goods

Xiaolin Bu, Zihao Li, Shengxin Liu, Jiaxin Song, Biaoshuai Tao

专题命中 Agent评测 ：agent(abstract)

Comments Accepted by WINE'2024, 22 pages