AI Agent

AgentCompass: Towards Reliable Evaluation of Agentic Workflows in Production

NVJK Kartik, Garvit Sapra, Rishav Hada, Nikhil Pareek

机构 * FutureAGI Inc.（未来AGI公司） 纠错

专题命中 Agent评测 ：agentic(title,abstract)；agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL

Ticket-Bench: A Kickoff for Multilingual and Regionalized Agent Evaluation

Thales Sales Almeida, João Guilherme Alves Santos, Thiago Laitz, Giovana Kerche Bonás

机构 * Institute of Computing (IC) State University of Campinas（计算学院（IC）坎皮纳斯州立大学） 纠错

专题命中 Agent评测 ：agent(title,abstract)；分类 cs.CL

STEP: Structured Training and Evaluation Platform for benchmarking trajectory prediction models

Julian F. Schumann, Anna Mészáros, Jens Kober, Arkady Zgonnikov

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)；分类 cs.LG

An Evaluation-Centric Paradigm for Scientific Visualization Agents

Kuangshi Ai, Haichao Miao, Zhimin Li, Chaoli Wang, Shusen Liu

机构 * Univ. Notre Dame（内布拉斯加大学） ； LLNL（劳伦斯利弗莫尔国家实验室） ； Vanderbilt Univ.（范德比大学） 纠错

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.CL

Journal ref 1st Workshop on GenAI, Agents, and the Future of VIS (IEEE VIS Conference 2025)

Disproving the Feasibility of Learned Confidence Calibration Under Binary Supervision: An Information-Theoretic Impossibility

Arjun S. Nair, Kristina P. Sinaga

机构 * Independent Researcher（独立研究者） 纠错

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.LG

Comments 30 pages, 13 figures, 8 tables

Forecasting and Visualizing Air Quality from Sky Images with Vision-Language Models

Mohammad Saleh Vahdatpour, Maryam Eyvazi, Yanqing Zhang

机构 * Georgia State University（佐治亚州立大学） ； Savannah College of Art and Design（萨凡纳艺术与设计学院） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.LG

Comments Published at ICCVW 2025

Hybrid Table-Assisted and RL-Based Dynamic Routing for NGSO Satellite Networks

Flor Ortiz, Eva Lagunas

专题命中 Agent评测 ：agent(abstract)