Agentic systems augment large language models with external tools and iterative decision making, enabling complex tasks such as deep research, function calling, and coding. However, their long and intricate execution traces make failure diagnosis and root cause analysis extremely challenging. Manual inspection does not scale, while directly applying LLMs to raw traces is hindered by input length limits and unreliable reasoning. Focusing solely on final task outcomes further discards critical behavioral information required for accurate issue localization. To address these issues, we propose TraceSIR, a multi-agent framework for structured analysis and reporting of agentic execution traces. TraceSIR coordinates three specialized agents: (1) StructureAgent, which introduces a novel abstraction format, TraceFormat, to compress execution traces while preserving essential behavioral information; (2) InsightAgent, which performs fine-grained diagnosis including issue localization, root cause analysis, and optimization suggestions; (3) ReportAgent, which aggregates insights across task instances and generates comprehensive analysis reports. To evaluate TraceSIR, we construct TraceBench, covering three real-world agentic scenarios, and introduce ReportEval, an evaluation protocol for assessing the quality and usability of analysis reports aligned with industry needs. Experiments show that TraceSIR consistently produces coherent, informative, and actionable reports, significantly outperforming existing approaches across all evaluation dimensions. Our project and video are publicly available at https://github.com/SHU-XUN/TraceSIR.
FinReporting: An Agentic Workflow for Localized Reporting of Cross-Jurisdiction Financial Disclosures
MBZUAI;The University of Tokyo(东京大学);Meiji Gakuin University(明治大学);McGill University(麦吉尔大学);Kyoto University(京都大学);Columbia University(哥伦比亚大学);University of California, Berkeley(加州大学伯克利分校)
Auditable agentic AI for evidence-grounded thyroid ultrasound diagnosis and reporting
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);School of Software Engineering, Sun Yat-sen University(中山大学软件工程学院);School of Mathematical Sciences, Zhejiang University(浙江大学数学科学学院);Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院);Zhujiang Hospital, Southern Medical University(南方医科大学珠江医院);College of Mathematical Medicine, Zhejiang Normal University(浙江师范大学数学医学院)
CreditAudit: 2$^\text{nd}$ Dimension for LLM Evaluation and Selection
Northwestern Polytechnical University Institute of Artificial Intelligence (TeleAI), China Telecom(西北工业大学人工智能研究所(TeleAI),中国电信);Dalian Maritime University Institute of Artificial Intelligence (TeleAI), China Telecom(大连海事大学人工智能研究所(TeleAI),中国电信);Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究所(TeleAI),中国电信);Guangxi Normal University Institute of Artificial Intelligence (TeleAI), China Telecom(广西师范大学人工智能研究所(TeleAI),中国电信)
Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
QiYuan Lab(启元实验室);School of Information and Software Engineering, University of Electronic Science and Technology of China(电子科技大学信息与软件工程学院);Beijing University of Posts and Telecommunications(北京邮电大学);School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院)
Agentic-J: An AI Agent for Biological Microscopy Image Analysis
University of Tartu(塔尔图大学);Ruhr University Bochum(波鸿鲁尔大学);University of Amsterdam(阿姆斯特丹大学);University of Notre Dame(圣母大学);University of Duisburg-Essen(杜伊斯堡-埃森大学)
GCA Framework: A GCC Countries-Grounded Dataset and Agentic Pipeline for Climate Decision Support
Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)(莫扎德人工智能大学);University of Missouri(密苏里大学);Australian National University(澳大利亚国立大学);Linköping University(林肯大学)
Agents Are Systems, Not Models: Rethinking Agentic Evaluation
Technical University of Munich(慕尼黑工业大学);Helmholtz Munich(亥姆霍兹慕尼黑);Inria(法国国家信息与自动化研究所);École normale supérieure(巴黎高等师范学院);CNRS(法国国家科学研究中心);PSL Research University(巴黎文理研究大学)
UniACE: A Unified Framework for Evaluating LLM Agentic Capabilities
Beijing University of Posts and Telecommunications(北京邮电大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Chongqing University of Posts and Telecommunications(重庆邮电大学);North China Electric Power University(华北电力大学)
Aligning Agents via Planning: A Benchmark for Trajectory-Level Reward Modeling
State Key Laboratory of Novel Software Technology, Nanjing University(南京大学新型软件技术国家重点实验室);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院);AMAP, Alibaba Group(阿里集团AMAP)