AI Agent

Optimizing Cooperative Multi-Object Tracking using Graph Signal Processing

Maria Damanaki, Nikos Piperigkos, Alexandros Gkillas, Aris S. Lalos

机构 * Industrial Systems Institute, Athena Research Center, Patras Science Park, Greece（工业系统研究所，阿提卡研究中心，帕特拉斯科学公园，希腊） ； AviSense.AI, Patras Science Park, Greece（AviSense.AI，帕特拉斯科学公园，希腊） ； Dpt. of Informatics & Telecom., University of Ioannina, Arta, Greece（信息与电信系，伊奥安妮亚大学，阿塔，希腊） 纠错

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)

Comments 2025 IEEE International Conference on Multimedia and Expo Workshops, 3DMM - 3D Multimedia Analytics, Search and Generation

AmbiK: Dataset of Ambiguous Tasks in Kitchen Environment

Anastasiia Ivanova, Eva Bakaeva, Zoya Volovikova, Alexey K. Kovalev, Aleksandr I. Panov

机构 * LMU（慕尼黑大学） ； MIPT（莫斯科 Institute of Physics and Technology） ； AIRI（空气研究所） 纠错

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments ACL 2025 (Main Conference)

MCU: An Evaluation Framework for Open-Ended Game Agents

Xinyue Zheng, Haowei Lin, Kaichen He, Zihao Wang, Zilong Zheng, Yitao Liang

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Journal ref ICML 2025 Spotlight

Natural Language Reinforcement Learning

Xidong Feng, Bo Liu, Yan Song, Haotian Fu, Ziyu Wan, Girish A. Koushik, Zhiyuan Hu, Mengyue Yang, Ying Wen, Jun Wang

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments 10 pages

BETTY Dataset: A Multi-modal Dataset for Full-Stack Autonomy

Micah Nye, Ayoub Raji, Andrew Saba, Eidan Erlich, Robert Exley, Aragya Goyal, Alexander Matros, Ritesh Misra, Matthew Sivaprakasam, Marko Bertogna, Deva Ramanan, Sebastian Scherer

机构 * Robotics Institute, Carnegie Mellon University（卡内基梅隆大学机器人研究所） ； University of Modena and Reggio Emilia（摩德纳和雷吉奥艾米利亚大学） ； University of Waterloo（滑铁卢大学） ； University of Pittsburgh（匹兹堡大学） 纠错

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)

Comments 8 pages. 5 figures. ICRA 2025

AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents

Maksym Andriushchenko, Alexandra Souly, Mateusz Dziemian, Derek Duenas, Maxwell Lin, Justin Wang, Dan Hendrycks, Andy Zou, Zico Kolter, Matt Fredrikson, Eric Winsor, Jerome Wynne, Yarin Gal, Xander Davies

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Accepted at ICLR 2025

Building LLM Agents by Incorporating Insights from Computer Systems

Yapeng Mi, Zhi Gao, Xiaojian Ma, Qing Li

专题命中 Agent评测 ：agent(abstract)；autonomous agent(abstract)；agentic(abstract)

JudgeBench: A Benchmark for Evaluating LLM-based Judges

Sijun Tan, Siyuan Zhuang, Kyle Montgomery, William Y. Tang, Alejandro Cuadron, Chenguang Wang, Raluca Ada Popa, Ion Stoica

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Published as a conference paper at ICLR 2025

ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery

Ziru Chen, Shijie Chen, Yuting Ning, Qianheng Zhang, Boshi Wang, Botao Yu, Yifei Li, Zeyi Liao, Chen Wei, Zitong Lu, Vishal Dey, Mingyi Xue, Frazier N. Baker, Benjamin Burns, Daniel Adu-Ampratwum, Xuhui Huang, Xia Ning, Song Gao, Yu Su, Huan Sun

专题命中 Agent评测 ：agent(abstract)；workflow(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments ICLR 2025. 60 pages

A Rapid Trajectory Optimization and Control Framework for Resource-Constrained Applications

Deep Parikh, Thomas L. Ahrens, Manoranjan Majji

专题命中 Agent评测 ：agent(abstract)；autonomous agent(abstract)；multi-agent(abstract)

Comments This work has been accepted for publication at the IEEE ACC 2025

Fourier Head: Helping Large Language Models Learn Complex Probability Distributions

Nate Gillman, Daksh Aggarwal, Michael Freeman, Saurabh Singh, Chen Sun

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Camera ready version (ICLR 2025). Code at https://nategillman.com/fourier-head

Large Language Model Critics for Execution-Free Evaluation of Code Changes

Aashish Yadavally, Hoan Nguyen, Laurent Callot, Gauthier Guinet

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL、cs.SE

Comments 10 pages, 4 figures

Human-In-the-Loop Software Development Agents

Wannita Takerngsaksiri, Jirat Pasuksmit, Patanamon Thongtanunam, Chakkrit Tantithamthavorn, Ruixiong Zhang, Fan Jiang, Jing Li, Evan Cook, Kun Chen, Ming Wu

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.LG、cs.SE

Comments 10 pages, 9 figures, ICSE SEIP 2025

Moving Object Segmentation in Point Cloud Data using Hidden Markov Models

Vedant Bhandari, Jasmin James, Tyson Phillips, P. Ross McAree

专题命中 Agent评测 ：agent(abstract)；autonomous agent(abstract)；planning(abstract)

Comments Accepted to the IEEE IROS 2024 workshop on Long-Term Perception for Autonomy in Dynamic Human-shared Environments: What Do Robots Need?

Observational Scaling Laws and the Predictability of Language Model Performance

Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto

专题命中 Agent评测 ：agent(abstract)；agentic(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Accepted at NeurIPS 2024 as a spotlight

Using Generative Agents to Create Tip Sheets for Investigative Data Reporting

Joris Veerbeek, Nicholas Diakopoulos

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Short paper to be presented at Computation + Journalism 2024

CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecasting

Jiezhi Yang, Khushi Desai, Charles Packer, Harshil Bhatia, Nicholas Rhinehart, Rowan McAllister, Joseph Gonzalez

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)

Comments ECCV 2024. Project page with video and code: www.carff.website

The Vision of Autonomic Computing: Can LLMs Make It a Reality?

Zhiyang Zhang, Fangkai Yang, Xiaoting Qin, Jue Zhang, Qingwei Lin, Gong Cheng, Dongmei Zhang, Saravan Rajmohan, Qi Zhang

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.SE

IDAT: A Multi-Modal Dataset and Toolkit for Building and Evaluating Interactive Task-Solving Agents

Shrestha Mohanty, Negar Arabzadeh, Andrea Tupini, Yuxuan Sun, Alexey Skrynnik, Artem Zholus, Marc-Alexandre Côté, Julia Kiseleva

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

NExT-GPT: Any-to-Any Multimodal LLM

Shengqiong Wu, Hao Fei, Leigang Qu, Wei Ji, Tat-Seng Chua

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments ICML 2024 (Oral)

Understanding Understanding: A Pragmatic Framework Motivated by Large Language Models

Kevin Leyton-Brown, Yoav Shoham

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Feedback Loops With Language Models Drive In-Context Reward Hacking

Alexander Pan, Erik Jones, Meena Jagadeesan, Jacob Steinhardt

专题命中 Agent评测 ：agent(abstract)；autonomous agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments ICML 2024 camera-ready

Measuring Social Norms of Large Language Models

Ye Yuan, Kexin Tang, Jianhao Shen, Ming Zhang, Chenguang Wang

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Identifying the Risks of LM Agents with an LM-Emulated Sandbox

Yangjun Ruan, Honghua Dong, Andrew Wang, Silviu Pitis, Yongchao Zhou, Jimmy Ba, Yann Dubois, Chris J. Maddison, Tatsunori Hashimoto

专题命中 Agent评测 ：agent(abstract)；tool use(abstract)；分类 cs.AI、cs.CL、cs.LG

Weaver: Foundation Models for Creative Writing

Tiannan Wang, Jiamin Chen, Qingrui Jia, Shuai Wang, Ruoyu Fang, Huilin Wang, Zhaowei Gao, Chunzhao Xie, Chuou Xu, Jihong Dai, Yibin Liu, Jialong Wu, Shengwei Ding, Long Li, Zhiwei Huang, Xinle Deng, Teng Yu, Gangan Ma, Han Xiao, Zixin Chen, Danjun Xiang, Yunxia Wang, Yuanyuan Zhu, Yi Xiao, Jing Wang, Yiru Wang, Siran Ding, Jiayang Huang, Jiayi Xu, Yilihamu Tayier, Zhenyu Hu, Yuan Gao, Chengfeng Zheng, Yueshu Ye, Yihang Li, Lei Wan, Xinyue Jiang, Yujie Wang, Siyu Cheng, Zhule Song, Xiangru Tang, Xiaohua Xu, Ningyu Zhang, Huajun Chen, Yuchen Eleanor Jiang, Wangchunshu Zhou

专题命中 Agent评测 ：agent(abstract)；function calling(abstract)；分类 cs.AI、cs.CL、cs.LG

Skill-Mix: a Flexible and Expandable Family of Evaluations for AI models

Dingli Yu, Simran Kaur, Arushi Gupta, Jonah Brown-Cohen, Anirudh Goyal, Sanjeev Arora

专题命中 Agent评测 ：agent(abstract)；AI agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Language Instructed Reinforcement Learning for Human-AI Coordination

Hengyuan Hu, Dorsa Sadigh

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Winning the 3rd Japan Automotive AI Challenge -- Autonomous Racing with the Autoware.Auto Open Source Software Stack

Zirui Zang, Renukanandan Tumu, Johannes Betz, Hongrui Zheng, Rahul Mangharam

专题命中 Agent评测 ：agent(abstract)；planning(abstract)；multi-agent(abstract)

Comments Accepted at Autoware Workshop at IV 2022

MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge

Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, Anima Anandkumar

专题命中 Agent评测 ：agent(abstract)；autonomous agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments Outstanding Paper Award at NeurIPS 2022. Project website: https://minedojo.org

Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue

So Yeon Min, Hao Zhu, Ruslan Salakhutdinov, Yonatan Bisk

专题命中 Agent评测 ：agent(abstract)；multi-agent(abstract)；分类 cs.AI、cs.CL、cs.LG

Comments To Appear in the Proceedings of EMNLP 2022