AI Agent

LongRM: Revealing and Unlocking the Context Boundary of Reward Modeling

Zecheng Tang, Baibei Ji, Quantong Qiu, Haitian Wang, Xiaobo Liang, Juntao Li, Min Zhang

机构 * Soochow University（苏州大学） ； LCM Laboratory（LCM实验室） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.CL

The Physical Basis of Prediction: World Model Formation in Neural Organoids via an LLM-Generated Curriculum

Brennen Hill

机构 * Department of Computer Science University of Wisconsin-Madison（计算机科学系 威斯康星大学麦迪逊分校） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Published in the proceedings of the 39th Conference on Neural Information Processing Systems (NeurIPS 2025) Workshop: Scaling Environments for Agents (SEA). Additionally accepted for presentation in NeurIPS 2025 Workshop: Embodied World Models for Decision Making

SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents

Ibragim Badertdinov, Alexander Golubev, Maksim Nekrashevich, Anton Shevtsov, Simon Karasik, Andrei Andriushchenko, Maria Trofimova, Daria Litvintseva, Boris Yangel

机构 * Nebius 纠错

专题命中 Agent评测 ：agentic(abstract)；分类 cs.CL、cs.SE

Comments Dataset: https://huggingface.co/datasets/nebius/SWE-rebench, SWE-rebench leaderboard https://swe-rebench.com NeurIPS 2025

ARC-GEN: A Mimetic Procedural Benchmark Generator for the Abstraction and Reasoning Corpus

Michael D. Moffitt

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

How Effective Are Time-Series Models for Precipitation Nowcasting? A Comprehensive Benchmark for GNSS-based Precipitation Nowcasting

Yifang Zhang, Shengwu Xiong, Henan Wang, Wenjie Yin, Jiawang Peng, Yuqiang Zhang, Chen Zhou, Hua Chen, Qile Zhao, Pengfei Duan

机构 * Sanya Science and Education Innovation Park, Wuhan University of Technology（武汉理工大学三亚科技创新园） ； Wuhan University of Technology（武汉理工大学） ； School of Computer Science and Artificial Intelligence, Wuhan University of Technology（武汉理工大学计算机科学与人工智能学院） ； Interdisciplinary Artificial Intelligence Research Institute, Wuhan College（武汉学院交叉人工智能研究院） ； Shanghai Artificial Intelligence Laboratory, Shanghai（上海人工智能实验室） ； School of Earth and Space Science and Technology, Wuhan University（武汉大学地球空间科学与技术学院） ； School of Water Resources and Hydropower Engineering, Wuhan University（武汉大学水利水电学院） ； GNSS Research Center, Wuhan University（武汉大学GNSS研究中心） 纠错

专题命中 Agent评测 ：planning(abstract)；分类 cs.AI、cs.LG

Comments 13 pages,11 figures

An Open-Access Benchmark of Statistical and Machine-Learning Anomaly Detection Methods for Battery Applications

Mei-Chin Pang, Suraj Adhikari, Takuma Kasahara, Nagihiro Haba, Saneyuki Ohno

机构 * BASF SE（巴斯夫股份有限公司） ； Institute of Multidisciplinary Research for Advanced Materials（多学科先进材料研究所） 纠错

专题命中 Agent评测 ：workflow(abstract)；分类 cs.AI、cs.LG

Continual Learning, Not Training: Online Adaptation For Agents

Aman Jaglan, Jarrod Barnes

机构 * Arc Intelligence 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Comments 12 pages, 4 figures

Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning

Marwa Abdulhai, Ryan Cheng, Donovan Clay, Tim Althoff, Sergey Levine, Natasha Jaques

机构 * UC Berkeley（伯克利大学） ； University of Washington（华盛顿大学） ； Google DeepMind（谷歌DeepMind） 纠错

专题命中 Agent评测 ：AI agent(abstract)；分类 cs.AI、cs.CL

DCcluster-Opt: Benchmarking Dynamic Multi-Objective Optimization for Geo-Distributed Data Center Workloads

Antonio Guillen-Perez, Avisek Naug, Vineet Gundecha, Sahand Ghorbanpour, Ricardo Luna Gutierrez, Ashwin Ramesh Babu, Munther Salim, Shubhanker Banerjee, Eoin H. Oude Essink, Damien Fay, Soumyendu Sarkar

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Submitted to the NeurIPS 2025 conference

Towards Robust Evaluation of STEM Education: Leveraging MLLMs in Project-Based Learning

Xinyi Wu, Yanhao Jia, Qinglin Zhang, Yiran Qin, Luwei Xiao, Shuai Zhao

机构 * Shanghai Jiao Tong University（上海交通大学） ； Nanyang Technological University（南洋理工大学） ； Shanghai AI Laboratory（上海人工智能实验室） 纠错

专题命中 Agent评测 ：AI agent(abstract)；分类 cs.AI、cs.CL

STACKFEED: Structured Textual Actor-Critic Knowledge Base Editing with FeedBack

Shashank Kirtania, Naman Gupta, Priyanshu Gupta, Krishna Kariya, Sumit Gulwani, Arun Iyer, Suresh Parthasarathy, Arjun Radhakrishna, Sriram K. Rajamani, Gustavo Soares

机构 * Microsoft（微软） ； Microsoft Research India（微软印度研究院） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Journal ref Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track 2588-2606

VRScout: Towards Real-Time, Autonomous Testing of Virtual Reality Games

Yurun Wu, Yousong Sun, Burkhard Wunsche, Jia Wang, Elliott Wen

机构 * School of Computer Science University of Auckland（计算机科学学院 奥克兰大学） ； School of Advanced Technology Xi'an Jiaotong-Liverpool University（先进科技学院 西交利物浦大学） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

MedCalc-Eval and MedCalc-Env: Advancing Medical Calculation Capabilities of Large Language Models

Kangkun Mao, Jinru Ding, Jiayuan Chen, Mouxiao Bian, Ruiyao Chen, Xinwei Peng, Sijie Ren, Linyang Li, Jie Xu

机构 * Shanghai AI Laboratory（上海人工智能实验室） 纠错

专题命中 Agent评测 ：planning(abstract)；分类 cs.AI、cs.CL

MemeArena: Automating Context-Aware Unbiased Evaluation of Harmfulness Understanding for Multimodal Large Language Models

Zixin Chen, Hongzhan Lin, Kaixin Li, Ziyang Luo, Yayue Deng, Jing Ma

机构 * Hong Kong Baptist University（香港 Baptist 大学） ； Beijing University of Posts and Telecommunications（北京邮电大学） ； National University of Singapore（新加坡国立大学） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.CL

Comments EMNLP 2025

AstroVisBench: A Code Benchmark for Scientific Computing and Visualization in Astronomy

Sebastian Antony Joseph, Syed Murtaza Husain, Stella S. R. Offner, Stéphanie Juneau, Paul Torrey, Adam S. Bolton, Juan P. Farias, Niall Gaffney, Greg Durrett, Junyi Jessy Li

机构 * The University of Texas at Austin（德克萨斯大学奥斯汀分校） ； NSF National Optical-Infrared Astronomy Research Laboratory（国家光学红外天文研究实验室） ； University of Virginia（弗吉尼亚大学） ； SLAC National Accelerator Laboratory（斯坦福直线加速器实验室） ； Texas Advanced Computing Center（德克萨斯高级计算中心） 纠错

专题命中 Agent评测 ：workflow(abstract)；分类 cs.CL、cs.LG

Comments Accepted at NeurIPS 2025 Datasets & Benchmarks Track

On the Mistaken Assumption of Interchangeable Deep Reinforcement Learning Implementations

Rajdeep Singh Hundal, Yan Xiao, Xiaochun Cao, Jin Song Dong, Manuel Rigger

机构 * National University of Singapore（新加坡国立大学） ； Sun Yat-sen University（中山大学） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.SE

Comments Added the ACM Functional v1.1 badge, the full publication citation, and a link to the publication on IEEE Xplore

Journal ref IEEE/ACM 47th International Conference on Software Engineering (ICSE), Ottawa, ON, Canada, 2025, pp. 2225-2237

Context Engineering 2.0: The Context of Context Engineering

Qishuo Hua, Lyumanshan Ye, Dayuan Fu, Yang Xiao, Xiaojie Cai, Yunze Wu, Jifan Lin, Junfei Wang, Pengfei Liu

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.CL

Monopoly Deal: A Benchmark Environment for Bounded One-Sided Response Games

Will Wolf

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Comments 24 pages, 7 figures

Plasticity as the Mirror of Empowerment

David Abel, Michael Bowling, André Barreto, Will Dabney, Shi Dong, Steven Hansen, Anna Harutyunyan, Khimya Khetarpal, Clare Lyle, Razvan Pascanu, Georgios Piliouras, Doina Precup, Jonathan Richens, Mark Rowland, Tom Schaul, Satinder Singh

机构 * Google DeepMind（谷歌DeepMind） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2025

Automating Benchmark Design

Amanda Dsouza, Harit Vishwakarma, Zhengyang Qi, Justin Bauer, Derek Pham, Thomas Walshe, Armin Parchami, Frederic Sala, Paroma Varma

机构 * Snorkel AI ； Dept. of Computer Sciences, University of Wisconsin-Madison（计算机科学系，威斯康星大学麦迪逊分校） 纠错

专题命中 Agent评测 ：agentic(abstract)；分类 cs.LG、cs.SE

Perception Learning: A Formal Separation of Sensory Representation Learning from Decision Learning

Suman Sanyal

机构 * Big Data Analytics, Goa Institute of Management, Goa, India（大数据分析，果阿管理学院，果阿，印度） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

The Formalism-Implementation Gap in Reinforcement Learning Research

Pablo Samuel Castro

机构 * Google DeepMind（谷歌DeepMind） ； Université de Montréal（蒙特利尔大学） ； Mila - Québec AI Institute（魁北克AI研究院） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Open Multimodal Retrieval-Augmented Factual Image Generation

Yang Tian, Fan Liu, Jingyuan Zhang, Wei Bi, Yupeng Hu, Liqiang Nie

机构 * Shandong University（山东大学） ； National University of Singapore（新加坡国立大学） ； Kuaishou Technology（快手科技） ； Harbin Institute of Technology（哈尔滨工业大学） 纠错

专题命中 Agent评测 ：agentic(abstract)；分类 cs.AI、cs.LG

Comments Preprint

Right Place, Right Time: Market Simulation-based RL for Execution Optimisation

Ollie Olby, Andreea Bacalum, Rory Baggott, Namid Stillman

机构 * Simudyne UK（Simudyne英国公司） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Comments 8 pages, 4 figures, accepted to ICAIF 2025

PhysGym: Benchmarking LLMs in Interactive Physics Discovery with Controlled Priors

Yimeng Chen, Piotr Piȩkos, Mateusz Ostaszewski, Firas Laakom, Jürgen Schmidhuber

机构 * Center of Excellence for Generative AI, KAUST（生成人工智能卓越中心，KAUST） ； The Swiss AI Lab, IDSIA-USI/SUPSI（瑞士人工智能实验室，IDSIA-USI/SUPSI） ； NNAISENSE Principia-AI/PhysGym（NNAISENSE 原初人工智能/PhysGym） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Comments 31 Pages

ContextAgent: Context-Aware Proactive LLM Agents with Open-World Sensory Perceptions

Bufang Yang, Lilin Xu, Liekang Zeng, Kaiwei Liu, Siyang Jiang, Wenrui Lu, Hongkai Chen, Xiaofan Jiang, Guoliang Xing, Zhenyu Yan

机构 * The Chinese University of Hong Kong（香港中文大学） ； Columbia University（哥伦比亚大学） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.CL

Comments Accepted by NeurIPS 2025

Assessing the Potential of Generative Agents in Crowdsourced Fact-Checking

Luigia Costabile, Gian Marco Orlando, Valerio La Gatta, Vincenzo Moscato

机构 * Department of Electrical Engineering and Information Technology (DIETI), University of Naples Federico II（那不勒斯费德里科二世大学电气工程与信息技术系） ； Northwestern University, Department of Computer Science, McCormick School of Engineering and Applied Science（西北大学计算机科学系，麦科马克工程与应用科学学院） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.CL

Comments This paper has been published in Online Social Networks and Media (https://doi.org/10.1016/j.osnem.2025.100326). Please cite the published version accordingly

Journal ref Online Social Networks and Media, Volume 48, September 2025, 100326

Human Choice Prediction in Language-based Persuasion Games: Simulation-based Off-Policy Evaluation

Eilam Shapira, Omer Madmon, Reut Apel, Moshe Tennenholtz, Roi Reichart

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication in Transactions of the Association for Computational Linguistics (TACL), 2025. Pre-MIT Press publication version

Software Engineering Agents for Embodied Controller Generation : A Study in Minigrid Environments

Timothé Boulet, Xavier Hinaut, Clément Moulin-Frier

机构 * Inria Center of Bordeaux University（Inria 波尔多中心大学） ； Flowers AI & CogSci Lab（Flowers AI 与认知科学实验室） ； LaBRI, Bordeaux INP, CNRS UMR 5800（LaBRI，波尔多 INP，CNRS UMR 5800） ； IMN, CNRS UMR 5293（IMN，CNRS UMR 5293） ； Inria - Flowers AI & CogSci Lab - BioTiC（Inria - Flowers AI 与认知科学实验室 - BioTiC） 纠错

专题命中 Agent评测 ：agent(abstract)；分类 cs.AI、cs.SE

Comments 10 pages, 7 figures

Journal ref 39th Conference on Neural Information Processing Systems (NeurIPS 2025) Workshop: Efficient Reasoning

Risk Management for Mitigating Benchmark Failure Modes: BenchRisk

Sean McGregor, Victor Lu, Vassil Tashev, Armstrong Foundjem, Aishwarya Ramasethu, Sadegh AlMahdi Kazemi Zarkouei, Chris Knotz, Kongtao Chen, Alicia Parrish, Anka Reuel, Heather Frase

专题命中 Agent评测 ：workflow(abstract)；分类 cs.LG、cs.SE

Comments 19 pages, 7 figures, to be published in the 39th Conference on Neural Information Processing Systems (NeurIPS 2025)