2512.21373
2025-12-29
cs.SE
cs.AI
cs.PL
82%
AInsteinBench: Benchmarking Coding Agents on Scientific Repositories
AInsteinBench:在科学仓库中评估编码代理的基准测试
Titouan Duston, Shuo Xin, Yang Sun, Daoguang Zan, Aoyan Li, Shulin Xin, Kai Shen, Yixiao Chen, Qiming Sun, Ge Zhang, Jiashuo Liu, Huan Zhou, Jingkai Liu, Zhichen Pu, Yuanheng Wang, Bo-Xuan Ge, Xin Tong, Fei Ye, Zhi-Chao Zhao, Wen-Biao Han, Zhoujian Cao, Yueran Zhao, Weiluo Ren, Qingshen Long, Yuxiao Liu, Anni Huang, Yidi Du, Yuanyuan Rong, Jiahao Peng
机构
*
Princeton University(普林斯顿大学)
专题命中
软件智能体
:coding agent(title);code generation(abstract);分类 cs.SE、cs.AI、cs.PL
AI总结
AInsteinBench通过评估大型语言模型在科学计算开发中的能力,提供了一个基于真实科研软件生态系统的基准测试。