COMPASS: A Multi-Dimensional Benchmark for Evaluating Code Generation in Large Language Models
机构 * Codility
专题命中 代码生成 :code generation(title,abstract);分类 cs.SE、cs.AI
AI 大模型
代码生成、软件工程智能体、程序修复、测试生成和开发者工具。
机构 * Codility
专题命中 代码生成 :code generation(title,abstract);分类 cs.SE、cs.AI
机构 * Department of Mechanical Engineering, University of Wisconsin-Madison(威斯康星大学麦迪逊分校机械工程系) ; Department of Computer Science, Rice University(里德大学计算机科学系)
专题命中 代码生成 :code generation(title);分类 cs.AI
机构 * University of Manitoba(曼尼托巴大学) ; Washington State University(华盛顿州立大学) ; University at Buffalo(布法罗大学)
专题命中 代码生成 :code generation(abstract);分类 cs.SE、cs.LG
Comments Accepted by TOSEM; 26 pages, 6 figures, 8 tables, 3 prompt templates, 1 algorithm
机构 * University of Luebeck(吕贝克大学)
专题命中 代码生成 :code generation(abstract)
Comments Technical Documentation
专题命中 软件智能体 :repository(abstract);分类 cs.SE
Comments (C) 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works
机构 * Shanghai Jiao Tong University(上海交通大学)
专题命中 代码评测 :repository(abstract);分类 cs.CL、cs.AI
机构 * National Key Laboratory for Novel Software Technology, Nanjing University, China(国家新型软件技术重点实验室,南京大学,中国) ; School of Artificial Intelligence, Nanjing University, China(人工智能学院,南京大学,中国) ; School of Intelligence Science and Technology, Nanjing University, China(智能科学与技术学院,南京大学,中国)
专题命中 仓库级理解 :repository(abstract);分类 cs.AI、cs.LG
Comments 9 pages, 3 figures, IJCAI 2025 Survey Track
机构 * University of Georgia(佐治亚大学) ; University of California, Merced(加州大学默塞德分校) ; Lehigh University(莱特大学) ; The University of Queensland(昆士兰大学) ; National University of Singapore(新加坡国立大学) ; University of California, Los Angeles(加州大学洛杉矶分校)
专题命中 仓库级理解 :repository(abstract);分类 cs.CL、cs.LG
Comments 15 pages, 11 figures