Benchmarks and Metrics for Evaluations of Code Generation: A Critical Review
Debalina Ghosh Paul, Hong Zhu, Ian Bayley
专题命中
代码生成
:code generation(title);分类 cs.SE、cs.AI
CommentsAccepted by the First IEEE International Workshop on Testing and Evaluation of Large Language Models (TELLMe 2024) and will be published in the proceedings of the IEEE AITest 2024 conference
Shellcode_IA32: A Dataset for Automatic Shellcode Generation
Pietro Liguori, Erfan Al-Hossami, Domenico Cotroneo, Roberto Natella, Bojan Cukic, Samira Shaikh
专题命中
代码生成
:code generation(title);分类 cs.SE、cs.CL
CommentsPaper accepted to NLP4Prog Workshop 2021 co-located with ACL-IJCNLP 2021. Extended journal version of this work has been published in the Automated Software Engineering journal, Volume 29, Article no. 30, March 2022, DOI: 10.1007/s10515-022-00331-3
CommentsThis paper has been accepted for publication at the 30th International Conference on Evaluation and Assessment in Software Engineering (EASE 2026) AI models/data track
SimLLM: Fine-Tuning Code LLMs for SimPy-Based Queueing System Simulation
SimLLM:用于基于SimPy的排队系统模拟的代码LLM微调
Jun-Qi Chen, Kun Zhang, Rui Zheng, Ying Zhong
机构
*
Institute of Statistics and Big Data, Renmin University of China(中国人民大学统计与大数据研究院)
;
School of Information, Renmin University of China(中国人民大学信息学院)
;
School of Management and Economics, University of Electronic Science and Technology of China(电子科技大学管理学院)
机构
*
University of Science and Technology of China(科学技术大学)
;
Cambricon Technologies(Cambricon科技)
;
SKL of Processors, Institute of Computing Technology, Chinese Academy of Sciences(处理器实验室,计算技术研究所,中国科学院)
;
Institute of Software, Chinese Academy of Sciences(软件研究所,中国科学院)