Recent advances in language models (LMs) have driven significant progress in various software engineering tasks. However, existing LMs still struggle with complex programming scenarios due to limitations in data quality, model architecture, and reasoning capability. This research systematically addresses these challenges through three complementary directions: (1) improving code data quality with a code difference-guided adversarial augmentation technique (CODA) and a code denoising technique (CodeDenoise); (2) enhancing model architecture via syntax-guided code LMs (LEAM and LEAM++); and (3) advancing model reasoning with a prompting technique (muFiX) and an agent-based technique (Specine). These techniques aim to promote the practical adoption of LMs in software development and further advance intelligent software engineering.
The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation
FPT Software AI Center(FPT软件人工智能中心);Hanoi University of Science and Technology(河内科技大学);McGill University(麦吉尔大学);Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Fulbright University(富布赖特大学)
本文提出多语言代码-文本数据集 The Vault,包含 4300 万高质量样本,通过规则与深度学习方法提取构建,实验表明在其上微调的代码大模型在代码生成、搜索和摘要任务上优于 CodeSearchNet 等数据集训练结果。
Large Language Models are Qualified Benchmark Builders: Rebuilding Pre-Training Datasets for Advancing Code Intelligence Tasks
College of Computer, National University of Defense Technology(计算机学院,国防科技大学);Sun Yat-sen University(中山大学);College of Banking and Financial Studies(金融学院)
HistoryFinder: Advancing Method-Level Source Code History Generation with Accurate Oracles and Enhanced Algorithm
SQM Research Lab, University of Manitoba(马尼托巴大学 SQM 研究实验室);American International University-Bangladesh(孟加拉国美国国际大学);University of Saskatchewan(萨斯喀彻温大学)
LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuning
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);School of Software, Tsinghua University(清华大学软件学院);Sinosoft Company Limited(中科软科技股份有限公司)
Deep Learning and Machine Learning, Advancing Big Data Analytics and Management: Object-Oriented Programming
Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学);Indiana University(印第安纳大学);Rutgers University(罗格斯大学);Purdue University(普渡大学);Kyoto University(京都大学);University of Hawaii(夏威夷大学);National Tsing Hua University(国立清华大学);The University of Texas at Dallas(德克萨斯大学达拉斯分校);Georgia Institute of Technology(佐治亚理工学院);University of Wisconsin-Madison(威斯康星大学麦迪逊分校);National Taiwan Normal University(台湾师范大学);Emory University(埃默里大学);JTB Technology Corp.(JTB技术公司)