CodeS: Natural Language to Code Repository via Multi-Layer Sketch
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);Peking University(北京大学);Huawei Technologies Co., Ltd(华为技术有限公司);Chinese Academy of Sciences(中国科学院);Shandong University(山东大学);Funcun-wuyou Technologies Co., Ltd(Funcun-wuyou科技有限公司)
Daoguang Zan, Ailun Yu, Wei Liu, Dong Chen, Bo Shen, Wei Li, Yafen Yao, Yongshun Gong, Xiaolin Chen, Bei Guan, Zhiguang Yang, Yongji Wang, Qianxiang Wang, Lizhen Cui
The impressive performance of large language models (LLMs) on code-related tasks has shown the potential of fully automated software development. In light of this, we introduce a new software engineering task, namely Natural Language to code Repository (NL2Repo). This task aims to generate an entire code repository from its natural language requirements. To address this task, we propose a simple yet effective framework CodeS, which decomposes NL2Repo into multiple sub-tasks by a multi-layer sketch. Specifically, CodeS includes three modules: RepoSketcher, FileSketcher, and SketchFiller. RepoSketcher first generates a repository's directory structure for given requirements; FileSketcher then generates a file sketch for each file in the generated structure; SketchFiller finally fills in the details for each function in the generated file sketch. To rigorously assess CodeS on the NL2Repo task, we carry out evaluations through both automated benchmarking and manual feedback analysis. For benchmark-based evaluation, we craft a repository-oriented benchmark, SketchEval, and design an evaluation metric, SketchBLEU. For feedback-based evaluation, we develop a VSCode plugin for CodeS and engage 30 participants in conducting empirical studies. Extensive experiments prove the effectiveness and practicality of CodeS on the NL2Repo task.
Natural Language Summarization Enables Multi-Repository Bug Localization by LLMs in Microservice Architectures
Yildiz Technical University, Dept. of Computer Eng.(Yildiz技术大学,计算机工程系);Yildiz Technical University, Department of Computer Engineering(Yildiz技术大学,计算机工程系)
Synergizing LLMs and Knowledge Graphs: A Novel Approach to Software Repository-Related Question Answering
Data-driven Analysis of Software (DAS) Lab Department of Computer Science \& Software Engineering Concordia University Montreal QC Canada;Concordia University
Beyond Function-Level Search: Repository-Aware Dual-Encoder Code Retrieval with Adversarial Verification
International Digital Economy Academy (IDEA)(国际数字经济学院);School of Electronic and Computer Engineering, Peking University(电子与计算机工程学院,北京大学);Shenzhen International Graduate School, Tsinghua University(深圳国际研究生院,清华大学)
CERT: Continual Pre-Training on Sketches for Library-Oriented Code Generation
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);Microsoft Research Asia(微软亚洲研究院);Korea University(高丽大学);University of Chinese Academy of Sciences(中国科学院大学);Microsoft Azure AI(微软Azure人工智能)
Sketching Transformed Matrices with Applications to Natural Language Processing
University of Wisconsin-Madison(威斯康星大学麦迪逊分校);Princeton University(普林斯顿大学);Institute for Advanced Study(高等研究院);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);University of Washington(华盛顿大学)
Natural Language Processing in Ethiopian Languages: Current State, Challenges, and Opportunities
Bahir Dar University(巴赫达尔大学);Universität Hamburg(汉堡大学);Wuhan University of Technology(武汉理工大学);Instituto Politécnico Nacional(国立理工学院);Wollo University(沃洛大学);Saarland University(萨尔大学)