arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.02660cs.CL
收藏

Source Code汇总数据集的建议

Recommendations for Datasets for Source Code Summarization

University of Notre Dame(圣母大学)

Alexander LeClair, Collin McMillan

摘要:

源代码摘要是编写源代码的简短、自然语言描述的任务。这些描述的主要用途是在软件文档中,例如JavaScripts中的一句话Java方法描述。代码摘要正迅速成为一个热门的研究问题,但由于缺乏合适的数据集,进展受到限制。此外,缺乏创建数据集的社区标准导致了混乱和不可复制的研究结果-我们观察到仅由于数据集设计的变化而导致的性能波动超过33%。在本文中,我们提出了建议,这些标准从实验结果。我们发布了一个数据集,该数据集基于之前的工作,其中包括超过210万对Java方法和来自超过28 k个Java项目的一句话方法描述。我们描述了数据集,并指出了与自然语言数据的关键差异,以指导和支持未来的研究人员。

英文摘要:

Source Code Summarization is the task of writing short, natural language descriptions of source code. The main use for these descriptions is in software documentation e.g. the one-sentence Java method descriptions in JavaDocs. Code summarization is rapidly becoming a popular research problem, but progress is restrained due to a lack of suitable datasets. In addition, a lack of community standards for creating datasets leads to confusing and unreproducible research results -- we observe swings in performance of more than 33% due only to changes in dataset design. In this paper, we make recommendations for these standards from experimental results. We release a dataset based on prior work of over 2.1m pairs of Java methods and one sentence method descriptions from over 28k Java projects. We describe the dataset and point out key differences from natural language data, to guide and support future researchers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑