arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2206.08474cs.SEcs.AIcs.LG
收藏

XLCoST:跨语言代码智能基准数据集

XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence

Virginia Tech(弗吉尼亚理工大学)

Ming Zhu, Aneesh Jain, Karthik Suresh, Roshan Ravindran, Sindhu Tipirneni, Chandan K. Reddy

摘要:

机器学习的最新进展显著提高了对源代码数据的理解,并在许多下游任务上实现了良好的性能。像GitHub这样的开源存储库通过丰富的未标记代码数据实现了这一过程。然而,缺乏高质量的标记数据在很大程度上阻碍了一些代码相关任务的进展,如程序翻译,摘要,合成和代码搜索。本文介绍了一个新的跨语言代码智能基准数据集--跨语言代码片段数据集XLCoST。我们的数据集包含来自8种语言(7种常用的程序设计语言和英语)的细粒度并行数据,并支持10种跨语言代码任务。据我们所知,它是源代码的最大并行数据集,无论是在大小还是语言数量方面。我们还为每个任务提供了几个最先进的基线模型的性能。我们相信这个新的数据集可以成为研究社区的宝贵资产,并促进跨语言代码智能新方法的开发和验证。

英文摘要:

Recent advances in machine learning have significantly improved the understanding of source code data and achieved good performance on a number of downstream tasks. Open source repositories like GitHub enable this process with rich unlabeled code data. However, the lack of high quality labeled data has largely hindered the progress of several code related tasks, such as program translation, summarization, synthesis, and code search. This paper introduces XLCoST, Cross-Lingual Code SnippeT dataset, a new benchmark dataset for cross-lingual code intelligence. Our dataset contains fine-grained parallel data from 8 languages (7 commonly used programming languages and English), and supports 10 cross-lingual code tasks. To the best of our knowledge, it is the largest parallel dataset for source code both in terms of size and the number of languages. We also provide the performance of several state-of-the-art baseline models for each task. We believe this new dataset can be a valuable asset for the research community and facilitate the development and validation of new methods for cross-lingual code intelligence.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑