arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1908.09804cs.SE
收藏

神经代码搜索评估数据集

Neural Code Search Evaluation Dataset

Hongyu Li, Seohyun Kim, Satish Chandra

摘要:

人们对使用自然语言进行代码搜索越来越感兴趣。如果没有现成的评估套件,评估这种代码搜索模型的性能可能会很困难。在本文中,我们提出了一个评估数据集组成的自然语言查询和代码片段对,希望在这一领域的未来工作可以使用这个数据集作为一个共同的基准。我们还提供了最近工作中的两个代码搜索模型([1]和[6])的结果。评估数据集可在https://github.com/facebookresearch/Neural-Code-Search-Evaluation-Dataset上获得

英文摘要:

There has been an increase of interest in code search using natural language. Assessing the performance of such code search models can be difficult without a readily available evaluation suite. In this paper, we present an evaluation dataset consisting of natural language query and code snippet pairs, with the hope that future work in this area can use this dataset as a common benchmark. We also provide the results of two code search models ([1] and [6]) from recent work. The evaluation dataset is available at https://github.com/facebookresearch/Neural-Code-Search-Evaluation-Dataset

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑