arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.03061cs.LGcs.PLcs.SEstat.ML
收藏

关于Source Code嵌入的文献研究

A Literature Study of Embeddings on Source Code

KTH Royal Institute of Technology(瑞典皇家理工学院)

Zimin Chen, Martin Monperrus

摘要:

自然语言处理在词嵌入技术(如word2vec)取得成功后有了巨大的进步。最近,同样的想法已经应用在源代码上,取得了令人鼓舞的结果。在这个调查中,我们的目标是收集和讨论词嵌入技术在程序和源代码中的使用。本调查中的文章是通过询问相关工作的作者并在Google Scholar上进行广泛搜索而收集的。每篇文章分为五类:1。标记的嵌入2.函数或方法的嵌入3.嵌入方法调用的序列或集合4.二进制代码的嵌入5.其他嵌入我们还提供了实验数据的链接,并展示了一些显着的可视化代码嵌入。总之,词嵌入已经成功地应用于不同粒度的源代码。通过访问无数的开源存储库,我们看到了未来在源代码上应用其他数据驱动的自然语言处理技术的巨大潜力。

英文摘要:

Natural language processing has improved tremendously after the success of word embedding techniques such as word2vec. Recently, the same idea has been applied on source code with encouraging results. In this survey, we aim to collect and discuss the usage of word embedding techniques on programs and source code. The articles in this survey have been collected by asking authors of related work and with an extensive search on Google Scholar. Each article is categorized into five categories: 1. embedding of tokens 2. embedding of functions or methods 3. embedding of sequences or sets of method calls 4. embedding of binary code 5. other embeddings. We also provide links to experimental data and show some remarkable visualization of code embeddings. In summary, word embedding has been successfully applied on different granularities of source code. With access to countless open-source repositories, we see a great potential of applying other data-driven natural language processing techniques on source code in the future.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑