arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.09201cs.SEcs.LG
收藏

神经嵌入中程序的句法和语义表示的比较

Comparison of Syntactic and Semantic Representations of Programs in Neural Embeddings

Imperial College London(伦敦帝国学院);Department of Computing(计算机系)

Austin P. Wright, Herbert Wiklicky

摘要:

神经方法的程序合成和理解在过去的几年里已经广泛扩散,在同一时间基于图的神经网络已成为一个有前途的新工具。这项工作旨在成为第一个实证研究,比较自然语言模型和基于静态分析图的模型在表示深度学习系统中的程序的有效性。它比较了图卷积网络在程序嵌入任务中使用不同的图表示。结果表明,控制流图的稀疏性和图卷积网络的隐式聚集性导致这些模型的性能比朴素模型差。因此,它得出结论,简单地用形式信息扩充纯语言或统计模型并不能很好地执行,因为形式属性的细微差别会为图卷积网络引入更多的噪声而不是结构。

英文摘要:

Neural approaches to program synthesis and understanding have proliferated widely in the last few years; at the same time graph based neural networks have become a promising new tool. This work aims to be the first empirical study comparing the effectiveness of natural language models and static analysis graph based models in representing programs in deep learning systems. It compares graph convolutional networks using different graph representations in the task of program embedding. It shows that the sparsity of control flow graphs and the implicit aggregation of graph convolutional networks cause these models to perform worse than naive models. Therefore it concludes that simply augmenting purely linguistic or statistical models with formal information does not perform well due to the nuanced nature of formal properties introducing more noise than structure for graph convolutional networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑