学习识别可操作的静态代码库(非常简单)
Learning to Recognize Actionable Static Code Warnings (is Intrinsically Easy)
摘要:
静态代码警告工具经常生成程序员忽略的警告。这些工具可以通过选择“可操作的”警告(即通常不会被忽略的警告)的数据采掘算法而变得更有用。在本文中,我们在FindBugs的31,058个静态代码警告中看到的5,675个可操作警告样本中寻找可操作警告。我们发现,数据采掘算法可以找到可操作的警告,非常容易。具体来说,一系列数据采掘方法(深度学习器、随机森林、决策树学习器和支持向量机)都取得了非常好的结果(召回率和AUC(TRN,TPR)测量通常超过95%,误报通常低于5%)。鉴于所有这些学习者都很容易成功,我们应该问一下,这项任务是否有一些本质上容易的地方。我们报告说,虽然我们的数据集有多达58个原始特征,但这些特征可以近似为不到两个基本维度。对于这种本质上简单的数据,许多不同类型的学习器可以生成具有相似性能的有用模型。基于上述,我们得出结论,学习识别可操作的静态代码警告是容易的,使用广泛的学习算法,因为底层数据本质上是简单的。如果我们不得不为这个任务选择一个特定的学习器,我们会建议使用线性SVM(因为至少在我们的样本中,该学习器运行得相对较快,并且达到了最佳的中值性能),我们不建议使用深度学习(因为这些数据本质上非常简单)。
英文摘要:
Static code warning tools often generate warnings that programmers ignore. Such tools can be made more useful via data mining algorithms that select the "actionable" warnings; i.e. the warnings that are usually not ignored. In this paper, we look for actionable warnings within a sample of 5,675 actionable warnings seen in 31,058 static code warnings from FindBugs. We find that data mining algorithms can find actionable warnings with remarkable ease. Specifically, a range of data mining methods (deep learners, random forests, decision tree learners, and support vector machines) all achieved very good results (recalls and AUC (TRN, TPR) measures usually over 95% and false alarms usually under 5%). Given that all these learners succeeded so easily, it is appropriate to ask if there is something about this task that is inherently easy. We report that while our data sets have up to 58 raw features, those features can be approximated by less than two underlying dimensions. For such intrinsically simple data, many different kinds of learners can generate useful models with similar performance. Based on the above, we conclude that learning to recognize actionable static code warnings is easy, using a wide range of learning algorithms, since the underlying data is intrinsically simple. If we had to pick one particular learner for this task, we would suggest linear SVMs (since, at least in our sample, that learner ran relatively quickly and achieved the best median performance) and we would not recommend deep learning (since this data is intrinsically very simple).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。