arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.06319cs.SEcs.AI
收藏

老但金:重新考虑前馈学习器对软件分析的价值

Old but Gold: Reconsidering the value of feedforward learners for software analytics

North Carolina State University(北卡罗来纳州立大学)

Rahul Yedida, Xueqi Yang, Tim Menzies

摘要:

人们对使用深度学习方法进行软件分析任务的兴趣越来越大。最先进的技术利用现代深度学习技术,如LSTM,产生有竞争力的性能,尽管代价是更长的训练时间。最近,Galke和Scherp [18]表明,至少对于图像识别,几十年前的前馈神经网络可以与现代深度学习技术的性能相匹配。这促使我们在SE文献中尝试相同的方法。具体来说,在本文中,我们将前馈网络与一些预处理应用于两个分析任务:问题关闭时间预测和漏洞检测。我们测试了Galke和Scherp [18]提出的假设,即前馈网络足以完成这两个任务的许多分析任务(我们称之为“老而金”假设)。对于来自这些任务的五个数据集中的三个,我们实现了新的高水位线结果(优于先前的最先进的结果),对于第四个数据集,旧的但黄金的表现以及最新的最先进的结果。此外,旧的但黄金的结果比先前的工作快了几个数量级。例如,对于问题关闭时间,旧的但黄金在90秒内找到了好的预测器(而新的方法需要6个小时才能运行)。我们的研究结果支持“古老但黄金”的假设,并导致以下建议:尝试更复杂的方法之前,简单的替代品。至少,这将产生一个基线结果,研究人员可以比较其他一些据说更复杂的方法。在最好的情况下,他们将获得有用的结果,与其他任何东西一样好,在一小部分的努力。为了支持开放科学,我们所有的脚本和数据都可以在https://github.com/fastidiouschipmunk/simple上获得。

英文摘要:

There has been an increased interest in the use of deep learning approaches for software analytics tasks. State-of-the-art techniques leverage modern deep learning techniques such as LSTMs, yielding competitive performance, albeit at the price of longer training times. Recently, Galke and Scherp [18] showed that at least for image recognition, a decades-old feedforward neural network can match the performance of modern deep learning techniques. This motivated us to try the same in the SE literature. Specifically, in this paper, we apply feedforward networks with some preprocessing to two analytics tasks: issue close time prediction, and vulnerability detection. We test the hypothesis laid by Galke and Scherp [18], that feedforward networks suffice for many analytics tasks (which we call, the "Old but Gold" hypothesis) for these two tasks. For three out of five datasets from these tasks, we achieve new high-water mark results (that out-perform the prior state-of-the-art results) and for a fourth data set, Old but Gold performed as well as the recent state of the art. Furthermore, the old but gold results were obtained orders of magnitude faster than prior work. For example, for issue close time, old but gold found good predictors in 90 seconds (as opposed to the newer methods, which took 6 hours to run). Our results supports the "Old but Gold" hypothesis and leads to the following recommendation: try simpler alternatives before more complex methods. At the very least, this will produce a baseline result against which researchers can compare some other, supposedly more sophisticated, approach. And in the best case, they will obtain useful results that are as good as anything else, in a small fraction of the effort. To support open science, all our scripts and data are available on-line at https://github.com/fastidiouschipmunk/simple.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑