心理科学在可操作分析中的应用
Applications of Psychological Science for Actionable Analytics
摘要:
可操作的分析是人类可以理解和操作的分析。什么样的数据采掘模型可以生成这样的可操作分析?根据心理科学家的说法,人类理解的模型最符合他们自己的内部模型,他们将其描述为“启发式”列表(即,非常简洁的规则列表)。一个这样的启发式规则生成器是心理科学家喜欢的快速节俭树(FFT)。尽管FFT在许多应用领域都取得了成功,但它还没有应用于软件分析。因此,本文评估软件分析的FFT。我们发现,FFT是非常有效的。他们的模型非常简洁(5行或更少的代码描述了一个二叉决策树)。这些简洁的模型优于Ghortra等人在ICSE'15上定义的最先进的缺陷预测算法。此外,当我们将训练数据限制为操作属性(即,这些属性经常被开发人员改变),FFT的性能比标准学习器好得多。我们的结论是双重的。首先,软件分析社区可以从心理科学中学到很多东西。其次,复杂方法的支持者应始终将这些方法与较简单的替代方法进行比较。例如,FFT可以用作标准基线学习器,与其他软件分析工具进行比较。
英文摘要:
Actionable analytics are those that humans can understand, and operationalize. What kind of data mining models generate such actionable analytics? According to psychological scientists, humans understand models that most match their own internal models, which they characterize as lists of "heuristic" (i.e., lists of very succinct rules). One such heuristic rule generator is the Fast-and-Frugal Trees (FFT) preferred by psychological scientists. Despite their successful use in many applied domains, FFTs have not been applied in software analytics. Accordingly, this paper assesses FFTs for software analytics. We find that FFTs are remarkably effective. Their models are very succinct (5 lines or less describing a binary decision tree). These succinct models outperform state-of-the-art defect prediction algorithms defined by Ghortra et al. at ICSE'15. Also, when we restrict training data to operational attributes (i.e., those attributes that are frequently changed by developers), FFTs perform much better than standard learners. Our conclusions are two-fold. Firstly, there is much that software analytics community could learn from psychological science. Secondly, proponents of complex methods should always baseline those methods against simpler alternatives. For example, FFTs could be used as a standard baseline learner against which other software analytics tools are compared.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。