AutoSpearman:自动减轻解释缺陷模型的相关性干扰
AutoSpearman: Automatically Mitigating Correlated Metrics for Interpreting Defect Models
摘要:
缺陷模型的解释在很大程度上依赖于用于构建它们的软件度量。然而,这样的软件度量通常与缺陷模型相关。为了提高缺陷模型的性能,以前的工作通常使用特征选择技术来去除相关的度量。然而,如果特征选择技术产生不一致和相关度量的子集,则缺陷模型的解释可能是误导性的。在本文中,我们调查的一致性和相关性的度量的子集产生的九个常用的特征选择技术。通过对13个公开的缺陷数据集的案例研究,我们发现特征选择技术产生了不一致的度量子集,并且没有减轻相关度量,这表明当目标是模型解释时,不应该使用特征选择技术,并且必须应用相关性分析。由于相关性分析往往涉及手动选择的指标领域的专家,我们介绍AutoSpearman,一个自动化的指标选择方法的基础上相关性分析。我们的评估表明,AutoSpearman在训练样本中产生了最高的度量子集一致性,并减轻了相关度量,同时影响模型性能1-2%pts。因此,为了在解释缺陷模型时自动减轻相关度量,我们建议未来的研究使用AutoSpearman代替常用的特征选择技术。
英文摘要:
The interpretation of defect models heavily relies on software metrics that are used to construct them. However, such software metrics are often correlated to defect models. Prior work often uses feature selection techniques to remove correlated metrics in order to improve the performance of defect models. Yet, the interpretation of defect models may be misleading if feature selection techniques produce subsets of inconsistent and correlated metrics. In this paper, we investigate the consistency and correlation of the subsets of metrics that are produced by nine commonly-used feature selection techniques. Through a case study of 13 publicly-available defect datasets, we find that feature selection techniques produce inconsistent subsets of metrics and do not mitigate correlated metrics, suggesting that feature selection techniques should not be used and correlation analyses must be applied when the goal is model interpretation. Since correlation analyses often involve manual selection of metrics by a domain expert, we introduce AutoSpearman, an automated metric selection approach based on correlation analyses. Our evaluation indicates that AutoSpearman yields the highest consistency of subsets of metrics among training samples and mitigates correlated metrics, while impacting model performance by 1-2%pts. Thus, to automatically mitigate correlated metrics when interpreting defect models, we recommend future studies use AutoSpearman in lieu of commonly-used feature selection techniques.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。