arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.05501stat.MLcs.LG
收藏

使用特征重要性融合实现安全关键系统的机器学习输出的更可靠解释

Towards a More Reliable Interpretation of Machine Learning Outputs for Safety-Critical Systems using Feature Importance Fusion

The University of Nottingham(诺丁汉大学)

Divish Rengasamy, Benjamin Rothwell, Grazziela Figueredo

摘要:

当机器学习支持安全关键系统中的决策时,验证和理解产生特定输出的原因非常重要。虽然特征重要性计算方法有助于解释,但关于如何量化特征的重要性缺乏共识,这使得为结果提供的解释大多不可靠。解决缺乏一致性的一个可能的解决方案是组合来自多个特征重要性量化器的结果以减少估计的方差。我们的假设是,这将导致对每个特征对机器学习预测的贡献的更强大和更可信的解释。为了帮助测试这一假设,我们提出了一个可扩展的框架分为四个主要部分:(i)传统的数据预处理和准备预测机器学习模型;(ii)预测机器学习;(iii)特征重要性量化和(iv)使用集成策略的特征重要性决策融合。我们还引入了一种新的融合度量,并将其与最先进的融合度量进行比较。我们的方法在已知地面真实情况的合成数据上进行了测试。我们比较不同的融合方法和他们的训练和测试集的结果。我们还研究了数据集内的不同特征如何影响所研究的特征重要性集成。结果表明,与现有方法相比,我们的特征重要性集成框架总体上减少了15%的特征重要性误差。此外,结果表明,数据集中的不同水平的噪声不影响特征重要性集成的能力,准确地量化特征重要性,而特征重要性量化误差增加的特征的数量和正交信息特征的数量。

英文摘要:

When machine learning supports decision-making in safety-critical systems, it is important to verify and understand the reasons why a particular output is produced. Although feature importance calculation approaches assist in interpretation, there is a lack of consensus regarding how features' importance is quantified, which makes the explanations offered for the outcomes mostly unreliable. A possible solution to address the lack of agreement is to combine the results from multiple feature importance quantifiers to reduce the variance of estimates. Our hypothesis is that this will lead to more robust and trustworthy interpretations of the contribution of each feature to machine learning predictions. To assist test this hypothesis, we propose an extensible Framework divided in four main parts: (i) traditional data pre-processing and preparation for predictive machine learning models; (ii) predictive machine learning; (iii) feature importance quantification and (iv) feature importance decision fusion using an ensemble strategy. We also introduce a novel fusion metric and compare it to the state-of-the-art. Our approach is tested on synthetic data, where the ground truth is known. We compare different fusion approaches and their results for both training and test sets. We also investigate how different characteristics within the datasets affect the feature importance ensembles studied. Results show that our feature importance ensemble Framework overall produces 15% less feature importance error compared to existing methods. Additionally, results reveal that different levels of noise in the datasets do not affect the feature importance ensembles' ability to accurately quantify feature importance, whereas the feature importance quantification error increases with the number of features and number of orthogonal informative features.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑