arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2007.08283stat.MLcs.LG
收藏

相对特征重要性

Relative Feature Importance

LMU Munich(慕尼黑大学);University of Vienna(维也纳大学)

Gunnar König, Christoph Molnar, Bernd Bischl, Moritz Grosse-Wentrup

摘要:

可解释的机器学习(IML)方法用于深入了解感兴趣特征与模型性能的相关性。常用的IML方法的不同之处在于它们是否孤立地考虑感兴趣的特征,例如,置换特征重要性(PFI),或者与所有剩余的特征变量相关,例如,条件特征重要性(CFI)。因此,PFI和CFI固有的扰动机制代表了极端的参考点。我们引入了相对特征重要性(RFI),PFI和CFI的推广,允许一个更细致入微的特征重要性计算超出PFI与CFI二分法。使用RFI,可以评估特征相对于任何其他特征子集的重要性,包括在训练时不可用的变量。我们推导出一般的解释规则RFI的基础上,详细的理论分析的影响,相对功能的相关性,并证明了该方法的实用性模拟的例子。

英文摘要:

Interpretable Machine Learning (IML) methods are used to gain insight into the relevance of a feature of interest for the performance of a model. Commonly used IML methods differ in whether they consider features of interest in isolation, e.g., Permutation Feature Importance (PFI), or in relation to all remaining feature variables, e.g., Conditional Feature Importance (CFI). As such, the perturbation mechanisms inherent to PFI and CFI represent extreme reference points. We introduce Relative Feature Importance (RFI), a generalization of PFI and CFI that allows for a more nuanced feature importance computation beyond the PFI versus CFI dichotomy. With RFI, the importance of a feature relative to any other subset of features can be assessed, including variables that were not available at training time. We derive general interpretation rules for RFI based on a detailed theoretical analysis of the implications of relative feature relevance, and demonstrate the method's usefulness on simulated examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑