arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.07910cs.LG
收藏

边际贡献特征重要性--自然情况下的公理化方法

Marginal Contribution Feature Importance -- an Axiomatic Approach for The Natural Case

Tel-Aviv University(特拉维夫大学);University of California, Los Angeles(加州大学洛杉矶分校)

Amnon Catav, Boyang Fu, Jason Ernst, Sriram Sankararaman, Ran Gilad-Bachrach

摘要:

在对医疗数据训练预测模型时,目标有时是获得对某种疾病的见解。在这种情况下,通常使用特征重要性作为工具来突出导致该疾病的重要因素。由于有许多计算特征重要性分数的现有方法,因此理解它们的相对优点并不容易。此外,使用它们的场景的多样性导致对特征重要性分数的不同期望。虽然通常区分关注个体预测的局部分数和关注特征对模型的贡献的全局分数,但另一个重要的划分区分了模型场景,其中目标是理解给定模型的预测和自然场景,其中目标是理解疾病等现象。我们开发了一组公理,表示期望从一个功能的重要性函数在自然场景中的属性,并证明,只存在一个功能,满足所有这些,边际贡献功能的重要性(MCI)。我们分析了这个函数的理论和经验性质,并将其与其他特征重要性分数进行了比较。虽然我们的重点是自然的情况下,我们建议,我们的公理化的方法也可以在其他情况下进行。

英文摘要:

When training a predictive model over medical data, the goal is sometimes to gain insights about a certain disease. In such cases, it is common to use feature importance as a tool to highlight significant factors contributing to that disease. As there are many existing methods for computing feature importance scores, understanding their relative merits is not trivial. Further, the diversity of scenarios in which they are used lead to different expectations from the feature importance scores. While it is common to make the distinction between local scores that focus on individual predictions and global scores that look at the contribution of a feature to the model, another important division distinguishes model scenarios, in which the goal is to understand predictions of a given model from natural scenarios, in which the goal is to understand a phenomenon such as a disease. We develop a set of axioms that represent the properties expected from a feature importance function in the natural scenario and prove that there exists only one function that satisfies all of them, the Marginal Contribution Feature Importance (MCI). We analyze this function for its theoretical and empirical properties and compare it to other feature importance scores. While our focus is the natural scenario, we suggest that our axiomatic approach could be carried out in other scenarios too.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑