arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.04750cs.LGstat.ML
收藏

非参数特征的影响和重要性

Nonparametric Feature Impact and Importance

University of San Francisco(旧金山大学)

Terence Parr, James D. Wilson, Jeff Hamrick

摘要:

从业者在模型开发过程中使用特征重要性来排名和消除弱预测因子,以简化模型并提高通用性。不幸的是,他们还经常将这些特征重要性度量与特征影响混为一谈,特征影响是解释变量对响应变量的孤立影响。当重要性被不恰当地解释为对业务或医疗洞察目的的影响时,这可能导致现实世界的后果。用于计算重要性的主要方法是通过询问拟合模型,该拟合模型对于特征选择很有效,但是给出了特征影响的失真度量。应用于相同数据集的相同方法可以产生不同的特征重要性,具体取决于模型,这使我们得出结论,应该直接从数据中计算影响。虽然存在非参数特征选择算法,但它们通常提供特征排名,而不是影响或重要性的度量。它们通常也关注与响应的单变量关联。在本文中,我们给出了数学定义的功能的影响和重要性,来自部分依赖曲线,直接对数据进行操作。为了评估质量,我们表明,这些定义的功能排名与现有的特征选择技术,使用三个真实的数据集的预测任务是有竞争力的。

英文摘要:

Practitioners use feature importance to rank and eliminate weak predictors during model development in an effort to simplify models and improve generality. Unfortunately, they also routinely conflate such feature importance measures with feature impact, the isolated effect of an explanatory variable on the response variable. This can lead to real-world consequences when importance is inappropriately interpreted as impact for business or medical insight purposes. The dominant approach for computing importances is through interrogation of a fitted model, which works well for feature selection, but gives distorted measures of feature impact. The same method applied to the same data set can yield different feature importances, depending on the model, leading us to conclude that impact should be computed directly from the data. While there are nonparametric feature selection algorithms, they typically provide feature rankings, rather than measures of impact or importance. They also typically focus on single-variable associations with the response. In this paper, we give mathematical definitions of feature impact and importance, derived from partial dependence curves, that operate directly on the data. To assess quality, we show that features ranked by these definitions are competitive with existing feature selection techniques using three real data sets for predictive tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑