arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.07765cs.LG
收藏

可变重要性评分

Variable importance scores

University of Wisconsin(威斯康星大学)

Wei-Yin Loh, Peigen Zhou

摘要:

对预测反应的变量重要性进行评分是一个定义不清的概念。已经提出了几种方法,但对其性能知之甚少。本文填补了空白的比较评估的11种方法和更新的GUIDE算法的基础上。对于没有缺失值的数据,有八种方法被证明是有偏差的,因为它们对不同类型的变量给出了更高或更低的分数,即使所有变量都与响应无关。在其余四种方法中,只有两种方法适用于缺失值的数据,GUIDE是唯一无偏的方法。GUIDE通过使用自校准步骤实现无偏性,该步骤适用于其他评分去偏方法。GUIDE还在95%和99%的置信水平下产生区分重要和不重要变量的阈值;该技术也适用于其他方法。最后,本文在三个数据集上研究了得分与预测能力的关系。结果发现,许多方法的得分更符合边际预测能力比条件预测能力。

英文摘要:

Scoring of variables for importance in predicting a response is an ill-defined concept. Several methods have been proposed but little is known of their performance. This paper fills the gap with a comparative evaluation of eleven methods and an updated one based on the GUIDE algorithm. For data without missing values, eight of the methods are shown to be biased in that they give higher or lower scores to different types of variables, even when all are independent of the response. Of the remaining four methods, only two are applicable to data with missing values, with GUIDE the only unbiased one. GUIDE achieves unbiasedness by using a self-calibrating step that is applicable to other methods for score de-biasing. GUIDE also yields a threshold for distinguishing important from unimportant variables at 95 and 99 percent confidence levels; the technique is applicable to other methods as well. Finally, the paper studies the relationship of the scores to predictive power in three data sets. It is found that the scores of many methods are more consistent with marginal predictive power than conditional predictive power.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑