变量重要性云:一种探索好模型集变量重要性的方法
Variable Importance Clouds: A Way to Explore Variable Importance for the Set of Good Models
摘要:
变量重要性是科学研究的核心,包括社会科学和因果推断,医疗保健和其他领域。然而,当前变量重要性的概念通常与特定的预测模型相关联。这是有问题的:如果有多个表现良好的预测模型,并且某个特定变量对其中一些模型很重要,而对另一些模型不重要,那会怎么样?在这种情况下,我们可能无法从一个表现良好的模型中判断一个变量在预测结果时是否总是重要的。与其依赖于单个预测模型的变量重要性,我们希望探索所有近似相等准确的预测模型的变量重要性。这项工作引入了变量重要性云的概念,它将每个变量映射到每个良好预测模型的重要性。我们展示了变量重要性云的属性,并绘制了与其他统计领域的连接。我们引入可变重要性图作为可变重要性云到两个维度的投影,用于可视化目的。刑事司法、营销数据和图像分类任务的实验说明了变量如何在近似相等准确的预测模型中显著改变重要性
英文摘要:
Variable importance is central to scientific studies, including the social sciences and causal inference, healthcare, and other domains. However, current notions of variable importance are often tied to a specific predictive model. This is problematic: what if there were multiple well-performing predictive models, and a specific variable is important to some of them and not to others? In that case, we may not be able to tell from a single well-performing model whether a variable is always important in predicting the outcome. Rather than depending on variable importance for a single predictive model, we would like to explore variable importance for all approximately-equally-accurate predictive models. This work introduces the concept of a variable importance cloud, which maps every variable to its importance for every good predictive model. We show properties of the variable importance cloud and draw connections to other areas of statistics. We introduce variable importance diagrams as a projection of the variable importance cloud into two dimensions for visualization purposes. Experiments with criminal justice, marketing data, and image classification tasks illustrate how variables can change dramatically in importance for approximately-equally-accurate predictive models
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。