窥视黑箱内部:用个体条件期望图可视化统计学习
Peeking Inside the Black Box: Visualizing Statistical Learning with Plots of Individual Conditional Expectation
摘要:
本文介绍了个体条件期望(ICE)图,这是一种用于可视化任何监督学习算法估计的模型的工具。经典偏相关图(PDP)有助于可视化预测响应与一个或多个特征之间的平均偏相关性。在存在大量相互作用效应的情况下,部分响应关系可能是异质的。因此,诸如PDP的平均曲线可以混淆建模关系的复杂性。因此,ICE图通过绘制预测响应与个体观测特征之间的函数关系来细化部分相关性图。具体而言,ICE图突出显示了协变量范围内拟合值的变化,表明可能存在异质性的位置和程度。除了为探索性分析提供绘图套件外,我们还在数据生成模型中包含了对添加剂结构的可视化测试。通过模拟示例和真实数据集,我们展示了ICE图如何以PDP无法的方式揭示估计模型。概述的程序可在R包ICEbox中找到。
英文摘要:
This article presents Individual Conditional Expectation (ICE) plots, a tool for visualizing the model estimated by any supervised learning algorithm. Classical partial dependence plots (PDPs) help visualize the average partial relationship between the predicted response and one or more features. In the presence of substantial interaction effects, the partial response relationship can be heterogeneous. Thus, an average curve, such as the PDP, can obfuscate the complexity of the modeled relationship. Accordingly, ICE plots refine the partial dependence plot by graphing the functional relationship between the predicted response and the feature for individual observations. Specifically, ICE plots highlight the variation in the fitted values across the range of a covariate, suggesting where and to what extent heterogeneities might exist. In addition to providing a plotting suite for exploratory analysis, we include a visual test for additive structure in the data generating model. Through simulated examples and real data sets, we demonstrate how ICE plots can shed light on estimated models in ways PDPs cannot. Procedures outlined are available in the R package ICEbox.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。