arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.03047stat.MLcs.LG
收藏

混合数据的条件特征重要性

Conditional Feature Importance for Mixed Data

Leibniz Institute for Prevention Research & Epidemiology – BIPS(莱布尼茨预防研究与流行病学研究所——BIPS);University of Bremen(不来梅大学);King’s College London(伦敦国王学院);University of Copenhagen(哥本哈根大学)

Kristin Blesch, David S. Watson, Marvin N. Wright

AI总结:

针对现有条件特征重要性度量难以处理含复杂依赖的混合数据的问题,提出结合CPI框架与序贯knockoff采样的方法,可控制I类错误且效能高,验证了混合数据专用统计方法的必要性。

摘要:

尽管特征重要性(FI)度量在可解释机器学习中应用广泛,但这些方法的统计充分性却鲜少被讨论。从统计学视角来看,一个核心区别在于分析变量重要性时是否对协变量进行校正——即**边际**度量与**条件**度量的差异。本研究关注这一鲜少被提及却至关重要的区别,并展示了其实际影响。\n此外我们发现,可用于条件FI检验的方法极少,且由于数据需求不匹配,从业者在方法应用上长期受到严重限制。大多数真实世界数据存在复杂的特征依赖关系,同时包含连续型和分类型数据(即混合数据),而这两个特性往往被现有条件FI度量方法所忽略。\n为填补这一空白,我们提出将条件预测影响(CPI,conditional predictive impact)框架与序贯knockoff采样相结合。CPI框架通过为待分析数据采样有效knockoff(即生成具有相似统计特性的合成数据),能够在控制任意特征依赖关系的前提下测量条件FI。序贯knockoff方法专为处理混合数据设计,因此可将CPI方法扩展至此类数据集。\n我们通过大量模拟实验和一个真实案例验证了所提工作流:它能控制I类错误,具备高检验效能,结果与其他条件FI度量方法一致;而边际FI指标则会产生误导性解读。研究结果表明,有必要为混合数据开发统计上充分的专用方法。

英文摘要:

Despite the popularity of feature importance (FI) measures in interpretable machine learning, the statistical adequacy of these methods is rarely discussed. From a statistical perspective, a major distinction is between analyzing a variable's importance before and after adjusting for covariates - i.e., between $\textit{marginal}$ and $\textit{conditional}$ measures. Our work draws attention to this rarely acknowledged, yet crucial distinction and showcases its implications. Further, we reveal that for testing conditional FI, only few methods are available and practitioners have hitherto been severely restricted in method application due to mismatching data requirements. Most real-world data exhibits complex feature dependencies and incorporates both continuous and categorical data (mixed data). Both properties are oftentimes neglected by conditional FI measures. To fill this gap, we propose to combine the conditional predictive impact (CPI) framework with sequential knockoff sampling. The CPI enables conditional FI measurement that controls for any feature dependencies by sampling valid knockoffs - hence, generating synthetic data with similar statistical properties - for the data to be analyzed. Sequential knockoffs were deliberately designed to handle mixed data and thus allow us to extend the CPI approach to such datasets. We demonstrate through numerous simulations and a real-world example that our proposed workflow controls type I error, achieves high power and is in line with results given by other conditional FI measures, whereas marginal FI metrics result in misleading interpretations. Our findings highlight the necessity of developing statistically adequate, specialized methods for mixed data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑