Measuring Variable Importance in Heterogeneous Treatment Effects with Confidence
Roche Pharma Research \& Early Development, Roche Innovation Center Basel, F. Hoffmann-La Roche Ltd, Basel, Switzerland;Université Paris-Saclay, Inria, CEA, Palaiseau, France
Joseph Paillard, Angel Reyero Lobo, Vitaliy Kolodyazhniy, Bertrand Thirion, Denis A. Engemann
Causal machine learning holds promise for estimating individual treatment effects from complex data. For successful real-world applications of machine learning methods, it is of paramount importance to obtain reliable insights into which variables drive heterogeneity in the response to treatment. We propose PermuCATE, an algorithm based on the Conditional Permutation Importance (CPI) method, for statistically rigorous global variable importance assessment in the estimation of the Conditional Average Treatment Effect (CATE). Theoretical analysis of the finite sample regime and empirical studies show that PermuCATE has lower variance than the Leave-One-Covariate-Out (LOCO) reference method and provides a reliable measure of variable importance. This property increases statistical power, which is crucial for causal inference in the limited-data regime common to biomedical applications. We empirically demonstrate the benefits of PermuCATE in simulated and real-world health datasets, including settings with up to hundreds of correlated variables.
Identifying Heterogeneous Treatment Effects in Multiple Outcomes using Joint Confidence Intervals
Harvard John A. Paulson School of Engineering and Applied Sciences(哈佛大学约翰·A·保尔森工程与应用科学学院);Massachusetts Institute of Technology(麻省理工学院);Harvard Medical School(哈佛医学院)
Beijing University of Posts and Telecommunications(北京邮电大学);ByteDance(字节跳动);USTC(中国科学技术大学);Beijing Key Laboratory of Network System and Network Culture(北京网络系统与网络文化重点实验室);Key Laboratory of Interactive Technology and Experience System, Ministry of Culture and Tourism(文化和旅游部互动技术与体验系统重点实验室);Zhongguancun Academy(中关村科学城)
Robust Recursive Partitioning for Heterogeneous Treatment Effects with Uncertainty Quantification
Sejong University(世宗大学);University of Cambridge(剑桥大学);UCLA(加州大学洛杉矶分校);University of Virginia(弗吉尼亚大学);Yonsei University(延世大学);The Alan Turing Institute(艾伦·图灵研究所)