The optimal learner for prediction modeling varies depending on the underlying data-generating distribution. Super Learner (SL) is a generic ensemble learning algorithm that uses cross-validation to select among a "library" of candidate prediction models. The SL is not restricted to a single prediction model, but uses the strengths of a variety of learning algorithms to adapt to different databases. While the SL has been shown to perform well in a number of settings, it has not been thoroughly evaluated in large electronic healthcare databases that are common in pharmacoepidemiology and comparative effectiveness research. In this study, we applied and evaluated the performance of the SL in its ability to predict treatment assignment using three electronic healthcare databases. We considered a library of algorithms that consisted of both nonparametric and parametric models. We also considered a novel strategy for prediction modeling that combines the SL with the high-dimensional propensity score (hdPS) variable selection algorithm. Predictive performance was assessed using three metrics: the negative log-likelihood, area under the curve (AUC), and time complexity. Results showed that the best individual algorithm, in terms of predictive performance, varied across datasets. The SL was able to adapt to the given dataset and optimize predictive performance relative to any individual learner. Combining the SL with the hdPS was the most consistent prediction method and may be promising for PS estimation and prediction modeling in electronic healthcare databases.
Conformal Convolution and Monte Carlo Meta-learners for Predictive Inference of Individual Treatment Effects
IDLab Department of Electronics and Information Systems Ghent University, Belgium(IDLab电子与信息系统系根特大学,比利时);IDLab Department of Electronics and Information Systems Ghent University - imec, Belgium(IDLab电子与信息系统系根特大学-imec,比利时);Biometrics Research Group Department of Morphology, Imaging, Orthopedics, Rehabilitation and Nutrition Ghent University, Belgium(生物医学研究组形态学、成像、骨科、康复与营养系根特大学,比利时)
Benign-Overfitting in Conditional Average Treatment Effect Prediction with Linear Regression
The University of Tokyo(东京大学);CyberAgent, Inc.(CyberAgent公司)
我们研究了良性过拟合理论在预测条件平均处理效应(CATE)中的应用,并建立了线性回归模型。随着因果推断的机器学习的发展,大范围的因果关系模型越来越受到关注。一个问题是,已经提出了怀疑,大规模的模型是倾向于过度拟合的样本选择的观察,因此,大型模型可能不适合因果预测。在这项研究中,为了解决可疑问题,我们通过应用最近的良性过拟合理论(Bartlett et al.,2020年)。具体来说,我们认为样本的分布开关取决于分配规则,并研究预测CATE的线性模型,其尺寸发散到无穷大。我们专注于两种方法:T-学习器,其基于每个治疗组的单独构造的估计量之间的差异,以及逆概率权重(IPW)-学习器,其解决由倾向分数近似的另一回归问题。在这两种方法中,估计器由完全拟合样本的插值器组成。结果表明,T-学习者除了随机分配外,无法实现一致性,而IPW-学习者在倾向分数已知的情况下,将风险收敛到零。这种差异源于T学习器无法保持协方差的特征空间,这对于过参数化设置中的良性过拟合是必要的。我们的结果提供了新的见解因果推断方法的使用在overparameterizated设置,特别是,双稳健估计。
Martingale R-learner: Estimating Time-varying Heterogeneous Treatment Effects for Time-to-event Outcomes
Division of Biostatistics and Health Data Science, School of Public Health, University of Minnesota(明尼苏达大学公共卫生学院生物统计与健康数据科学部);Biostatistics and Bioinformatics, Herbert Wertheim School of Public Health and Human Longevity Science, University of California, San Diego(加州大学圣地亚哥分校赫伯特·韦尔特海姆公共卫生与人类长寿科学学院生物统计与生物信息学);Biostatistics and Bioinformatics, Herbert Wertheim School of Public Health and Human Longevity Science, & Department of Mathematics, & Halicioglu Data Science Institute University of California, San Diego(加州大学圣地亚哥分校赫伯特·韦尔特海姆公共卫生与人类长寿科学学院生物统计与生物信息学、数学系及哈利奥格鲁数据科学研究所)
Calibration Strategies for Robust Causal Estimation: Theoretical and Empirical Insights on Propensity Score-Based Estimators
Economic AI, Nürnberger Str. 262 A, 93059 Regensburg, Bayern, Germany(经济人工智能,德国雷根施塔特);Chair of Statistics with Application in Business Analytics, University of Hamburg Business School, Moorweidenstr. 18, 20148 Hamburg, Hamburg, Germany(商务分析统计学系,汉堡大学商业学院);Chair of Mathematics and Statistics in Economics, University of Hamburg Business School, Von-Melle-Park 5, 20146 Hamburg, Hamburg, Germany(经济学数学与统计学系,汉堡大学商业学院);Düsseldorf Institute for Competition Economics, Heinrich Heine University Düsseldorf, Universitätstr. 1, 20225 Düsseldorf, Nordrhein-Westphalen, Germany(多特蒙德竞争经济学研究所,杜伊斯堡-艾森大学)
Multi-Study R-Learner for Estimating Heterogeneous Treatment Effects Across Studies Using Statistical Machine Learning
Vanderbilt University Medical Center(范德堡大学医学中心);McLean Hospital(麦克林医院);Boston University School of Public Health(波士顿大学公共卫生学院);Dana-Farber Cancer Institute(达纳-法伯癌症研究所)
Undersmoothed LASSO Models for Propensity Score Weighting and Synthetic Negative Control Exposures for Bias Detection
Brigham and Women’s Hospital, Harvard Medical School(Brigham and Women's Hospital, 哈佛医学院);University of Michigan(密歇根大学);University of Washington(华盛顿大学);Massachusetts General Hospital, Harvard Medical School(Massachusetts General Hospital, 哈佛医学院)