arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.07973stat.MEmath.OCstat.APstat.ML
收藏

使用通用机器学习进行子组识别的统计性能保证

Statistical Performance Guarantee for Subgroup Identification with Generic Machine Learning

Michael Lingzhi Li, Kosuke Imai

AI总结:

针对机器学习识别治疗受益或受害子组时的偏差、噪声与多重检验问题,本文提出无需建模假设和重抽样的 GATES 统一置信带,并通过模拟和前列腺癌临床试验验证其有效性。

摘要:

在众多学科中,许多研究人员使用机器学习(ML)算法来识别最可能从某种治疗中获益的个体子组(“异常应答者”),或受到该治疗伤害的个体子组。解决这一子组识别问题的常用方法包括两个步骤。首先,研究人员使用一种 ML 算法估计条件平均处理效应(CATE)。接着,他们利用估计的 CATE 选择那些被预测为受治疗影响最大的个体,无论这种影响是正面还是负面。遗憾的是,CATE 估计往往存在偏差且含有噪声。此外,利用相同数据既识别子组又估计其组平均处理效应,会导致多重检验问题。为应对这些挑战,我们开发了用于估计按通用 ML 算法排序的组平均处理效应(GATES)的统一置信带。借助这些统一置信带,研究人员能够在具有统计保证的情况下识别出 GATES 超过某一效应量的子组,而无论该效应量是如何选择的。所提方法的有效性仅依赖于治疗的随机化和单元的随机抽样。重要的是,我们的方法不需要建模假设,并且避免了计算密集型的重抽样过程。模拟研究表明,即使样本量小至 100,所提出的统一置信带也具有合理的信息量,并具备适当的经验覆盖率。我们分析了一项晚期前列腺癌临床试验,发现其中异常应答者占相对较大的比例。

英文摘要:

Across a wide array of disciplines, many researchers use machine learning (ML) algorithms to identify a subgroup of individuals who are likely to benefit from a treatment the most (``exceptional responders'') or those who are harmed by it. A common approach to this subgroup identification problem consists of two steps. First, researchers estimate the conditional average treatment effect (CATE) using an ML algorithm. Next, they use the estimated CATE to select those individuals who are predicted to be most affected by the treatment, either positively or negatively. Unfortunately, CATE estimates are often biased and noisy. In addition, utilizing the same data to both identify a subgroup and estimate its group average treatment effect results in a multiple testing problem. To address these challenges, we develop uniform confidence bands for estimation of the group average treatment effect sorted by generic ML algorithm (GATES). Using these uniform confidence bands, researchers can identify, with a statistical guarantee, a subgroup whose GATES exceeds a certain effect size, regardless of how this effect size is chosen. The validity of the proposed methodology depends solely on randomization of treatment and random sampling of units. Importantly, our method does not require modeling assumptions and avoids a computationally intensive resampling procedure. A simulation study shows that the proposed uniform confidence bands are reasonably informative and have an appropriate empirical coverage even when the sample size is as small as 100. We analyze a clinical trial of late-stage prostate cancer and find a relatively large proportion of exceptional responders.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑