arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.10332stat.MEstat.ML
收藏

广义的预测驱动推断,应用于二元分类器评估

Generalized Prediction-Powered Inference, with Application to Binary Classifier Evaluation

University of Washington(华盛顿大学);Kaiser Permanente Washington Health Research Institute(凯撒永久华盛顿健康研究所);Fred Hutchinson Cancer Center(弗雷德·哈钦森癌症中心)

Runjia Zou, Daniela Witten, Brian Williamson

AI总结:

本文提出广义的预测驱动推断方法,用于二元分类器评估,通过处理协变量分布偏移问题,提供计算简便的估计量。

摘要:

在部分观察结果的设定下,最近出现的一系列称为“预测驱动推断”(PPI)的提案涉及(i)应用一个预训练的机器学习模型来预测响应,然后(ii)利用这些预测来获得参数估计量,其渐近方差不超过仅使用标注观测值所获得的方差。尽管现有的PPI提案考虑的是来自M估计的估计量,但本文将PPI推广到任何正则的渐近线性估计量。此外,通过将PPI置于现有的关于缺失数据和半参数效率理论的丰富文献背景下,我们表明,尽管PPI在非常严格和不现实的场景外无法达到半参数效率下限,但它可以被视为该文献中提案的一种计算简便的替代方法。我们利用与该文献的联系,提出修改后的PPI估计量,能够处理三种不同的协变量分布偏移形式。最后,我们通过数值研究构建PPI估计量,以估计真正的阳性率、假阳性率和曲线下面积。

英文摘要:

In the partially-observed outcome setting, a recent set of proposals known as "prediction-powered inference" (PPI) involve (i) applying a pre-trained machine learning model to predict the response, and then (ii) using these predictions to obtain an estimator of the parameter of interest with asymptotic variance no greater than that which would be obtained using only the labeled observations. While existing PPI proposals consider estimators arising from M-estimation, in this paper we generalize PPI to any regular asymptotically linear estimator. Furthermore, by situating PPI within the context of an existing rich literature on missing data and semi-parametric efficiency theory, we show that while PPI does not achieve the semi-parametric efficiency lower bound outside of very restrictive and unrealistic scenarios, it can be viewed as a computationally-simple alternative to proposals in that literature. We exploit connections to that literature to propose modified PPI estimators that can handle three distinct forms of covariate distribution shift. Finally, we illustrate these developments by constructing PPI estimators of true positive rate, false positive rate, and area under the curve via numerical studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑