arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.01408stat.MEstat.ML
收藏

基于共形p值的选择预测方法

Selection by Prediction with Conformal p-values

Ying Jin, Emmanuel J. Candès

AI总结:

本文提出一种基于共形推断的筛选方法,通过构造p值并与多重检验阈值比较,在控制错误选择比例的同时从候选池中选出结果超过指定值的候选者,并应用于招聘和药物发现。

摘要:

诸如招聘和药物发现等决策或科学发现流程通常涉及多个阶段:在任何资源密集型步骤之前,往往存在一个初始筛选环节,利用机器学习模型的预测从大量候选者中筛选出少数候选者。我们研究旨在选择那些未观测结果超过用户指定值的候选者的筛选程序。我们开发了一种方法,该方法可包裹任何预测模型,在控制被错误选择的单元比例的同时,产生一个候选者子集。基于共形推断框架,我们的方法首先构建p值,用于量化出现较大结果的统计证据;然后通过将p值与多重检验文献中引入的阈值进行比较来确定候选名单。在许多情况下,该程序选择的候选者其预测值高于一个依赖于数据的阈值。我们的理论保证在样本满足温和的可交换性条件下成立,推广了关于多重共形p值的现有结果。我们通过模拟实验展示了该方法的经验性能,并将其应用于招聘和药物发现数据集。

英文摘要:

Decision making or scientific discovery pipelines such as job hiring and drug discovery often involve multiple stages: before any resource-intensive step, there is often an initial screening that uses predictions from a machine learning model to shortlist a few candidates from a large pool. We study screening procedures that aim to select candidates whose unobserved outcomes exceed user-specified values. We develop a method that wraps around any prediction model to produce a subset of candidates while controlling the proportion of falsely selected units. Building upon the conformal inference framework, our method first constructs p-values that quantify the statistical evidence for large outcomes; it then determines the shortlist by comparing the p-values to a threshold introduced in the multiple testing literature. In many cases, the procedure selects candidates whose predictions are above a data-dependent threshold. Our theoretical guarantee holds under mild exchangeability conditions on the samples, generalizing existing results on multiple conformal p-values. We demonstrate the empirical performance of our method via simulations, and apply it to job hiring and drug discovery datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑