arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.09291stat.MEmath.STstat.APstat.TH
收藏

通过加权保序p值实现协变量偏移下的无模型选择性推断

Model-free selective inference under covariate shift via weighted conformal p-values

Ying Jin, Emmanuel J. Candès

AI总结:

针对协变量偏移下无需建模假设的选择性推断问题,提出加权保序p值与WCS过程,在有限样本中控制FDR,并支持处理效应推断和异常值检测。

摘要:

本文介绍了用于无模型选择性推断的新型加权保序p值和方法。所研究的问题如下:给定具有协变量X和缺失响应Y的测试单元,如何选择那些响应Y大于用户指定值的单元,同时控制假阳性的比例?我们能否在不对数据作任何建模假设、也不对预测响应的模型施加任何限制的情况下实现这一点?最后,方法应当适用于训练数据与测试数据之间存在协变量偏移的情形,而这种情况在实践中经常出现。我们通过首先利用任意预测模型来产生一类经过良好校准的加权保序p值,从而回答这些问题;这些p值能够控制检测大响应时的I类错误。这些p值不能直接传入经典的多重检验过程,因为它们可能不满足一个众所周知的正相关性性质。因此,我们提出加权保序选择(WCS),这是一种在有限样本中控制错误发现率(FDR)的新过程。除了预测辅助的候选选择外,WCS还(1)允许推断多个个体处理效应,并且(2)扩展到具有内点分布偏移的异常值检测。我们通过模拟以及在因果推断、药物发现和异常值检测数据集上的应用展示了其性能。

英文摘要:

This paper introduces novel weighted conformal p-values and methods for model-free selective inference. The problem is as follows: given test units with covariates $X$ and missing responses $Y$, how do we select units for which the responses $Y$ are larger than user-specified values while controlling the proportion of false positives? Can we achieve this without any modeling assumptions on the data and without any restriction on the model for predicting the responses? Last, methods should be applicable when there is a covariate shift between training and test data, which commonly occurs in practice. We answer these questions by first leveraging any prediction model to produce a class of well-calibrated weighted conformal p-values, which control the type-I error in detecting a large response. These p-values cannot be passed on to classical multiple testing procedures since they may not obey a well-known positive dependence property. Hence, we introduce weighted conformalized selection (WCS), a new procedure which controls false discovery rate (FDR) in finite samples. Besides prediction-assisted candidate selection, WCS (1) allows to infer multiple individual treatment effects, and (2) extends to outlier detection with inlier distributions shifts. We demonstrate performance via simulations and applications to causal inference, drug discovery, and outlier detection datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑