arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2611.06158cs.LG
收藏

选择性预测区间:联合学习预测、边界与弃权

Selective Prediction Intervals: Jointly Learning to Predict, Bound, and Abstain

Ben-Gurion University of the Negev(内盖夫本-古里安大学);Faculty of Computer and Information Science(计算机与信息科学学院)

Lidor Rubi, Gilad Katz

AI总结:

提出SelPI模型,联合训练区间、值与弃权头,通过双门控结合Fréchet惩罚,在18个表格基准上优于宽度阈值及深度集成分歧选择方法,缩小与最优选择器的差距。

摘要:

许多高风险回归决策同时要求模型完成三项任务:用于决策的点估计、界定决策风险的区间,以及在两者均不可信时的弃权(不执行)选项。深度学习单独提供这些功能:预测区间方法为每个输入返回一个区间,且最多返回区间内的一个值估计;而选择性预测方法学习何时弃权,但仅针对点预测,且未说明真实值与估计值的偏差范围。我们提出SelPI,它在单一损失函数下联合训练区间头、值头和弃权头,并设置明确的接受率预算。一个自然的反对观点是区间宽度本身就能判断何时弃权。我们证明事实并非如此:在18个表格基准测试中,宽度能较好预测大的点误差(AUROC为0.72),但与区间漏检呈负相关(AUROC为0.38),因此对宽区间弃权会恰好丢弃区间预测正确的输入。SelPI因此采用两个门控机制进行选择,一个基于区间损失训练,另一个基于值损失训练,通过Fréchet惩罚将它们各自的预算与联合接受率绑定。在基础预测器固定的情况下,学习到的门控在18个表格数据集上的合适区间得分均优于宽度阈值法,中位数缩小了与最优选择器差距的87%,且在所有数据集上均优于深度集成分歧的选择方法。该优势随任务的异方差性增强而增大,我们也报告了其优势消失的设置。

英文摘要:

Many high-stakes regression decisions ask three things of a model at once: a point estimate to act on, an interval that bounds the risk of acting, and the option to abstain when neither can be trusted. Deep learning provides these in isolation: prediction-interval methods return an interval, and at best a value estimate inside it, for every input, while selective-prediction methods learn when to abstain, but only for point predictions and with no statement of how far the truth may lie from the estimate. We introduce SelPI, which trains interval, value and abstention heads jointly under a single loss with an explicit acceptance-rate budget. A natural objection is that interval width already tells us when to abstain. We show that it does not: across 18 tabular benchmarks, width predicts large point errors well (AUROC 0.72) but is anti-correlated with interval misses (AUROC 0.38), so abstaining on wide intervals discards precisely the inputs the interval got right. SelPI therefore selects with two gates, one trained on the interval loss and one on the value loss, coupled by a Fr'echet penalty that ties their separate budgets to the joint acceptance rate they deliver. With the base predictor held fixed, the learned gate beats width thresholding on a proper interval score on all 18 tabular datasets, closing a median 87% of the gap to an oracle selector, and it also beats selection by deep-ensemble disagreement on every dataset. The advantage grows with the heteroscedasticity of the task, and we report the settings in which it disappears.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑