arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.05405cs.LG
收藏

利用特权信息的鲁棒保形预测

Robust Conformal Prediction Using Privileged Information

Technion(以色列理工学院)

Shai Feldman, Yaniv Romano

AI总结:

针对训练数据损坏导致的分布偏移,本文提出利用仅训练期可用的特权信息,推广加权保形预测以获得有理论覆盖率保证且更具信息量的预测集。

摘要:

我们开发了一种生成具有保证覆盖率的预测集的方法,该方法对训练数据中的损坏(例如变量缺失或含噪)具有鲁棒性。我们的方法建立在保形预测(conformal prediction)之上,后者是一个在独立同分布(i.i.d.)假设下构造有效预测集的强大框架。重要的是,由于这些损坏引发的分布偏移,在这种情形下朴素地应用保形预测无法提供可靠的预测。为应对该分布偏移,我们假设可以获得特权信息(PI)。PI 被表述为解释分布偏移的附加特征,但它们仅在训练期间可用,在测试时不存在。我们通过引入加权保形预测的一种新颖推广来解决该问题,并以理论覆盖率保证支撑我们的方法。在真实数据集和合成数据集上的实证实验表明,与缺乏理论保证支持的现有方法相比,我们的方法实现了有效覆盖率,并构造了信息量更高的预测。

英文摘要:

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to construct prediction sets that are valid under the i.i.d assumption. Importantly, naively applying conformal prediction does not provide reliable predictions in this setting, due to the distribution shift induced by the corruptions. To account for the distribution shift, we assume access to privileged information (PI). The PI is formulated as additional features that explain the distribution shift, however, they are only available during training and absent at test time. We approach this problem by introducing a novel generalization of weighted conformal prediction and support our method with theoretical coverage guarantees. Empirical experiments on both real and synthetic datasets indicate that our approach achieves a valid coverage rate and constructs more informative predictions compared to existing methods, which are not supported by theoretical guarantees.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑