arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.02809cs.LGcs.AI
收藏

在线时间序列符合预测中的相关性感知阈值

Relevance-Aware Thresholding in Online Conformal Prediction for Time Series

EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Ales(EuroMov数字健康运动、蒙彼利埃大学、IMT矿山学院)

Théo Dupuy, Binbin Xu, Stéphane Perrey, Jacky Montmain, Abdelhak Imoussaten

AI总结:

本文提出通过引入相关性函数改进在线时间序列符合预测的阈值更新,以产生更紧的预测区间并保持覆盖有效性。

摘要:

不确定性量化在机器学习中受到广泛关注,其中符合预测(CP)在该领域占据一席之地。对于时间序列,在线符合预测(OCP)成为解决数据分布偏移问题的选项。OCP的核心思想是根据分布观察更新某些量的阈值(无论是误覆盖水平还是分位数)。评估OCP方法性能的两个关键方面是覆盖有效性和预测区间宽度最小化。最近,新的OCP方法涌现,提供长期覆盖保证并产生更具信息量的区间。然而,在阈值更新步骤中,大多数方法仅关注预测区间的有效性——即真实值是否在区间内或外——而未考虑其相关性。本文旨在利用这一被忽视的方面。具体而言,我们提出通过将二元评估(在/外)替换为更广泛的函数来增强阈值更新步骤,这些函数利用真实值量化预测区间的相关性。这种方法有助于防止阈值突变,可能产生更窄的预测区间。确实,实验结果表明,这些函数在保持覆盖有效性的同时,能够产生比现有OCP方法更紧的区间。

英文摘要:

Uncertainty quantification has received considerable interest in recent works in Machine Learning. In particular, Conformal Prediction (CP) gains ground in this field. For the case of time series, Online Conformal Prediction (OCP) becomes an option to address the problem of data distribution shift over time. Indeed, the idea of OCP is to update a threshold of some quantity (whether the miscoverage level or the quantile) based on the distribution observation. To evaluate the performance of OCP methods, two key aspects are typically considered: the coverage validity and the prediction interval width minimization. Recently, new OCP methods have emerged, offering long-run coverage guarantees and producing more informative intervals. However, during the threshold update step, most of these methods focus solely on the validity of the prediction intervals~--~that is, whether the ground truth falls inside or outside the interval~--~without accounting for their relevance. In this paper, we aim to leverage this overlooked aspect. Specifically, we propose enhancing the threshold update step by replacing the binary evaluation (inside/outside) with a broader class of functions that quantify the relevance of the prediction interval using the ground truth. This approach helps prevent abrupt threshold changes, potentially resulting in narrower prediction intervals. Indeed, experimental results on real-world datasets suggest that these functions can produce tighter intervals compared to existing OCP methods while maintaining coverage validity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑