Uncertainty quantification has received considerable interest in recent works in Machine Learning. In particular, Conformal Prediction (CP) gains ground in this field. For the case of time series, Online Conformal Prediction (OCP) becomes an option to address the problem of data distribution shift over time. Indeed, the idea of OCP is to update a threshold of some quantity (whether the miscoverage level or the quantile) based on the distribution observation. To evaluate the performance of OCP methods, two key aspects are typically considered: the coverage validity and the prediction interval width minimization. Recently, new OCP methods have emerged, offering long-run coverage guarantees and producing more informative intervals. However, during the threshold update step, most of these methods focus solely on the validity of the prediction intervals~--~that is, whether the ground truth falls inside or outside the interval~--~without accounting for their relevance. In this paper, we aim to leverage this overlooked aspect. Specifically, we propose enhancing the threshold update step by replacing the binary evaluation (inside/outside) with a broader class of functions that quantify the relevance of the prediction interval using the ground truth. This approach helps prevent abrupt threshold changes, potentially resulting in narrower prediction intervals. Indeed, experimental results on real-world datasets suggest that these functions can produce tighter intervals compared to existing OCP methods while maintaining coverage validity.
JAPAN: Joint Adaptive Prediction Areas with Normalising-Flows
Hasso Plattner Institute for Digital Engineering(霍普斯·普兰特研究所数字工程院);University of Tokyo(东京大学);Hasso Plattner Institute for Digital Health at the Icahn School of Medicine at Mount Sinai(霍普斯·普兰特研究所数字健康院)
Reliable Statistical Guarantees for Conformal Predictors with Small Datasets
ETSIAE-UPM - School of Aeronautics, Universidad Politécnica de Madrid(西班牙马德里理工大学航空航天学院);Institute for Cross-Disciplinary Physics and Complex Systems (IFISC), CSIC-UIB(交叉学科物理与复杂系统研究所(IFISC),CSIC-UIB);Center for Computational Simulation, Universidad Politécnica de Madrid, Campus de Montegancedo, Boadilla del Monte(计算模拟中心,马德里理工大学蒙特加森多校区,博阿迪利亚德尔蒙特)
Model-Free Kernel Conformal Depth Measures Algorithm for Uncertainty Quantification in Regression Models in Separable Hilbert Spaces
Department of Biostatistics(生物统计学系);Harvard University(哈佛大学);Department of Epidemiology and Biostatistics(流行病学与生物统计学系);University of South Carolina(南卡罗来纳大学);LTCI Telecom Paris Institut Polytechnique de Paris(巴黎电信理工学院LTCI);UCLA(加州大学洛杉矶分校)
RFFNet: Large-Scale Interpretable Kernel Methods via Random Fourier Features
Federal University of São Carlos(圣卡洛斯联邦大学);Universidade de São Paulo(圣保罗大学);Instituto de Ciências Matemáticas e de Computação, Universidade de São Paulo(圣保罗大学数学与计算机科学学院)
Instituto de Telecomunicações(电信研究所);Instituto Superior Técnico, Universidade de Lisboa(里斯本大学高等技术学院);IT University of Copenhagen(哥本哈根信息技术大学);Pioneer Centre for Artificial Intelligence(先锋人工智能中心);Unbabel(Unbabel公司)
Improving the interpretability of GNN predictions through conformal-based graph sparsification
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);McGill University(麦吉尔大学);Saarland University(萨尔大学);Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所)
Attention-Based Feature Online Conformal Prediction for Time Series
King’s Communications, Learning & Information Processing (KCLIP) lab, Department of Engineering, King’s College London(国王通讯、学习与信息处理实验室(KCLIP),工程系,伦敦国王学院);Beijing Key Laboratory of Network System Architecture and Convergence, School of Information and Communication Engineering, Beijing University of Posts and Telecommunications(北京网络系统架构与融合重点实验室,信息与通信工程学院,北京邮电大学)