Conformal prediction is a framework for uncertainty quantification that constructs prediction sets for previously unseen data, guaranteeing coverage of the true label with a specified probability. However, the efficiency of these prediction sets, measured by their size, depends on the choice of the underlying learning model. Relying on a single fixed model may lead to suboptimal performance in online environments, as a single model may not consistently perform well across all time steps. To mitigate this, prior work has explored selecting a model from a set of candidates. However, this approach becomes computationally expensive as the number of candidate models increases. Moreover, poorly performing models in the set may also hinder the effectiveness. To tackle this challenge, this work develops a novel multi-model online conformal prediction algorithm that reduces computational complexity and improves prediction efficiency. At each time step, a bipartite graph is generated to identify a subset of effective models, from which a model is selected to construct the prediction set. Experiments demonstrate that our method outperforms existing multi-model conformal prediction techniques in terms of both prediction set size and computational efficiency.
Exploring the Noise Robustness of Online Conformal Prediction
Department of Statistics and Data Science, Southern University of Science and Technology(统计与数据科学系,南方科技大学);Department of Computer and Information Science, University of Macau(计算机与信息科学系,澳门大学);Center for Data Science, Zhejiang University(数据科学中心,浙江大学)
School of Statistics and Data Science, LPMC, KLMDASR and LEBPS, Nankai University(南开大学统计与数据科学学院);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
Parameter-Free and Group Conditional Online Conformal Prediction
Data Science and AI Institute (DSAI), Johns Hopkins University(数据科学与人工智能研究院(DSAI),约翰霍普金斯大学);Mathematical Institute for Data Science (MINDS), Johns Hopkins University(数据科学数学研究院(MINDS),约翰霍普金斯大学);Department of Biomedical Engineering, Johns Hopkins University(生物医学工程系,约翰霍普金斯大学);Department of Computer Science, Johns Hopkins University(计算机科学系,约翰霍普金斯大学);Amazon Responsible AI(亚马逊负责任人工智能)
Conformalized Interactive Imitation Learning: Handling Expert Shift and Intermittent Feedback
Robotics Institute, School of Computer Science, Carnegie Mellon University(机器人研究所、计算机科学学院、卡内基梅隆大学);Departments of Statistics and Machine Learning, Carnegie Mellon University(统计学与机器学习系、卡内基梅隆大学)
Error-quantified Conformal Inference for Time Series
School of Statistics and Data Science, LPMC, KLMDASR and LEBPS, Nankai University(统计与数据科学学院,LPMC,KLMDASR和LEBPS,南开大学);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院,清华大学)
Mirror Online Conformal Prediction with Intermittent Feedback
King’s Communications, Learning and Information Processing (KCLIP) Lab, Department of Engineering, King’s College London(国王学院通信、学习和信息处理实验室(KCLIP)实验室,工程系,伦敦国王学院)
Dynamic Estimation Loss Control in Variational Quantum Sensing via Online Conformal Inference
Signal Processing Systems Group, Department of Electrical Engineering, Eindhoven University of Technology(埃因霍温理工大学电子工程系信号处理系统组);KCLIP lab, Center for Intelligent Information Processing Systems, Department of Engineering, King’s College London(伦敦国王学院工程系智能信息处理系统中心)
Boost AI Power: Data Augmentation Strategies with unlabelled Data and Conformal Prediction, a Case in Alternative Herbal Medicine Discrimination with Electronic Nose
Zhejiang University(浙江大学);Stanford University(斯坦福大学);Royal Holloway, University of London(伦敦大学皇家霍洛威学院)
Reliable Real-Time Value at Risk Estimation via Quantile Regression Forest with Conformal Calibration
Institute of Statistics and Big Data, Renmin University of China(统计与大数据研究院,中国人民大学);Department of Decision Analytics and Operations, City University of Hong Kong(决策分析与运营部门,香港城市大学);School of Information, Renmin University of China(信息学院,中国人民大学)
Online Conformal Anomaly Detection with Prediction-Powered Data Acquisition
King’s Communications, Learning & Information Processing (KCLIP) lab within the Centre for Intelligent Information Processing Systems (CIIPS), Department of Engineering, King’s College London(伦敦国王学院工程系智能信息处理系统中心(CIIPS)通信、学习与信息处理实验室(KCLIP))
Online Conformal Prediction with Corrupted Feedback
Department of Engineering, King’s College London(伦敦国王学院工程系);Communication Systems Department, EURECOM(EURECOM通信系统部);Institute for Intelligent Networked Systems, Northeastern University London(伦敦东北大学智能网络系统研究所)