We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to construct prediction sets that are valid under the i.i.d assumption. Importantly, naively applying conformal prediction does not provide reliable predictions in this setting, due to the distribution shift induced by the corruptions. To account for the distribution shift, we assume access to privileged information (PI). The PI is formulated as additional features that explain the distribution shift, however, they are only available during training and absent at test time. We approach this problem by introducing a novel generalization of weighted conformal prediction and support our method with theoretical coverage guarantees. Empirical experiments on both real and synthetic datasets indicate that our approach achieves a valid coverage rate and constructs more informative predictions compared to existing methods, which are not supported by theoretical guarantees.
Conformal Prediction with Corrupted Labels: Uncertain Imputation and Robust Re-weighting
Department of Computer Science(计算机科学系);Technion, Israel(技术学院,以色列);Department of Electrical Engineering and Computer Science(电气工程与计算机科学系);Massachusetts Institute of Technology(麻省理工学院);Departments of Electrical and Computer Engineering and of Computer Science(电气工程与计算机科学系)
Exploring the Noise Robustness of Online Conformal Prediction
Department of Statistics and Data Science, Southern University of Science and Technology(统计与数据科学系,南方科技大学);Department of Computer and Information Science, University of Macau(计算机与信息科学系,澳门大学);Center for Data Science, Zhejiang University(数据科学中心,浙江大学)
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Carle’s Illinois College of Medicine(卡尔伊利诺伊医学院);GE Healthcare(GE医疗);University of Chicago(芝加哥大学)
City University of Hong Kong(香港城市大学);Tsinghua University(清华大学);Shenzhen University of Advanced Technology(深圳理工大学);Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
Enhancing Adversarial Robustness with Conformal Prediction: A Framework for Guaranteed Model Reliability
Huaiyin Institute of Technology, Huai'an, China(淮阴职业技术学院);Chengdu Research Institute, City University of Hong Kong, Chengdu, China(香港城市大学成都研究院);Saarland University, Saarbrücken, Germany(萨尔兰大学);Alpha Benito Research, Los Angeles, USA(Alpha Benito研究公司);City University of Hong Kong, Hong Kong, China(香港城市大学)
Conformal Prediction under Levy-Prokhorov Distribution Shifts: Robustness to Local and Global Perturbations
Department of Electrical Engineering and Computer Sciences, UC Berkeley, USA(加州大学伯克利分校电子工程与计算机科学系);Laboratory for Information and Decision Systems, MIT, USA(麻省理工学院信息与决策系统实验室)
PIGDreamer: Privileged Information Guided World Models for Safe Partially Observable Reinforcement Learning
School of Computer Science, University of Beihang, Beijing, China(北京航空航天大学计算机学院);School of Computer Science, Chinese University of Hong Kong, Hongkong, China(香港中文大学计算机学院);JD Explore Academy, Beijing, China(京东探索研究院);North Automatic Control Institute, Taiyuan, China(太原北自动控制研究所)
Partial Model Sharing Improves Byzantine Resilience in Federated Conformal Prediction
Department of Electronic Systems, Norwegian University of Science and Technology(挪威科学技术大学电子系统系);CSIRO’s Data61(澳大利亚数据61机构);Department of Information and Communications Engineering, Aalto University(艾尔沃斯大学信息与通信工程系)
Coupled Training with Privileged Information and Unlabeled Data
Department of Electrical and Computer Engineering, Princeton University(普林斯顿大学电子与计算机工程系);Department of Operations Research and Financial Engineering, Princeton University(普林斯顿大学运筹学与金融工程系)
Enhancing Electricity-System Resilience with Adaptive Robust Optimization and Conformal Uncertainty Characterization
Heinz College of Information Systems and Public Policy, Carnegie Mellon University(信息系统与公共政策学院,卡内基梅隆大学);Carnegie Mellon Electricity Industry Center(卡内基梅隆电力产业中心);Wilton E. Scott Institute for Energy Innovation(威利特·E·斯科特能源创新研究所);Department of Engineering and Public Policy, Carnegie Mellon Electricity Industry Center(工程与公共政策系,卡内基梅隆电力产业中心);Department of Electrical and Computer Engineering, Heinz College of Information Systems and Public Policy(电气与计算机工程系,信息系统与公共政策学院);Department of Integrated Systems Engineering, The Ohio State University(整合系统工程系,俄亥俄州立大学)
Doubly Robust Conformalized Survival Analysis with Right-Censored Data
Department of Data Sciences and Operations(数据科学与运营系);Department of Computer Science, University of Southern California(计算机科学系,南加州大学);Merck & Co., Inc.(默克公司)