The black box nature of deep learning models complicate their usage in critical applications such as remote sensing. Conformal prediction is a method to ensure trust in such scenarios. Subject to data exchangeability, conformal prediction provides finite sample coverage guarantees in the form of a prediction set that is guaranteed to contain the true class within a user defined error rate. In this letter we show that conformal prediction algorithms are related to the uncertainty of the deep learning model and that this relation can be used to detect if the deep learning model is out-of-calibration. Popular classification models like Resnet50, Densenet161, InceptionV3, and MobileNetV2 are applied on remote sensing datasets such as the EuroSAT to demonstrate how under noisy scenarios the model outputs become untrustworthy. Furthermore an out-of-calibration detection procedure relating the model uncertainty and the average size of the conformal prediction set is presented.
Does confidence calibration improve conformal prediction?
Southern University of Science and Technology(南方科技大学);Nanyang Technological University(南洋理工大学);University of Macau(澳门大学);Singapore University of Technology and Design(新加坡科技设计大学)
ConformaDecompose: Explaining Uncertainty via Calibration Localization
Department of Computer Science and Engineering, University of Bologna, Italy(博洛尼亚大学计算机科学与工程系);Marketing and Sales, Automobili Lamborghini S.p.A, Sant'Agata Bolognese, Italy(法拉利拉尔布奇公司);RCT Data Science and Security, Technical University Dortmund, Germany(多特蒙德技术大学数据科学与安全部);Jönköping AI Lab, Department of Computing, Jönköping University, Sweden(约翰内斯堡大学人工智能实验室);Jönköping International Business School, Sweden(约翰内斯堡国际商学院);Department of Software Engineering, Haliç University, Istanbul, Turkey(伊斯坦布尔哈利奇大学软件工程系);University College Cork, Ireland(科克大学)
Probabilistic Conformal Coverage Guarantees in Small-Data Settings
Berkeley Synchrotron Infrared Structural Biology Program(伯克利同步辐射红外结构生物学项目);Center for Advanced Mathematics in Energy Research Applications(能源研究应用高级数学中心);Molecular Biophysics and Integrated Bioimaging Division(分子生物物理与整合生物成像部门)
CP4SBI: Local Conformal Calibration of Credible Sets in Simulation-Based Inference
Department of Statistics, Federal University of São Carlos(统计系,圣卡洛斯联邦大学);Institute of Mathematics and Computer Science, University of São Paulo(数学与计算机科学学院,圣保罗大学);Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK(格勒诺布尔阿尔卑斯大学,法国国家信息与自动化研究所,法国国家科学研究中心,格勒诺布尔INP,LJK)
Conformal Calibration: Ensuring the Reliability of Black-Box AI in Wireless Systems
King’s Communications, Learning and Information Processing (KCLIP) lab(国王通讯、学习与信息处理实验室);Centre for Intelligent Information Processing Systems (CIIPS)(智能信息处理系统中心);Department of Engineering(工程系)
Decoupled Conformal Optimisation: Efficient Prediction Sets via Independent Tuning and Calibration
Department of Computer Science, University of Manchester(曼彻斯特大学计算机科学系);UKRI AI Centre for Doctoral Training in Decision Making for Complex Systems(UKRI人工智能博士培训中心(复杂系统决策));Department of Computer Science, Aalto University(艾尔沃斯大学计算机科学系);ELLIS Institute, Finland(芬兰ELLIS研究所)
Efficient Federated Conformal Prediction with Group-Conditional Guarantee
IoT Thrust(物联网 thrust);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Institute for Intelligent Networked Systems (INSI)(智能网络化系统研究所);Northeastern University London(伦敦东北大学);Department of ECE The Hong Kong University of Science and Technology HK SAR(电子工程系 香港科技大学香港特别行政区)
Multi-Variable Conformal Prediction: Optimizing Prediction Sets using Multiple Calibration Variables
TU Munich & MCML, Germany(慕尼黑技术大学及MCML,德国);Politecnico di Milano, Italy(米兰理工学院,意大利);University of Brescia, Italy(布雷西亚大学,意大利);ETH Zürich, Switzerland(苏黎世联邦理工学院,瑞士)
Stable Localized Conformal Prediction via Transduction
School of Statistics;Data Science, Nankai University, Tianjin, China;School of Mathematics \& Statistics, The University of Melbourne, Melbourne, Australia
Multi-Agent Conformal Prediction with Personalized Statistical Validity
Department of Electronic Systems(电子系统系);Aalborg University(奥尔堡大学);Department of Mathematical Sciences(数学科学系);Institut de Mathématiques de Toulouse(图卢兹数学研究所);Université de Toulouse(图卢兹大学)
A Critical Perspective on Finite Sample Conformal Prediction Theory in Medical Applications
Max Planck Institute for Intelligent Systems, Germany(德国马克斯·普朗克智能系统研究所);Tübingen AI Center, Germany(图宾根人工智能中心);ELLIS Institute Tübingen, Germany(图宾根ELLIS研究所);Department of Digital Medicine, University of Bern, Switzerland(伯恩大学数字医学系);Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism UDEM, Inselspital, Bern University Hospital, University of Bern, Switzerland(伯恩大学糖尿病、内分泌学、营养医学和代谢学系);Diabetes Center Berne, Bern, Switzerland(伯恩糖尿病中心);University of Tübingen, Germany(图宾根大学);University of Lucerne, Switzerland(卢塞恩大学)
Reliable Real-Time Value at Risk Estimation via Quantile Regression Forest with Conformal Calibration
Institute of Statistics and Big Data, Renmin University of China(统计与大数据研究院,中国人民大学);Department of Decision Analytics and Operations, City University of Hong Kong(决策分析与运营部门,香港城市大学);School of Information, Renmin University of China(信息学院,中国人民大学)
Mirror Online Conformal Prediction with Intermittent Feedback
King’s Communications, Learning and Information Processing (KCLIP) Lab, Department of Engineering, King’s College London(国王学院通信、学习和信息处理实验室(KCLIP)实验室,工程系,伦敦国王学院)
Online Reasoning Calibration: Test-Time Training Enables Generalizable Conformal LLM Reasoning
Department of Electrical Engineering and Computer Science (MIT EECS)(麻省理工学院电气工程与计算机科学系);Computer Science and Artificial Intelligence Laboratory (MIT CSAIL)(麻省理工学院计算机科学与人工智能实验室);Laboratory for Information and Decision Systems (MIT LIDS)(麻省理工学院信息与决策系统实验室);Computational Science and Engineering (MIT CSE)(麻省理工学院计算科学与工程);Massachusetts Institute of Technology(麻省理工学院)
Center for Advanced Mathematics in Energy Research Applications(能源研究应用高级数学中心);Synchrotron Infrared Structural Biology Program(同步辐射红外结构生物学计划);Molecular Biophysics and Integrated Bioimaging Division(分子生物物理与整合生物成像部)
TCUQ: Single-Pass Uncertainty Quantification from Temporal Consistency with Streaming Conformal Calibration for TinyML
Multidisciplinary Faculty of Nador University Mohammed Premier Oujda(穆罕默德·布雷德·奥杰达大学多学科学院);Laboratory LaSTI, ENSAK Sultan Moulay Slimane University Khouribga(库尔希格大学拉斯特伊实验室)