When used in complex engineered systems, such as communication networks, artificial intelligence (AI) models should be not only as accurate as possible, but also well calibrated. A well-calibrated AI model is one that can reliably quantify the uncertainty of its decisions, assigning high confidence levels to decisions that are likely to be correct and low confidence levels to decisions that are likely to be erroneous. This paper investigates the application of conformal prediction as a general framework to obtain AI models that produce decisions with formal calibration guarantees. Conformal prediction transforms probabilistic predictors into set predictors that are guaranteed to contain the correct answer with a probability chosen by the designer. Such formal calibration guarantees hold irrespective of the true, unknown, distribution underlying the generation of the variables of interest, and can be defined in terms of ensemble or time-averaged probabilities. In this paper, conformal prediction is applied for the first time to the design of AI for communication systems in conjunction to both frequentist and Bayesian learning, focusing on demodulation, modulation classification, and channel prediction.
Conformal Calibration: Ensuring the Reliability of Black-Box AI in Wireless Systems
King’s Communications, Learning and Information Processing (KCLIP) lab(国王通讯、学习与信息处理实验室);Centre for Intelligent Information Processing Systems (CIIPS)(智能信息处理系统中心);Department of Engineering(工程系)
Loss-Controlling Calibration with Asymptotic Guarantees
Tianjin University(天津大学);Shandong University of Technology(山东理工大学);Shandong University of Traditional Chinese Medicine(山东中医药大学);Hefei University of Technology(合肥工业大学)
Semantic Meta-Split Learning: A TinyML Scheme for Few-Shot Wireless Image Classification
Centre for Wireless Communications (CWC), University of Oulu(奥卢大学无线通信中心);CEMSE Division, King Abdullah University of Science and Technology (KAUST)(阿卜杜拉国王科技大学CEMSE学部)
Prediction-Powered Communication with Distortion Guarantees
King’s Communications, Learning & Information Processing (KCLIP) lab within the Centre for Intelligent Information Processing Systems (CIIPS), Department of Engineering, King’s College London(国王学院通信、学习与信息处理(KCLIP)实验室,位于智能信息处理系统中心(CIIPS)内,工程系,伦敦国王学院);Department of Electrical Engineering, Chalmers University of Technology(电子工程系,查尔姆斯理工大学);Department of Electronic Systems, Aalborg University(电子系统系,奥尔堡大学)