Reliable confidence measures of metrics derived from medical imaging reconstruction pipelines would improve the standard of decision-making in many clinical workflows. Conformal Prediction (CP) provides a robust framework for producing calibrated prediction intervals, but standard CP formulations face a critical challenge in the imaging pipeline: common mismatches between image reconstruction objectives and downstream metrics can introduce systematic prediction deviations from ground truth values, known as bias. These biases in turn compromise the efficiency of prediction intervals, which is a problem that has been unexplored in the CP literature. In this study, we formalize the behavior of symmetric (where bounds expand equally in both directions) and asymmetric (where bounds expand unequally) formulations for common non-conformity scores in CP in the presence of bias, and argue that this measurable bias must inform the choice of CP formulation. We theoretically and empirically demonstrate that symmetric intervals are inflated by a factor of two times the magnitude of bias while asymmetric intervals remain unaffected by bias, and provide conditions under which each formulation produces tighter intervals. We empirically validated our theoretical analyses on sparse-view CT reconstruction for downstream radiotherapy planning. Our work enables users of medical imaging pipelines to proactively select optimal CP formulations, thereby improving interval length efficiency for critical downstream metrics.
Parametric Scaling Law of Tuning Bias in Conformal Prediction
Department of Statistics and Data Science, Southern University of Science and Technology(统计与数据科学系,南方科技大学);Department of Computer and Information Science, University of Macau(计算机与信息科学系,澳门大学)
Decomposition-Based Modular Conformal Prediction for Two-Stage Modeling
Operations Research Center, Massachusetts Institute of Technology, Cambridge, MA, USA(麻省理工学院运筹学研究中心);Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, MA, US(麻省理工学院信息与决策系统实验室);Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, USA(麻省理工学院斯隆管理学院)
Self-Supervised Conformal Prediction with Equivariant Bootstrapping for Image Uncertainty Quantification
Mullard Space Science Laboratory, University College London(伦敦大学学院穆拉德空间科学实验室);IRFU, CEA, Université Paris-Saclay(法国原子能和替代能源委员会IRFU,巴黎萨克雷大学);Heriot-Watt University(赫瑞瓦特大学);Maxwell Institute for Mathematical Sciences(麦克斯韦数学科学研究所);The Alan Turing Institute(艾伦·图灵研究所)
Conformal prediction after data-dependent model selection
University of Chicago(芝加哥大学);Department of Statistics, University of California, Irvine(加州大学尔湾分校统计系);Department of Statistics, University of Chicago(芝加哥大学统计系)
A Rigorous Machine Learning Analysis Pipeline for Biomedical Binary Classification: Application in Pancreatic Cancer Nested Case-control Studies with Implications for Bias Assessments
Institute for Biomedical Informatics(生物医学信息学研究所);University of Pennsylvania(宾夕法尼亚大学);Biostatistics and Bioinformatics Facility(生物统计学与生物信息学中心);Fox Chase Cancer Center(福克斯蔡斯癌症中心);Division of Cancer Epidemiology and Genetics(癌症流行病学与遗传学部门);National Cancer Institute(美国国家癌症研究所);Cancer Prevention and Control(癌症预防与控制部门)