Accurate image reconstruction is at the heart of diagnostics in medical imaging. Supervised deep learning-based approaches have been investigated for solving inverse problems including image reconstruction. However, these trained models encounter unseen data distributions that are widely shifted from training data during deployment. Therefore, it is essential to assess whether a given input falls within the training data distribution for diagnostic purposes. Uncertainty estimation approaches exist but focus on providing an uncertainty map to radiologists, rather than assessing the training distribution fit. In this work, we propose a method based on the local Lipschitz-based metric to distinguish out-of-distribution images from in-distribution with an area under the curve of 99.94%. Empirically, we demonstrate a very strong relationship between the local Lipschitz value and mean absolute error (MAE), supported by a high Spearman's rank correlation coefficient of 0.8475, which determines the uncertainty estimation threshold for optimal model performance. Through the identification of false positives, the local Lipschitz and MAE relationship was used to guide data augmentation and reduce model uncertainty. Our study was validated using the AUTOMAP architecture for sensor-to-image Magnetic Resonance Imaging (MRI) reconstruction. We compare our proposed approach with baseline methods: Monte-Carlo dropout and deep ensembles, and further analysis included MRI denoising and Computed Tomography (CT) sparse-to-full view reconstruction using UNET architectures. We show that our approach is applicable to various architectures and learned functions, especially in the realm of medical image reconstruction, where preserving the diagnostic accuracy of reconstructed images remains paramount.
Robust Uncertainty Estimation under Distribution Shift via Difference Reconstruction
1 Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore 2 College of Computing;Data Science, Nanyang Technological University, Singapore 3 Centre for Medical Technologies \& Innovations, National Health Group, Singapore
Generative imaging for radio interferometry with fast uncertainty quantification
Mullard Space Science Laboratory (MSSL)(穆拉德空间科学实验室);University College London (UCL)(伦敦大学学院);Leiden Observatory(莱顿天文台);Leiden University(莱顿大学);IRFU CEA Université Paris-Saclay(CEA巴黎-萨克雷大学IRFU);Department of Computer Science(计算机科学系);Alan Turing Institute(艾伦·图灵研究所)
Prompting Lipschitz-constrained network for multiple-in-one sparse-view CT reconstruction
School of Information Science and Engineering, Yanshan University(燕山大学信息科学与工程学院);Beijing Advanced Innovation Center for Imaging Technology, Capital Normal University(北京影像技术先进创新中心,首都师范大学);Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)(高性能计算研究所(IHPC),科技研究局(A*STAR))
Bayesian Uncertainty Estimation of Learned Variational MRI Reconstruction
Graz University of Technology(格拉茨技术大学);Silicon Austria Labs(奥地利硅谷实验室);University of Bonn(波恩大学);Johannes Kepler University(约翰·开普勒大学);Technical University of Munich(慕尼黑工业大学);Imperial College London(伦敦帝国理工学院);NYU School of Medicine(纽约大学医学院)
Uncertainty Quantification for Cardiac Shape Reconstruction with Deep Signed Distance Functions via MCMC methods
Department of Mathematics and Scientific Computing, University of Graz, Austria(格拉茨大学数学与科学计算系,奥地利);PRIN-PNRR project no. P2022N5ZNP(PRIN-PNRR项目编号P2022N5ZNP);INdAM-GNCS
MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation
Imperial College London(伦敦帝国学院);Royal Brompton Hospital(皇家布朗普顿医院);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);University of Cambridge(剑桥大学)
Probabilistic 3D surface reconstruction from sparse MRI information
ETH Zurich(苏黎世联邦理工学院);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Imperial College London(帝国理工学院);King’s College London(伦敦国王学院);Microsoft Mixed Reality and AI lab(微软混合现实与人工智能实验室)
Endo-NeRF++: Uncertainty-Aware Neural Rendering with Multi-Resolution Hash Encoding for Dynamic Surgical Scene Reconstruction
Finnish Center for Artificial Intelligence (FCAI)(芬兰人工智能中心);ELLIS Unit Helsinki(欧洲学习与智能系统研究所赫尔辛基分部);University of Helsinki(赫尔辛基大学);Institute for Urban Studies (Urbaria)(城市研究所);Institute of Sustainability Science (HELSUS)(可持续发展科学研究所)
Department of Computer Science, University of Exeter, UK(埃克塞特大学计算机科学系,英国);UCL Hawkes Institute, Department of Computer Science, University College London, UK(伦敦大学学院霍克斯研究所,计算机科学系,英国)
Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba
Imperial College London(帝国理工学院);Royal Brompton Hospital(皇家布朗普顿医院);College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区生物医学工程学院);Human Phenome Institute, Fudan University(复旦大学人类表型组研究院);Inselspital, University of Bern(伯尔尼大学因塞尔医院);Technical University of Munich(慕尼黑工业大学)
Uncertainty-Aware Global-View Reconstruction for Multi-View Multi-Label Feature Selection
College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University(吉林大学符号计算与知识工程教育部重点实验室);Department of Computer Science, Portland State University(波特兰州立大学计算机科学系)
U-DAVI: Uncertainty-Aware Diffusion-Prior-Based Amortized Variational Inference for Image Reconstruction
Computing and Mathematical Sciences, California Institute of Technology(计算与数学科学系,加州理工学院);Mathematical Sciences, California Institute of Technology(数学科学系,加州理工学院)
Leveraging Geometric Prior Uncertainty and Complementary Constraints for High-Fidelity Neural Indoor Surface Reconstruction
Department of Automation, Shanghai Jiao Tong University(自动化系,上海交通大学);Department of Mechanical and Automation Engineering and T Stone Robotics Institute, The Chinese University of Hong Kong(机械与自动化工程系及T Stone机器人研究所,香港中文大学)
DynActiveGS: Active Gaussian Splatting for Dynamic Scene Reconstruction
Tsinghua University, Shenzhen International Graduate School(清华大学深圳国际研究生院);Huawei Technologies Ltd(华为技术有限公司);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Peng Cheng Laboratory(鹏城实验室)
Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimization
School of Mechanical Engineering and Automation, Harbin Institute of Technology Shenzhen(哈尔滨工业大学(深圳)机械工程与自动化学院);Shenzhen University General Hospital(深圳大学总医院)
Trustworthy MRI Reconstruction via Bayesian Uncertainty Quantification with Sparsity Prior Models
Department of Computer Science, University of Exeter(埃克塞特大学计算机科学系);UCL Hawkes Institute, Department of Computer Science, University College London(伦敦大学学院计算机科学系霍克斯研究所)