The issue of disagreements amongst human experts is a ubiquitous one in both machine learning and medicine. In medicine, this often corresponds to doctor disagreements on a patient diagnosis. In this work, we show that machine learning models can be trained to give uncertainty scores to data instances that might result in high expert disagreements. In particular, they can identify patient cases that would benefit most from a medical second opinion. Our central methodological finding is that Direct Uncertainty Prediction (DUP), training a model to predict an uncertainty score directly from the raw patient features, works better than Uncertainty Via Classification, the two-step process of training a classifier and postprocessing the output distribution to give an uncertainty score. We show this both with a theoretical result, and on extensive evaluations on a large scale medical imaging application.
Visual explanations for polyp detection: How medical doctors assess intrinsic versus extrinsic explanations
SimulaMet(西穆拉大都会研究所);UIT The Artic University of Norway(挪威UIT北极大学);Sahlgrenska University Hospital-Mölndal(萨尔格伦斯卡大学医院-默恩达尔);Swedish Medical Group(瑞典医疗集团);Oslo Metropolitan University(奥斯陆城市大学);Norwegian University of Science and Technology(挪威科技大学)
Embracing Aleatoric Uncertainty in Medical Multimodal Learning with Missing Modalities
HKUST (GZ)(香港科技大学);Tongji University(同济大学);University of Rochester(罗切斯特大学);Meta;Fudan University(复旦大学);The University of British Columbia(不列颠哥伦比亚大学);University of California, Davis(加州大学戴维斯分校)
Propagation and Attribution of Uncertainty in Medical Imaging Pipelines
Technical University of Munich(慕尼黑工业大学);Imperial College London(帝国理工学院);German Cancer Consortium DKTK(德国癌症研究联盟(DKTK));Helmholtz-Zentrum Munich(慕尼黑亥姆霍兹中心)
EDUE: Expert Disagreement-Guided One-Pass Uncertainty Estimation for Medical Image Segmentation
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Applied Sciences Western Switzerland (HES-SO)(瑞士西部应用科学大学(HES-SO))
Center for Data Science, New York University(纽约大学数据科学中心);NYU Grossman School of Medicine(纽约大学格罗斯曼医学院);Department of Population Health, NYU Grossman School of Medicine(纽约大学格罗斯曼医学院人口健康系)
Hyper Evidential Deep Learning to Quantify Composite Classification Uncertainty
The University of Texas at Dallas(德克萨斯大学达拉斯分校);US Army Research Laboratory(美国陆军研究实验室);University of Oslo(奥斯陆大学);Virginia Tech(弗吉尼亚理工大学);University of the District of Columbia(哥伦比亚特区大学)
Trustworthy clinical AI solutions: a unified review of uncertainty quantification in deep learning models for medical image analysis
Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);Inserm(法国国家健康与医学研究院);Pixyl Research and Development Laboratory(Pixyl研发实验室);Inria(法国国家信息与自动化研究所);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔理工学院)
Enhancing the Reliability of Medical AI through Expert-guided Uncertainty Modeling
Kharkevich Institute for Information Transmission Problems of Russian Academy of Sciences(俄罗斯科学院哈克维奇信息传输问题研究所);Skolkovo Institute of Science and Technology(斯科尔科沃科学技术学院);Sber(俄罗斯联邦储蓄银行);Artificial Intelligence Research Institute(人工智能研究院)
SegWithU: Uncertainty as Perturbation Energy for Single-Forward-Pass Risk-Aware Medical Image Segmentation
University of Toronto(多伦多大学);McGill University(麦吉尔大学);University of Waterloo(滑铁卢大学);Vector Institute(向量研究所);Project Neura;University of Toronto Machine Intelligence Student Team(多伦多大学人工智能学生团队);Amplimit
Word-Sequence Entropy: Towards Uncertainty Estimation in Free-Form Medical Question Answering Applications and Beyond
University of Electronic Science and Technology of China(电子科技大学);Drexel University(德雷塞尔大学);University of Pennsylvania(宾夕法尼亚大学);Yale University(耶鲁大学);Massachusetts Institute of Technology(麻省理工学院);Illinois Institute of Technology(伊利诺伊理工学院)
Explainable Uncertainty Estimation for Reliable Medical AI
College of Computing and Data Science (CCDS)(计算与数据科学学院);Nanyang Technological University (NTU)(南洋理工大学);A*STAR Centre for Frontier AI Research(新加坡科技研究局前沿人工智能研究中心);School Of Computing and Digital Technologies(计算与数字技术学院);Sheffield Hallam University(谢菲尔德哈勒姆大学);School of Computing(计算机学院);University of Utah(犹他大学);Tan Tock Seng Hospital (TTSH)(陈笃生医院);Lee Kong Chian School of Medicine(李光前医学院)
Bayesian uncertainty estimation improves clinical decision making in medical AI agents
University Hospital RWTH Aachen(亚琛工业大学附属医院);Heidelberg University Hospital(海德堡大学医院);TU Dresden(德累斯顿工业大学);TUD Dresden University of Technology(德累斯顿工业大学)
Rep-GLS: Report-Guided Generalized Label Smoothing for Robust Disease Detection
Arizona State University(亚利桑那州立大学);Guangzhou Institutes of Biomedicine and Health, Chinese Academy of Sciences(广州生物医学研究院,中国科学院);Kunming Medical University(昆明医科大学);Northumbria University(北umbria大学);NII, Tokyo Institute of Technology(东京技术大学国家研究所);RIKEN(理化学研究所);Westlake University(西湖大学)
Calibrating Ensembles for Scalable Uncertainty Quantification in Deep Learning-based Medical Segmentation
University of Cambridge(剑桥大学);Cancer Research UK Cambridge Centre(英国癌症研究中心剑桥中心);Cancer Research UK Cambridge Institute(英国癌症研究中心剑桥研究所);Danube Private University(多瑙河私立大学);KTH Royal Institute of Technology(KTH皇家理工学院)
UMedNeRF: Uncertainty-aware Single View Volumetric Rendering for Medical Neural Radiance Fields
Chengdu University of Information Technology(成都信息工程大学);Purdue University(普渡大学);University at Buffalo, State University of New York(纽约州立大学布法罗分校);University at Albany, State University of New York(纽约州立大学奥尔巴尼分校)