arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.02568cs.CV
收藏

基于置信度的分布外检测的比较研究与分析

Confidence-based Out-of-Distribution Detection: A Comparative Study and Analysis

Technical University Munich(慕尼黑工业大学);Imperial College London(帝国理工学院)

Christoph Berger, Magdalini Paschali, Ben Glocker, Konstantinos Kamnitsas

摘要:

部署在现实世界中的图像分类模型可能接收预期数据分布之外的输入。对于临床决策等关键应用,模型必须能够检测此类分布外(OOD)输入并表示其不确定性。在这项工作中,我们通过比较研究和深入分析,评估各种国家的最先进的方法,以信心为基础的OOD检测的能力。首先,我们利用计算机视觉基准再现和比较多种OOD检测方法。然后,我们评估他们的能力,在具有挑战性的任务,疾病分类使用胸部X射线。我们的研究表明,计算机视觉任务的高性能并不直接转化为医学成像任务的准确性。我们分析了影响两个任务之间的方法的性能的因素。我们的研究结果为开发下一代OOD检测方法提供了有用的见解。

英文摘要:

Image classification models deployed in the real world may receive inputs outside the intended data distribution. For critical applications such as clinical decision making, it is important that a model can detect such out-of-distribution (OOD) inputs and express its uncertainty. In this work, we assess the capability of various state-of-the-art approaches for confidence-based OOD detection through a comparative study and in-depth analysis. First, we leverage a computer vision benchmark to reproduce and compare multiple OOD detection methods. We then evaluate their capabilities on the challenging task of disease classification using chest X-rays. Our study shows that high performance in a computer vision task does not directly translate to accuracy in a medical imaging task. We analyse factors that affect performance of the methods between the two tasks. Our results provide useful insights for developing the next generation of OOD detection methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑