arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2309.01488cs.CVcs.LG
收藏

马氏距离在医学影像神经网络分布外检测中的应用

On the use of Mahalanobis distance for out-of-distribution detection with neural networks for medical imaging

University of Oxford(牛津大学);Imperial College London(帝国理工学院);University of Birmingham(伯明翰大学)

Harry Anthony, Konstantinos Kamnitsas

AI总结:

本文挑战马氏距离OOD检测存在最优层的假设,证明最优层随OOD类型变化,并验证多检测器策略可增强鲁棒性,为医学影像OOD检测提供最佳实践。

摘要:

将神经网络用于临床应用时,网络必须能够检测输入数据与训练数据之间的显著差异,以防止不可靠的预测。社区已开发多种分布外(OOD)检测方法,其中基于距离的方法(如马氏距离)展现出潜力。本文挑战了社区普遍认为的“存在一个最优层或层组合用于应用马氏距离检测任何OOD模式”的观点。通过使用合成伪影模拟OOD模式,本文表明应用马氏距离的最优层随OOD模式类型而变化,不存在通用解决方案。本文还表明,将OOD检测器分离为网络不同深度处的多个检测器,可以增强对不同OOD模式的检测鲁棒性。这些见解在真实世界的OOD任务上得到验证:在无支持设备的CheXpert胸部X光片上训练模型,然后使用带有未见起搏器(我们为这项研究手动标注了CheXpert的50%)和未见性别的扫描作为OOD案例。结果为指导马氏距离在OOD检测中的最佳实践提供了依据。手动标注的起搏器标签和项目代码可在https://github.com/HarryAnthony/Mahalanobis-OOD-detection获取。

英文摘要:

Implementing neural networks for clinical use in medical applications necessitates the ability for the network to detect when input data differs significantly from the training data, with the aim of preventing unreliable predictions. The community has developed several methods for out-of-distribution (OOD) detection, within which distance-based approaches - such as Mahalanobis distance - have shown potential. This paper challenges the prevailing community understanding that there is an optimal layer, or combination of layers, of a neural network for applying Mahalanobis distance for detection of any OOD pattern. Using synthetic artefacts to emulate OOD patterns, this paper shows the optimum layer to apply Mahalanobis distance changes with the type of OOD pattern, showing there is no one-fits-all solution. This paper also shows that separating this OOD detector into multiple detectors at different depths of the network can enhance the robustness for detecting different OOD patterns. These insights were validated on real-world OOD tasks, training models on CheXpert chest X-rays with no support devices, then using scans with unseen pacemakers (we manually labelled 50% of CheXpert for this research) and unseen sex as OOD cases. The results inform best-practices for the use of Mahalanobis distance for OOD detection. The manually annotated pacemaker labels and the project's code are available at: https://github.com/HarryAnthony/Mahalanobis-OOD-detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑