arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2108.04815cs.CV
收藏

损失对泛化的影响--基于人工肺诊断数据的实证研究

The Effect of the Loss on Generalization: Empirical Study on Synthetic Lung Nodule Data

School of Biomedical Engineering and Imaging Sciences, King’s College London(伦敦国王学院生物医学工程与影像科学学院);BioMedIA, Department of Computing, Imperial College London(帝国理工学院计算系生物医学影像与数据分析中心);Department of Radiology, University College London(伦敦大学学院放射学系);The Royal Brompton & Harefield NHS Foundation Trust(皇家布朗普顿和哈菲尔德英国国民保健信托基金会);Technical University of Munich(慕尼黑工业大学);Helmholtz Center Munich(亥姆霍兹慕尼黑中心)

Vasileios Baltatzis, Loic Le Folgoc, Sam Ellis, Octavio E. Martinez Manzanera, Kyriaki-Margarita Bintsi, Arjun Nair, Sujal Desai, Ben Glocker, Julia A. Schnabel

摘要:

卷积神经网络(CNN)广泛用于包括医学成像在内的各种领域中的图像分类。虽然大多数研究部署交叉熵的损失函数在这样的任务,越来越多的方法已经转向一个家庭的对比学习为基础的损失。即使性能指标,如准确性,灵敏度和特异性经常用于评估CNN分类器,这些分类器实际学习的功能很少被识别,它们对分布外测试样本的分类性能的影响也没有得到充分的探索。在本文中,出于肺结节分类的现实任务的动机,我们研究了CNN在具有受控变异模式的合成数据集的不同分布上进行训练和测试时学习的特征。我们发现,不同的损失函数导致不同的功能正在学习,从而影响分类器的泛化能力上看不见的数据。这项研究为医学成像任务的深度学习解决方案的设计提供了一些重要的见解。

英文摘要:

Convolutional Neural Networks (CNNs) are widely used for image classification in a variety of fields, including medical imaging. While most studies deploy cross-entropy as the loss function in such tasks, a growing number of approaches have turned to a family of contrastive learning-based losses. Even though performance metrics such as accuracy, sensitivity and specificity are regularly used for the evaluation of CNN classifiers, the features that these classifiers actually learn are rarely identified and their effect on the classification performance on out-of-distribution test samples is insufficiently explored. In this paper, motivated by the real-world task of lung nodule classification, we investigate the features that a CNN learns when trained and tested on different distributions of a synthetic dataset with controlled modes of variation. We show that different loss functions lead to different features being learned and consequently affect the generalization ability of the classifier on unseen data. This study provides some important insights into the design of deep learning solutions for medical imaging tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑