arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.04419eess.IVcs.LG

什么限制了弱监督深度学习在胸部CT分类中的性能?

What limits performance of weakly supervised deep learning for chest CT classification?

Duke University School of Medicine(杜克大学医学院);Duke University(杜克大学);University of Arizona(亚利桑那大学)

Fakrul Islam Tushar, Vincent M. D'Anniballe, Geoffrey D. Rubin, Joseph Y. Lo

AI总结:

本研究通过实验探究弱监督深度学习在胸部CT分类中的性能限制,发现模型能容忍10%标签噪声,在75%训练数据时性能达到平台,且二元模型优于多标签模型,但需警惕其受共存疾病影响,强调构建大规模数据集与可解释AI的重要性。

摘要:

带有噪声数据的弱监督学习因其高质量疾病标签的稀缺性而引起了医学影像领域的关注。然而,关于此类弱监督学习的局限性以及这些限制对疾病分类性能的影响,目前知之甚少。在本文中,我们通过检验模型对三种条件的容忍度来测试此类弱监督的影响。首先,我们通过逐步增加训练数据中标签的错误率来检验模型对噪声数据的容忍度。其次,我们通过改变训练数据量来评估数据集规模的影响。第三,我们比较了二元分类与多标签分类之间的性能差异。结果表明,在疾病分类性能下降之前,模型能够承受高达10%的额外标签错误。对于所有疾病类别,随着训练数据量的增加,疾病分类性能稳步上升,直到在训练数据的75%处出现性能平台期。最后,二元模型在每个疾病类别中的表现均优于多标签模型。然而,此类解释可能具有误导性,因为二元模型受到共存疾病的严重影响,可能并未学习到图像中疾病的特定特征。总之,本研究可能有助于医学影像领域理解带有噪声标签的弱监督的益处与风险。此类研究证明了构建多样化、大规模数据集以及开发可解释和负责任的人工智能的必要性。

英文摘要:

Weakly supervised learning with noisy data has drawn attention in the medical imaging community due to the sparsity of high-quality disease labels. However, little is known about the limitations of such weakly supervised learning and the effect of these constraints on disease classification performance. In this paper, we test the effects of such weak supervision by examining model tolerance for three conditions. First, we examined model tolerance for noisy data by incrementally increasing error in the labels within the training data. Second, we assessed the impact of dataset size by varying the amount of training data. Third, we compared performance differences between binary and multi-label classification. Results demonstrated that the model could endure up to 10% added label error before experiencing a decline in disease classification performance. Disease classification performance steadily rose as the amount of training data was increased for all disease classes, before experiencing a plateau in performance at 75% of training data. Last, the binary model outperformed the multilabel model in every disease category. However, such interpretations may be misleading, as the binary model was heavily influenced by co-occurring diseases and may not have learned the specific features of the disease in the image. In conclusion, this study may help the medical imaging community understand the benefits and risks of weak supervision with noisy labels. Such studies demonstrate the need to build diverse, large-scale datasets and to develop explainable and responsible AI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑