arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.01704cs.CV

基于皮肤镜与临床图像的多标签皮肤病变分类的图集成学习模型

Graph-Ensemble Learning Model for Multi-label Skin Lesion Classification using Dermoscopy and Clinical Images

Technical University of Munich(慕尼黑工业大学);Munich Institute of Biomedical Engineering(慕尼黑生物医学工程研究所);Imperial College London(伦敦帝国学院)

Peng Tang, Yang Nan, Tobias Lasser

AI总结:

本文针对多标签皮肤病变分类中标签相关性利用不足的问题,提出图集成学习模型GELN,将GCN的预测作为融合模型的互补信息进行自适应加权融合,在多个公开数据集上取得SPC和诊断分类的最先进性能。

摘要:

近年来,许多皮肤病变分析(SLA)方法专注于开发基于多模态的多标签分类方法,这源于两个因素。第一是多模态数据,即临床图像和皮肤镜图像,能够提供互补信息,从而获得比单模态数据更准确的结果。第二是多标签分类,即七点检查表(SPC)标准作为辅助分类任务,不仅可以提升深度学习(DL)流程中黑色素瘤的诊断准确性,还能为临床医生提供更多实用功能,因为SPC在临床皮肤科医生的诊断中被普遍使用。然而,大多数方法仅专注于设计更好的多模态数据融合模块,很少有方法探索利用SPC与皮肤疾病之间的标签相关性来提升性能。本研究填补了这一空白,引入图卷积网络(GCN),将各类别之间的先验共现关系作为相关矩阵融入深度学习模型,用于多标签分类。然而,在我们的实验中,直接应用GCN导致性能下降;我们将此归因于GCN在医学数据统计样本不足场景下的泛化能力较弱。为解决这一问题,我们提出了图集成学习模型(GELN),该模型将GCN的预测视为融合模型预测的互补信息,并通过加权平均方案自适应地融合二者,从而在尽可能避免GCN负面影响的同时利用其有价值的信息。为评估我们的方法,我们在公开数据集上进行了实验。结果表明,我们的GELN能够在不同数据集上持续提升分类性能,并且所提方法在SPC和诊断分类中能够取得最先进的性能。

英文摘要:

Many skin lesion analysis (SLA) methods recently focused on developing a multi-modal-based multi-label classification method due to two factors. The first is multi-modal data, i.e., clinical and dermoscopy images, which can provide complementary information to obtain more accurate results than single-modal data. The second one is that multi-label classification, i.e., seven-point checklist (SPC) criteria as an auxiliary classification task can not only boost the diagnostic accuracy of melanoma in the deep learning (DL) pipeline but also provide more useful functions to the clinical doctor as it is commonly used in clinical dermatologist's diagnosis. However, most methods only focus on designing a better module for multi-modal data fusion; few methods explore utilizing the label correlation between SPC and skin disease for performance improvement. This study fills the gap that introduces a Graph Convolution Network (GCN) to exploit prior co-occurrence between each category as a correlation matrix into the DL model for the multi-label classification. However, directly applying GCN degraded the performances in our experiments; we attribute this to the weak generalization ability of GCN in the scenario of insufficient statistical samples of medical data. We tackle this issue by proposing a Graph-Ensemble Learning Model (GELN) that views the prediction from GCN as complementary information of the predictions from the fusion model and adaptively fuses them by a weighted averaging scheme, which can utilize the valuable information from GCN while avoiding its negative influences as much as possible. To evaluate our method, we conduct experiments on public datasets. The results illustrate that our GELN can consistently improve the classification performance on different datasets and that the proposed method can achieve state-of-the-art performance in SPC and diagnosis classification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑