arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.03629cs.CV
收藏

用于半监督胸部X线分类的自我监督平均教师

Self-supervised Mean Teacher for Semi-supervised Chest X-ray Classification

University of Adelaide(阿德莱德大学);Universidade Federal Rural de Pernambuco(伯南布哥联邦农村大学);Universität Ulm(乌尔姆大学);South Australian Health and Medical Research Institute(南澳大利亚健康与医学研究所)

Fengbei Liu, Yu Tian, Filipe R. Cordeiro, Vasileios Belagiannis, Ian Reid, Gustavo Carneiro

摘要:

深度学习模型的训练通常需要大量的注释数据,以实现有效的收敛和泛化。然而,获得高质量的注释是一个费力和昂贵的过程,由于需要专业的放射科医生的标签任务。医学图像分析中的半监督学习的研究是至关重要的,因为获得未标记的图像比获得由放射科专家标记的图像便宜得多。从本质上讲,半监督方法利用大量未标记的数据集来实现比仅使用少量标记图像更好的训练收敛和泛化。在本文中,我们提出了半监督(S $^2$ MTS $^2$)学习的自监督均值教师,它将自监督均值教师预训练与半监督微调相结合。S $^2$ MTS $^2$的主要创新点是基于联合对比学习的自监督平均教师预训练,它使用无限数量的正查询和关键特征对来改进平均教师表示。然后使用经过半监督学习训练的指数移动平均教师框架对模型进行微调。我们验证了S $^2$ MTS $^2$在胸部X射线14和CheXpert的多标签分类问题上的有效性,以及ISIC 2018的多类分类,我们表明它大大优于以前的SOTA半监督学习方法。

英文摘要:

The training of deep learning models generally requires a large amount of annotated data for effective convergence and generalisation. However, obtaining high-quality annotations is a laboursome and expensive process due to the need of expert radiologists for the labelling task. The study of semi-supervised learning in medical image analysis is then of crucial importance given that it is much less expensive to obtain unlabelled images than to acquire images labelled by expert radiologists. Essentially, semi-supervised methods leverage large sets of unlabelled data to enable better training convergence and generalisation than using only the small set of labelled images. In this paper, we propose Self-supervised Mean Teacher for Semi-supervised (S$^2$MTS$^2$) learning that combines self-supervised mean-teacher pre-training with semi-supervised fine-tuning. The main innovation of S$^2$MTS$^2$ is the self-supervised mean-teacher pre-training based on the joint contrastive learning, which uses an infinite number of pairs of positive query and key features to improve the mean-teacher representation. The model is then fine-tuned using the exponential moving average teacher framework trained with semi-supervised learning. We validate S$^2$MTS$^2$ on the multi-label classification problems from Chest X-ray14 and CheXpert, and the multi-class classification from ISIC2018, where we show that it outperforms the previous SOTA semi-supervised learning methods by a large margin.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑