arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.08657eess.IVcs.CV

自监督学习提升深度学习肺肿瘤分割对CT成像差异的鲁棒性

Self-supervised learning improves robustness of deep learning lung tumor segmentation to CT imaging differences

Memorial Sloan Kettering Cancer Center(纪念斯隆-凯特琳癌症中心)

Jue Jiang, Aneesh Rangnekar, Harini Veeraraghavan

AI总结:

该研究对比野外预训练与自预训练的Transformer模型在肺肿瘤分割中对CT成像差异的鲁棒性,发现野外预训练模型鲁棒性更优,Swin架构获益更显著,掩码图像预测前置任务效果优于对比任务。

摘要:

自监督学习(SSL)是一种从未标记数据中提取有用特征表示、并能在标记样本有限的下游任务上进行微调的方法。自预训练是一种将策划好的任务数据集同时用于网络预训练和微调的SSL方法。大规模、多样化且未经过策划的公共医学图像集的存在,为在“野外”场景下应用SSL并潜在提取对成像变化具有鲁棒性的特征提供了机会。然而,针对医学图像分析领域,野外预训练相较于自预训练的优势尚未得到研究。本文中,我们比较了野外预训练与自预训练的Transformer(视觉Transformer[ViT]和分层移位窗口[Swin])模型在非小细胞肺癌(NSCLC)分割任务中对计算机断层扫描(CT)成像差异的鲁棒性。在各类成像采集条件下,野外预训练的Swin模型表现优于自预训练的Swin模型。ViT在野外预训练和自预训练模型下取得的准确率相近。迫使网络学习局部结构的掩码图像预测前置任务,相较于建模全局图像信息的对比任务,能带来更高的准确率。野外预训练模型在微调后,低层网络的特征复用程度更高,且靠近输出层的特征区分度更强。因此我们得出结论:在肺肿瘤分割任务中,野外预训练网络对所分析的CT成像差异的鲁棒性优于自预训练方法;Swin架构从这类预训练中获益比ViT更多。

英文摘要:

Self-supervised learning (SSL) is an approach to extract useful feature representations from unlabeled data, and enable fine-tuning on downstream tasks with limited labeled examples. Self-pretraining is a SSL approach that uses the curated task dataset for both pretraining the networks and fine-tuning them. Availability of large, diverse, and uncurated public medical image sets provides the opportunity to apply SSL in the "wild" and potentially extract features robust to imaging variations. However, the benefit of wild- vs self-pretraining has not been studied for medical image analysis. In this paper, we compare robustness of wild versus self-pretrained transformer (vision transformer [ViT] and hierarchical shifted window [Swin]) models to computed tomography (CT) imaging differences for non-small cell lung cancer (NSCLC) segmentation. Wild-pretrained Swin models outperformed self-pretrained Swin for the various imaging acquisitions. ViT resulted in similar accuracy for both wild- and self-pretrained models. Masked image prediction pretext task that forces networks to learn the local structure resulted in higher accuracy compared to contrastive task that models global image information. Wild-pretrained models resulted in higher feature reuse at the lower level layers and feature differentiation close to output layer after fine-tuning. Hence, we conclude: Wild-pretrained networks were more robust to analyzed CT imaging differences for lung tumor segmentation than self-pretrained methods. Swin architecture benefited from such pretraining more than ViT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑