arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2409.18340eess.IVcs.AIcs.CV

DRL-STNet:基于解耦表示学习的跨模态医学图像分割无监督域适应

DRL-STNet: Unsupervised Domain Adaptation for Cross-modality Medical Image Segmentation via Disentangled Representation Learning

Northwestern University(西北大学)

Hui Lin, Florian Schiffers, Santiago López-Tapia, Neda Tavakoli, Daniel Kim, Aggelos K. Katsaggelos

AI总结:

本文提出DRL-STNet框架,结合GAN、解耦表示学习与自训练实现跨模态医学图像分割的无监督域适应,在FLARE数据集上显著超越现有方法。

摘要:

无监督域适应(UDA)对医学图像分割至关重要,尤其是在跨模态数据场景中。UDA旨在将知识从有标签的源域迁移到无标签的目标域,从而减少对大量人工标注的依赖。本文提出了DRL-STNet,这是一个用于跨模态医学图像分割的新颖框架,它利用了生成对抗网络(GANs)、解耦表示学习(DRL)和自训练(ST)。我们的方法在GAN内利用DRL将图像从源模态转换到目标模态。然后,使用这些转换后的图像及相应的源标签对分割模型进行初始训练,并随后使用合成图像和真实图像的组合(带有伪标签和真实标签)进行迭代微调。所提出的框架在FLARE challenge数据集上的腹部器官分割中表现出卓越的性能,在Dice相似系数上超越了最先进的方法11.4%,在Normalized Surface Dice指标上超越了13.1%,分别达到了74.21%和80.69%的分数。平均运行时间为41秒,GPU内存-时间曲线下面积为11,292 MB。这些结果表明了DRL-STNet在增强跨模态医学图像分割任务方面的潜力。

英文摘要:

Unsupervised domain adaptation (UDA) is essential for medical image segmentation, especially in cross-modality data scenarios. UDA aims to transfer knowledge from a labeled source domain to an unlabeled target domain, thereby reducing the dependency on extensive manual annotations. This paper presents DRL-STNet, a novel framework for cross-modality medical image segmentation that leverages generative adversarial networks (GANs), disentangled representation learning (DRL), and self-training (ST). Our method leverages DRL within a GAN to translate images from the source to the target modality. Then, the segmentation model is initially trained with these translated images and corresponding source labels and then fine-tuned iteratively using a combination of synthetic and real images with pseudo-labels and real labels. The proposed framework exhibits superior performance in abdominal organ segmentation on the FLARE challenge dataset, surpassing state-of-the-art methods by 11.4% in the Dice similarity coefficient and by 13.1% in the Normalized Surface Dice metric, achieving scores of 74.21% and 80.69%, respectively. The average running time is 41 seconds, and the area under the GPU memory-time curve is 11,292 MB. These results indicate the potential of DRL-STNet for enhancing cross-modality medical image segmentation tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑