arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.00925cs.CVeess.IV
收藏

具有肿瘤一致性损失的多模态生成对抗网络用于脑MR图像合成

Multi-Modality Generative Adversarial Networks with Tumor Consistency Loss for Brain MR Image Synthesis

Tsinghua University(清华大学);Tencent Youtu Lab(腾讯优图实验室)

Bingyu Xin, Yifan Hu, Yefeng Zheng, Hongen Liao

摘要:

不同模态的磁共振(MR)图像可以为临床诊断提供补充信息,但是获取整个模态通常是昂贵的。大多数现有的方法只专注于合成两个模态之间的丢失图像,这限制了它们的鲁棒性和效率时,多模态丢失。为了解决这个问题,我们提出了一种多模态生成对抗网络(MGAN),可以同时从一种MR模态T2合成三种高质量的MR模态(FLAIR,T1和T1 ce)。实验结果表明,我们提出的方法合成的图像质量优于基线模型,pix 2 pix合成的图像。此外,对于MR脑图像合成,重要的是要保持关键的肿瘤信息在生成的模态,所以我们进一步引入了多模态肿瘤一致性损失的MGAN,称为TC-MGAN。我们使用TC-MGAN合成的模态来提高肿瘤分割的准确性,结果证明了它的有效性。

英文摘要:

Magnetic Resonance (MR) images of different modalities can provide complementary information for clinical diagnosis, but whole modalities are often costly to access. Most existing methods only focus on synthesizing missing images between two modalities, which limits their robustness and efficiency when multiple modalities are missing. To address this problem, we propose a multi-modality generative adversarial network (MGAN) to synthesize three high-quality MR modalities (FLAIR, T1 and T1ce) from one MR modality T2 simultaneously. The experimental results show that the quality of the synthesized images by our proposed methods is better than the one synthesized by the baseline model, pix2pix. Besides, for MR brain image synthesis, it is important to preserve the critical tumor information in the generated modalities, so we further introduce a multi-modality tumor consistency loss to MGAN, called TC-MGAN. We use the synthesized modalities by TC-MGAN to boost the tumor segmentation accuracy, and the results demonstrate its effectiveness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑