arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2007.13408eess.IVcs.CVcs.LG
收藏

XCAT-GAN用于在解剖结构可变的XCAT模板上合成3D一致性标记心脏MR图像

XCAT-GAN for Synthesizing 3D Consistent Labeled Cardiac MR Images on Anatomically Variable XCAT Phantoms

Eindhoven University of Technology(埃因霍温理工大学);Philips Research Laboratories(飞利浦研究实验室);Philips Healthcare(飞利浦医疗)

Sina Amirrajab, Samaneh Abbasi-Sureshjani, Yasmina Al Khalil, Cristian Lorenz, Juergen Weese, Josien Pluim, Marcel Breeuwer

摘要:

生成对抗网络(GANs)通过合成高保真图像提供了有前途的数据丰富解决方案。然而,生成具有新的解剖变化的标记图像的大集合仍然未被探索。我们提出了一种新的方法,用于合成心脏磁共振(CMR)图像上的人口与一个大的解剖变化,介绍了使用4D扩展的心脏和躯干(XCAT)的计算机人体模型的虚拟主体。我们研究了两种基于语义一致的掩码引导图像生成技术的条件图像合成方法:4类和8类XCAT-GAN。4类技术仅依赖于心脏的注释;而8类技术采用心脏周围器官的预测多组织标记图,并为我们的条件图像合成提供更好的指导。对于这两种技术,我们训练我们的条件XCAT-GAN与对应的标签配对的真实图像,随后在推理时间,我们用XCAT派生的标签替换标签。因此,经过训练的网络可以准确地将组织特定的纹理转移到新的标签映射中。通过在舒张末期和收缩末期创建33个虚拟受试者的合成CMR图像,我们评估了这些数据在不同增强策略下的下游心腔分割任务中的有用性。结果表明,即使在训练过程中只看到20%的真实图像(40个体积),添加合成CMR图像也能保持分割性能。此外,利用合成图像增强真实数据的改进是显而易见的,Hausdorff距离减少了28%,Dice分数增加了5%,表明在所有维度上与地面真实值的相似性更高。

英文摘要:

Generative adversarial networks (GANs) have provided promising data enrichment solutions by synthesizing high-fidelity images. However, generating large sets of labeled images with new anatomical variations remains unexplored. We propose a novel method for synthesizing cardiac magnetic resonance (CMR) images on a population of virtual subjects with a large anatomical variation, introduced using the 4D eXtended Cardiac and Torso (XCAT) computerized human phantom. We investigate two conditional image synthesis approaches grounded on a semantically-consistent mask-guided image generation technique: 4-class and 8-class XCAT-GANs. The 4-class technique relies on only the annotations of the heart; while the 8-class technique employs a predicted multi-tissue label map of the heart-surrounding organs and provides better guidance for our conditional image synthesis. For both techniques, we train our conditional XCAT-GAN with real images paired with corresponding labels and subsequently at the inference time, we substitute the labels with the XCAT derived ones. Therefore, the trained network accurately transfers the tissue-specific textures to the new label maps. By creating 33 virtual subjects of synthetic CMR images at the end-diastolic and end-systolic phases, we evaluate the usefulness of such data in the downstream cardiac cavity segmentation task under different augmentation strategies. Results demonstrate that even with only 20% of real images (40 volumes) seen during training, segmentation performance is retained with the addition of synthetic CMR images. Moreover, the improvement in utilizing synthetic images for augmenting the real data is evident through the reduction of Hausdorff distance up to 28% and an increase in the Dice score up to 5%, indicating a higher similarity to the ground truth in all dimensions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑