arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.07230eess.IVcs.CV
收藏

基于共享隐高斯混合模型的跨域医学图像平移

Cross-Domain Medical Image Translation by Shared Latent Gaussian Mixture Model

National Institutes of Health(美国国立卫生研究院);University of Wisconsin(威斯康星大学)

Yingying Zhu, Youbao Tang, Yuxing Tang, Daniel C. Elton, Sungwon Lee, Perry J. Pickhardt, Ronald M. Summers

摘要:

由于训练数据不足,目前基于深度学习的分割模型在领域之间的泛化能力往往很差。在现实世界的临床应用中,跨域图像分析工具的需求很高,因为通常需要来自不同领域的医学图像来实现精确的诊断。放射学中的一个重要例子是从非造影CT推广到造影增强CT。不同阶段的对比增强CT扫描用于增强某些病理或器官。许多现有的跨域图像到图像转换模型已经被证明可以改善大器官的跨域分割。然而,这样的模型缺乏在平移过程中保留精细结构的能力,这对于许多临床应用是重要的,例如分割主动脉和骨盆动脉中的小钙化斑块。为了在医学图像翻译过程中保持精细结构,我们提出了一种基于块的模型,使用共享的潜在变量从高斯混合模型。我们将我们的图像翻译框架与几种最先进的跨域图像翻译方法进行了比较,并表明我们的模型在保留精细结构方面做得更好。我们的模型的优越性能进行了验证,通过执行两个任务与翻译的图像-检测和分割的主动脉斑块和胰腺分割。我们希望我们的框架的效用将扩展到分割以外的其他问题,由于生成的图像的质量提高和增强的能力,以保持小结构。

英文摘要:

Current deep learning based segmentation models often generalize poorly between domains due to insufficient training data. In real-world clinical applications, cross-domain image analysis tools are in high demand since medical images from different domains are often needed to achieve a precise diagnosis. An important example in radiology is generalizing from non-contrast CT to contrast enhanced CTs. Contrast enhanced CT scans at different phases are used to enhance certain pathologies or organs. Many existing cross-domain image-to-image translation models have been shown to improve cross-domain segmentation of large organs. However, such models lack the ability to preserve fine structures during the translation process, which is significant for many clinical applications, such as segmenting small calcified plaques in the aorta and pelvic arteries. In order to preserve fine structures during medical image translation, we propose a patch-based model using shared latent variables from a Gaussian mixture model. We compare our image translation framework to several state-of-the-art methods on cross-domain image translation and show our model does a better job preserving fine structures. The superior performance of our model is verified by performing two tasks with the translated images - detection and segmentation of aortic plaques and pancreas segmentation. We expect the utility of our framework will extend to other problems beyond segmentation due to the improved quality of the generated images and enhanced ability to preserve small structures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑