arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.00132eess.IVcs.CV

FetalDiffusion:基于条件扩散模型的可控姿态三维胎儿MRI合成

FetalDiffusion: Pose-Controllable 3D Fetal MRI Synthesis with Conditional Diffusion Model

Harvard Medical School(哈佛医学院)

Molin Zhang, Polina Golland, Patricia Ellen Grant, Elfar Adalsteinsson

AI总结:

本文提出FetalDiffusion条件扩散模型,合成可控姿态的三维胎儿MRI,并通过姿态级损失提升质量,在真实数据有限时将姿态估计PCK提高15.4%、平均误差降低50.2%。

摘要:

胎儿MRI的质量受到不可预测且幅度较大的胎动显著影响,即使采用快速采集序列也会引入伪影。基于容积EPI胎儿MRI的三维实时胎儿姿态估计方法的发展,为胎儿运动监测与预测开辟了有前景的途径。由于真实扫描的胎儿MR训练图像数量有限,当采集到的胎儿MRI缺乏足够姿态时,模型泛化面临挑战。在本研究中,我们提出了FetalDiffusion,一种利用条件扩散模型生成具有可控姿态的三维合成胎儿MRI的新方法。此外,采用辅助的姿态级损失来提升模型性能。我们的工作通过生成高质量、具有准确且可辨识胎儿姿态的合成胎儿MRI图像,证明了该模型的有效性,并与体内真实胎儿MRI相比表现良好。进一步地,我们展示了合成胎儿MR图像的引入能够提升胎儿姿态估计模型的性能,特别是在可用真实扫描数据数量有限的情况下,PCK提高了15.4%,平均误差降低了50.2%。所有实验均在单块32GB V100 GPU上完成。我们的方法有望改进实时跟踪模型,从而更有效地解决胎儿运动问题。

英文摘要:

The quality of fetal MRI is significantly affected by unpredictable and substantial fetal motion, leading to the introduction of artifacts even when fast acquisition sequences are employed. The development of 3D real-time fetal pose estimation approaches on volumetric EPI fetal MRI opens up a promising avenue for fetal motion monitoring and prediction. Challenges arise in fetal pose estimation due to limited number of real scanned fetal MR training images, hindering model generalization when the acquired fetal MRI lacks adequate pose. In this study, we introduce FetalDiffusion, a novel approach utilizing a conditional diffusion model to generate 3D synthetic fetal MRI with controllable pose. Additionally, an auxiliary pose-level loss is adopted to enhance model performance. Our work demonstrates the success of this proposed model by producing high-quality synthetic fetal MRI images with accurate and recognizable fetal poses, comparing favorably with in-vivo real fetal MRI. Furthermore, we show that the integration of synthetic fetal MR images enhances the fetal pose estimation model's performance, particularly when the number of available real scanned data is limited resulting in 15.4% increase in PCK and 50.2% reduced in mean error. All experiments are done on a single 32GB V100 GPU. Our method holds promise for improving real-time tracking models, thereby addressing fetal motion issues more effectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑