arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.08440eess.IVcs.CVcs.LG
收藏

利用预训练的正交二维扩散模型改进三维成像

Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models

Korea Advanced Institute of Science & Technology(韩国科学技术院);JLK Inc.(JLK公司)

Suhyeon Lee, Hyungjin Chung, Minyoung Park, Jonghyuk Park, Wi-Sun Ryu, Jong Chul Ye

AI总结:

提出利用两个正交的预训练二维扩散模型求解三维逆问题,通过乘积建模缓解维度灾难,在MRI超分辨率、压缩感知MRI和稀疏视角CT等医学重建任务中生成高质量体素体积。

摘要:

扩散模型因其诸多优势,已成为图像生成和重建的流行方法。然而,大多数基于扩散的逆问题求解方法仅处理二维图像,即便是近期发布的三维方法也未充分利用三维分布先验。为解决这一问题,我们提出了一种新方法,利用两个正交的预训练二维扩散模型来求解三维逆问题。通过将三维数据分布建模为不同方向切片上的二维分布的乘积,我们的方法有效应对了维度灾难。我们的实验结果表明,该方法在三维医学图像重建任务中非常有效,包括MRI Z轴超分辨率、压缩感知MRI和稀疏视角CT。我们的方法能够生成适用于医学应用的高质量体素体积。

英文摘要:

Diffusion models have become a popular approach for image generation and reconstruction due to their numerous advantages. However, most diffusion-based inverse problem-solving methods only deal with 2D images, and even recently published 3D methods do not fully exploit the 3D distribution prior. To address this, we propose a novel approach using two perpendicular pre-trained 2D diffusion models to solve the 3D inverse problem. By modeling the 3D data distribution as a product of 2D distributions sliced in different directions, our method effectively addresses the curse of dimensionality. Our experimental results demonstrate that our method is highly effective for 3D medical image reconstruction tasks, including MRI Z-axis super-resolution, compressed sensing MRI, and sparse-view CT. Our method can generate high-quality voxel volumes suitable for medical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑