arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.02572eess.IVcs.CV
收藏

基于无监督知识传递的学习型图像重建

Unsupervised Knowledge-Transfer for Learned Image Reconstruction

University College London(伦敦大学学院);University of Oulu(奥卢大学);The Chinese University of Hong Kong(香港中文大学)

Riccardo Barbano, Zeljko Kereta, Andreas Hauptmann, Simon R. Arridge, Bangti Jin

摘要:

基于深度学习的图像重建方法在许多成像模式中表现出令人印象深刻的经验性能。这些方法通常需要大量高质量的配对训练数据,而这在医学成像中通常是不可用的。为了规避这个问题,我们开发了一种新的无监督的知识转移范式学习重建贝叶斯框架内。该方法分两个阶段学习重构网络。第一阶段用一组有序对训练重建网络,该组有序对包括椭圆的地面实况图像和对应的模拟测量数据。第二阶段在没有监督的情况下将预训练的网络微调到更真实的测量数据。通过构造,该框架能够在重构图像上传递预测不确定性信息。我们提出了广泛的低剂量和稀疏视图计算机断层扫描的实验结果表明,该方法是有竞争力的几个国家的最先进的监督和无监督重建技术。此外,对于与训练数据分布不同的测试数据,与仅在合成数据集上训练的学习方法相比,所提出的框架不仅在视觉上而且在PSNR和SSIM方面定量地提高了重建质量。

英文摘要:

Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develop a novel unsupervised knowledge-transfer paradigm for learned reconstruction within a Bayesian framework. The proposed approach learns a reconstruction network in two phases. The first phase trains a reconstruction network with a set of ordered pairs comprising of ground truth images of ellipses and the corresponding simulated measurement data. The second phase fine-tunes the pretrained network to more realistic measurement data without supervision. By construction, the framework is capable of delivering predictive uncertainty information over the reconstructed image. We present extensive experimental results on low-dose and sparse-view computed tomography showing that the approach is competitive with several state-of-the-art supervised and unsupervised reconstruction techniques. Moreover, for test data distributed differently from the training data, the proposed framework can significantly improve reconstruction quality not only visually, but also quantitatively in terms of PSNR and SSIM, when compared with learned methods trained on the synthetic dataset only.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑