Deep learning-based image reconstruction approaches have demonstrated impressive empirical performance in many imaging modalities. These approaches usually require a large amount of high-quality paired training data, which is often not available in medical imaging. To circumvent this issue we develop a novel unsupervised knowledge-transfer paradigm for learned reconstruction within a Bayesian framework. The proposed approach learns a reconstruction network in two phases. The first phase trains a reconstruction network with a set of ordered pairs comprising of ground truth images of ellipses and the corresponding simulated measurement data. The second phase fine-tunes the pretrained network to more realistic measurement data without supervision. By construction, the framework is capable of delivering predictive uncertainty information over the reconstructed image. We present extensive experimental results on low-dose and sparse-view computed tomography showing that the approach is competitive with several state-of-the-art supervised and unsupervised reconstruction techniques. Moreover, for test data distributed differently from the training data, the proposed framework can significantly improve reconstruction quality not only visually, but also quantitatively in terms of PSNR and SSIM, when compared with learned methods trained on the synthetic dataset only.
Unsupervised Anomaly Detection in Medical Images with a Memory-augmented Multi-level Cross-attentional Masked Autoencoder
Harvard University(哈佛大学);Singapore Management University(新加坡管理大学);Australian Institute for Machine Learning(澳大利亚机器学习研究所);University of Adelaide(阿德莱德大学);South Australian Health and Medical Research Institute(南澳大利亚健康与医学研究所);University of Surrey(萨里大学)
School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);School of Information Science and Technology, ShanghaiTech University(上海交通大学信息科学与技术学院);School of Biomedical Engineering and the National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy (NERCAMRT), Shanghai Jiao Tong University(上海交通大学生物医学工程学院和先进磁共振诊断与治疗国家工程研究中心)
Model-based Reconstruction with Learning: From Unsupervised to Supervised and Beyond
Michigan State University(密歇根州立大学);University of Michigan - Shanghai Jiao Tong University Joint Institute(密歇根大学-上海交通大学联合学院);Shanghai Jiao Tong University(上海交通大学)
Unsupervised denoising for sparse multi-spectral computed tomography
University of Oulu(奥卢大学);University College London(伦敦大学学院)
具有光子计数探测器(PCD)的多能量计算机断层扫描(CT)能够实现光谱成像,因为PCD可以将入射光子分配给特定的能量通道。然而,具有许多光谱通道的PCD大幅增加了CT重建的计算复杂度,并且定制重建算法需要根据不同的噪声统计进行微调。\rev{Especially if many projections are taken, a large amount of data has to be collected and stored. Sparse view CT is one solution for data reduction. However, these issues are especially exacerbated when sparse imaging scenarios are encountered due to a significant reduction in photon counts.}在这项工作中,我们研究了基于学习的改进,以获得高质量的重建从稀疏测量的64通道PCD-CT的挑战性任务的适用性。特别是,为了克服训练过程中丢失的参考数据,我们提出了一种无监督的去噪和伪影去除方法,通过在重建中利用不同的滤波器函数以及光谱通道与核范数的显式耦合。性能评估模拟合成数据和公开提供的实验多光谱成像通过计算机断层扫描(MUSIC)数据集。我们将我们的无监督方法的质量…
Bayesian Uncertainty Estimation of Learned Variational MRI Reconstruction
Graz University of Technology(格拉茨技术大学);Silicon Austria Labs(奥地利硅谷实验室);University of Bonn(波恩大学);Johannes Kepler University(约翰·开普勒大学);Technical University of Munich(慕尼黑工业大学);Imperial College London(伦敦帝国理工学院);NYU School of Medicine(纽约大学医学院)
Primitive Representation Learning for Unsupervised Dynamic Contrast Enhanced MRI Reconstruction
Helmholtz Munich(亥姆霍兹慕尼黑);Technical University of Munich(慕尼黑工业大学);Boston Children’s Hospital(波士顿儿童医院);Harvard Medical School(哈佛医学院);Munich Center for Machine Learning(慕尼黑机器学习中心);Imperial College London(伦敦帝国理工学院);King’s College London(伦敦国王学院)
Enhancing Implicit Neural Representations with Image Feature Embedding for Unsupervised Cardiac Cine MRI Reconstruction
Division of Image Processing, Department of Radiology, Leiden University Medical Center(莱顿大学医学中心放射科图像处理部);C.J. Gorter Center, Department of Radiology, Leiden University Medical Center(莱顿大学医学中心放射科C.J. 戈特中心);Cardio Vascular Imaging Group, Department of Radiology, Leiden University Medical Center(莱顿大学医学中心放射科心血管成像组);Philips Innovative Technologies(飞利浦创新技术公司)
DULDA: Dual-domain Unsupervised Learned Descent Algorithm for PET image reconstruction
Zhejiang University(浙江大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);University of Florida(佛罗里达大学);Massachusetts General Brigham(麻省总医院布莱根医疗系统)
Unsupervised Low-dose CT Reconstruction with One-way Conditional Normalizing Flows
School of Mathematical Sciences, Capital Normal University(首都师范大学数学学院);Centre for Mathematical Imaging Techniques, University of Liverpool(利物浦大学数学成像技术中心);Department of Mathematics and Statistics, University of Strathclyde(斯特拉思克莱德大学数学与统计学系)
Unsupervised Self-Prior Embedding Neural Representation for Iterative Sparse-View CT Reconstruction
School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院);Lingang Laboratory(临港实验室);University of Michigan(密歇根大学);Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology(华中科技大学同济医学院附属同济医院);School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院)
Research Center for Medical Big Data, National Institute of Informatics(日本情报学研究所医疗大数据研究中心);LPixel Inc.(LPixel公司);Graduate School of Information Science and Technology, The University of Tokyo(东京大学信息科学与技术研究生院);Department of Radiology, University of Cambridge(剑桥大学放射科);Cancer Research UK Cambridge Centre(英国癌症研究中心剑桥中心);Department of Artificial Intelligence, ELTE Eötvös Loránd University(厄特沃什罗兰大学人工智能系);Department of Rehabilitation Medicine, Juntendo University School of Medicine(顺天堂大学医学部康复医学科);International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo(东京大学国际神经智能研究中心(WPI-IRCN))
MR-EIT: Multi-Resolution Reconstruction for Electrical Impedance Tomography via Data-Driven and Unsupervised Dual-Mode Neural Networks
Key Laboratory of Intelligent Control of Electrical Equipment, Tiangong University(天津工业大学智能电气装备控制重点实验室);School of Artificial Intelligence, Tiangong University(天津工业大学人工智能学院)
Enhancing Low-dose CT Image Reconstruction by Integrating Supervised and Unsupervised Learning
University of Michigan Shanghai Jiao Tong University Joint Institute(密歇根大学上海交通大学联合学院);Shanghai Jiao Tong University(上海交通大学);Amazon Inc.(亚马逊公司);Michigan State University(密歇根州立大学)
Unified Supervised-Unsupervised (SUPER) Learning for X-ray CT Image Reconstruction
传统的基于模型的图像重建(MBIR)方法将前向模型和噪声模型与简单的对象先验相结合。最近的用于图像重建的机器学习方法通常涉及监督学习或无监督学习,这两种方法都有其优点和缺点。在这项工作中,我们提出了一个统一的监督-无监督(SUPER)学习框架的X射线计算机断层扫描(CT)图像重建。所提出的学习公式在基于固定点迭代分析的统一MBIR框架中将基于无监督学习的先验(或甚至简单的分析先验)与(有监督的)基于深度网络的先验结合在一起。所提出的训练算法也是一个近似方案的双层监督训练优化问题,其中在较低级别的MBIR问题的基于网络的正则化优化使用上层重建损失。通过在更新网络权重和基于这些权重迭代更新重建之间交替来优化训练问题。我们证明了学习的SUPER模型对低剂量CT图像重建的有效性,为此我们使用NIH AAPM Mayo Clinic低剂量CT Grand Challenge数据集进行训练和测试。在我们的实验中,我们研究了有监督的深度网络先验和无监督的基于学习或分析的先验的不同组合。数值和可视化结果都显示了所提出的统一SUPER方法优于基于独立监督学习的方法,迭代MBIR方法和通过消融研究获得的SUPER变化。我们还表明,该算法在实践中收敛迅速。
MADGAN: unsupervised Medical Anomaly Detection GAN using multiple adjacent brain MRI slice reconstruction
LPIXEL Inc.(LPIXEL公司);University of Cambridge(剑桥大学);National Institute of Informatics(国立信息学研究所);National Center for Global Health and Medicine(国立国际医疗研究中心);Juntendo University(顺天堂大学);ELTE Eötvös Loránd University(厄特沃什·罗兰大学);The University of Tokyo(东京大学)
Combining Deep Learning and Adaptive Sparse Modeling for Low-dose CT Reconstruction
传统的基于模型的图像重建(MBIR)方法将前向模型和噪声模型与简单的对象先验相结合。最近深度学习方法在图像重建中的应用提供了一种成功的数据驱动方法,可以解决在测量欠采样或各种类型噪声的情况下重建图像时面临的挑战。在这项工作中,我们提出了一个混合监督-无监督学习框架的X射线计算机断层扫描(CT)图像重建。所提出的学习公式利用稀疏或无监督学习的先验知识和神经网络重构器来模拟定点迭代过程。每个建议的训练块由确定性MBIR求解器和神经网络组成。信息并行地流过这两个重构器,然后被最佳地组合,并且多个这样的块被级联以形成重构流水线。我们证明了这种学习的混合模型在训练数据有限的情况下用于低剂量CT图像重建的有效性,其中我们使用NIH AAPM Mayo Clinic低剂量CT Grand Challenge数据集进行训练和测试。在我们的实验中,我们研究了有监督的深度网络重构器和基于稀疏表示(无监督)的学习或分析先验的组合。我们的研究结果表明,所提出的框架相比,最近的重建方法有前途的性能。