Recent accelerated MRI reconstruction models have used Deep Neural Networks (DNNs) to reconstruct relatively high-quality images from highly undersampled k-space data, enabling much faster MRI scanning. However, these techniques sometimes struggle to reconstruct sharp images that preserve fine detail while maintaining a natural appearance. In this work, we enhance the image quality by using a Conditional Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing (AGB) technique that automates the process of combining the adversarial and pixel-wise terms and streamlines hyperparameter tuning. In addition, we introduce a Densely Connected Iterative Network, which is an undersampled MRI reconstruction network that utilizes dense connections. In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques. To demonstrate the general nature of our method, it is further evaluated on a battery of image-to-image translation experiments, demonstrating an ability to recover from sub-optimal weighting in multi-term adversarial training.
LDPM: Towards undersampled MRI reconstruction with MR-VAE and Latent Diffusion Prior
Shenzhen Technology University（深圳科技大学）；Shenzhen University（深圳大学）；Huawei（华为）；Nanjing University of Science and Technology（南京理工大学）；Qilu University of Technology（齐鲁工业大学）
MRPD: Undersampled MRI reconstruction by prompting a large latent diffusion model
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China (USTC)（中国科学技术大学生命科学与医学部生物医学工程学院）；Suzhou Institute for Advance Research, USTC（中国科学技术大学苏州高等研究院）；Key Laboratory of Precision and Intelligent Chemistry, USTC（中国科学技术大学精准与智能化学重点实验室）；Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS（中国科学院计算技术研究所中国科学院智能信息处理重点实验室）
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；Inner Mongolia University（内蒙古大学）
Recently, score-based diffusion models have shown satisfactory performance in MRI reconstruction. Most of these methods require a large amount of fully sampled MRI data as a training set, which, sometimes, is difficult to acquire in practice. This paper proposes a fully-sampled-data-free score-based diffusion model for MRI reconstruction, which learns the fully sampled MR image prior in a self-supervised manner on undersampled data. Specifically, we first infer the fully sampled MR image distribution from the undersampled data by Bayesian deep learning, then perturb the data distribution and a…
Conditional Denoising Diffusion Model-Based Robust MR Image Reconstruction from Highly Undersampled Data
Department of Mathematics and Systems Engineering（数学与系统工程系）；Department of Biomedical Engineering & Science（生物医学工程与科学系）；Florida Institute of Technology（佛罗里达理工学院）；A. A. Martinos Center for Biomedical Imaging（A.A. Martinos生物医学成像中心）；Massachusetts General Hospital/Harvard Medical School（麻省总医院/哈佛医学院）；Department of Radiology（放射科）；Embry-Riddle Aeronautical University（艾姆伯-里尔航空大学）
Multi-contrast MRI acquisitions of an anatomy enrich the magnitude of information available for diagnosis. Yet, excessive scan times associated with additional contrasts may be a limiting factor. Two mainstream approaches for enhanced scan efficiency are reconstruction of undersampled acquisitions and synthesis of missing acquisitions. In reconstruction, performance decreases towards higher acceleration factors with diminished sampling density particularly at high-spatial-frequencies. In synthesis, the absence of data samples from the target contrast can lead to artefactual sensitivity or inse…
Non-rigid Motion Correction for MRI Reconstruction via Coarse-To-Fine Diffusion Models
Department of Computing and Mathematical Sciences, Caltech（计算与数学科学部，加利福尼亚理工学院）；Chandra Family Department of Electrical and Computer Engineering, UT Austin（查纳德家庭电子与计算机工程系，德克萨斯大学奥斯汀分校）
本文提出一种基于由粗到细扩散模型的交替最小化框架，通过优先重建低频分量来联合校正非刚性运动并重建欠采样 k 空间数据，在 64 倍欠采样下仍表现良好。
This paper considers the problem of undersampled MRI reconstruction. We propose a novel Transformer-based framework for directly processing signal in k-space, going beyond the limitation of regular grids as ConvNets do. We adopt an implicit representation of k-space spectrogram, treating spatial coordinates as inputs, and dynamically query the sparsely sampled points to reconstruct the spectrogram, i.e. learning the inductive bias in k-space. To strike a balance between computational cost and reconstruction quality, we build the decoder with hierarchical structure to generate low-resolution an…
The University of Queensland（昆士兰大学）；The Commonwealth Scientific and Industrial Research Organisation（联邦科学与工业研究组织）；Johns Hopkins University（约翰斯·霍普金斯大学）；University of Science and Technology of China（中国科学技术大学）
Magnetic resonance (MR) images exhibit various contrasts and appearances based on factors such as different acquisition protocols, views, manufacturers, scanning parameters, etc. This generally accessible appearance-related side information affects deep learning-based undersampled magnetic resonance imaging (MRI) reconstruction frameworks, but has been overlooked in the majority of current works. In this paper, we investigate the use of such side information as normalisation parameters in a convolutional neural network (CNN) to improve undersampled MRI reconstruction. Specifically, a Side Info…
University of Amsterdam（阿姆斯特丹大学）；Facebook AI Research（Facebook人工智能研究院）
Most current approaches to undersampled multi-coil MRI reconstruction focus on learning the reconstruction model for a fixed, equidistant acquisition trajectory. In this paper, we study the problem of joint learning of the reconstruction model together with acquisition policies. To this end, we extend the End-to-End Variational Network with learnable acquisition policies that can adapt to different data points. We validate our model on a coil-compressed version of the large scale undersampled multi-coil fastMRI dataset using two undersampling factors: $4\times$ and $8\times$. Our experiments s…
Imperial College London（帝国理工学院）；Royal Brompton Hospital（皇家布朗普顿医院）
Magnetic resonance imaging (MRI) is a widely used non-radiative and non-invasive method for clinical interrogation of organ structures and metabolism, with an inherently long scanning time. Methods by k-space undersampling and deep learning based reconstruction have been popularised to accelerate the scanning process. This work focuses on investigating how powerful transformers are for fast MRI by exploiting and comparing different novel network architectures. In particular, a generative adversarial network (GAN) based Swin transformer (ST-GAN) was introduced for the fast MRI reconstruction. T…
Technion – Israel Institute of Technology（以色列理工学院）
Uncertainty quantification in deep-learning (DL) based image reconstruction models is critical for reliable clinical decision making based on the reconstructed images. We introduce "NPB-REC", a non-parametric fully Bayesian framework for uncertainty assessment in MRI reconstruction from undersampled "k-space" data. We use Stochastic gradient Langevin dynamics (SGLD) during the training phase to characterize the posterior distribution of the network weights. We demonstrated the added-value of our approach on the multi-coil brain MRI dataset, from the fastmri challenge, in comparison to the base…
The University of Queensland（昆士兰大学）；CSIRO（联邦科学与工业研究组织）；Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）
Deep neural networks have been extensively studied for undersampled MRI reconstruction. While achieving state-of-the-art performance, they are trained and deployed specifically for one anatomy with limited generalization ability to another anatomy. Rather than building multiple models, a universal model that reconstructs images across different anatomies is highly desirable for efficient deployment and better generalization. Simply mixing images from multiple anatomies for training a single network does not lead to an ideal universal model due to the statistical shift among datasets of various…
University of Tübingen（图宾根大学）；Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所）
Image-to-image translation plays a vital role in tackling various medical imaging tasks such as attenuation correction, motion correction, undersampled reconstruction, and denoising. Generative adversarial networks have been shown to achieve the state-of-the-art in generating high fidelity images for these tasks. However, the state-of-the-art GAN-based frameworks do not estimate the uncertainty in the predictions made by the network that is essential for making informed medical decisions and subsequent revision by medical experts and has recently been shown to improve the performance and inter…
Accelerated Patient-specific Non-Cartesian MRI Reconstruction using Implicit Neural Representations
University of California, San Francisco（加利福尼亚大学旧金山分校）；University of California, Los Angeles（加利福尼亚大学洛杉矶分校）；Keck School of Medicine, University of Southern California（南加州大学凯克医学院）；University of San Francisco（旧金山大学）
Philips Research（飞利浦研究院）；Philips Healthcare（飞利浦医疗）；Leiden University Medical Center（莱顿大学医学中心）
Adaptive intelligence aims at empowering machine learning techniques with the additional use of domain knowledge. In this work, we present the application of adaptive intelligence to accelerate MR acquisition. Starting from undersampled k-space data, an iterative learning-based reconstruction scheme inspired by compressed sensing theory is used to reconstruct the images. We adopt deep neural networks to refine and correct prior reconstruction assumptions given the training data. The network was trained and tested on a knee MRI dataset from the 2019 fastMRI challenge organized by Facebook AI Re…
Tsinghua Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；Tencent AI Lab（腾讯人工智能实验室）；The Chinese University of Hong Kong（香港中文大学）；University of Texas at Arlington（德克萨斯大学阿灵顿分校）
Recently, deep neural networks have greatly advanced undersampled Magnetic Resonance Image (MRI) reconstruction, wherein most studies follow the one-anatomy-one-network fashion, i.e., each expert network is trained and evaluated for a specific anatomy. Apart from inefficiency in training multiple independent models, such convention ignores the shared de-aliasing knowledge across various anatomies which can benefit each other. To explore the shared knowledge, one naive way is to combine all the data from various anatomies to train an all-round network. Unfortunately, despite the existence of th…
Balancing Fidelity, Utility, and Privacy in Synthetic Cardiac MRI Generation: A Comparative Study
University of Peradeniya, Sri Lanka（斯里兰卡大学）；University of Maryland, College Park, USA（美国马里兰大学 College Park 分校）；Tulane University School of Medicine, USA（美国 Tulane 大学医学院）；Simula Research Laboratory, Norway（挪威 Simula 研究实验室）；SimulaMet, Norway（挪威 SimulaMet）
Fast Controllable Diffusion Models for Undersampled MRI Reconstruction
School of Electrical Engineering and Computer Science, University of Queensland（昆士兰大学电气工程与计算机科学学院）；School of Mathematics and Physics, University of Queensland（昆士兰大学数学与物理学院）
Brigham and Women’s Hospital（布莱根妇女医院）；Harvard Medical School（哈佛医学院）
Magnetic Resonance Imaging (MRI) scans are time consuming and precarious, since the patients remain still in a confined space for extended periods of time. To reduce scanning time, some experts have experimented with undersampled k spaces, trying to use deep learning to predict the fully sampled result. These studies report that as many as 20 to 30 minutes could be saved off a scan that takes an hour or more. However, none of these studies have explored the possibility of using masked image modeling (MIM) to predict the missing parts of MRI k spaces. This study makes use of 11161 reconstructed…
Imperial College London（伦敦帝国理工学院）；City University London（伦敦城市大学）；University of Lincoln（林肯大学）；University College London（伦敦大学学院）
Fast Magnetic Resonance Imaging (MRI) is highly in demand for many clinical applications in order to reduce the scanning cost and improve the patient experience. This can also potentially increase the image quality by reducing the motion artefacts and contrast washout. However, once an image field of view and the desired resolution are chosen, the minimum scanning time is normally determined by the requirement of acquiring sufficient raw data to meet the Nyquist-Shannon sampling criteria. Compressive Sensing (CS) theory has been perfectly matched to the MRI scanning sequence design with much l…
Otto von Guericke University Magdeburg（马格德堡奥托·冯·格里克大学）；Human Technopole（人类技术园）；German Centre for Neurodegenerative Disease（德国神经退行性疾病中心）；Centre for Behavioural Brain Sciences（行为脑科学中心）
Computed tomography and magnetic resonance imaging are two widely used clinical imaging modalities for non-invasive diagnosis. However, both of these modalities come with certain problems. CT uses harmful ionising radiation, and MRI suffers from slow acquisition speed. Both problems can be tackled by undersampling, such as sparse sampling. However, such undersampled data leads to lower resolution and introduces artefacts. Several techniques, including deep learning based methods, have been proposed to reconstruct such data. However, the undersampled reconstruction problem for these two modalit…
Fast and Robust Diffusion Posterior Sampling for MR Image Reconstruction Using the Preconditioned Unadjusted Langevin Algorithm
Institute of Biomedical Imaging, Graz University of Technology, Graz, Austria；Department of Radiology, Boston Children's Hospital, Harvard Medical School, Boston, USA；Chandra Family Department of Electrical Engineering, University of Texas at Austin, USA；Department of Diagnostic Medicine, Dell Medical School, University of Texas at Austin, USA
Inference Stage Denoising for Undersampled MRI Reconstruction
School of Engineering, The University of Edinburgh（爱丁堡大学工程学院）；Department of Electrical and Electronic Engineering and I-X, Imperial College London（帝国理工学院电气与电子工程系及I-X）
Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院保罗·C·劳特伯生物医学成像研究中心）；University of Chinese Academy of Sciences（中国科学院大学）；Department of Electronic Information Engineering, Nanchang University（南昌大学电子信息工程系）；Peng Cheng Laboratory（鹏城实验室）；Pazhou Lab（琶洲实验室）
Image reconstruction from undersampled k-space data plays an important role in accelerating the acquisition of MR data, and a lot of deep learning-based methods have been exploited recently. Despite the achieved inspiring results, the optimization of these methods commonly relies on the fully-sampled reference data, which are time-consuming and difficult to collect. To address this issue, we propose a novel self-supervised learning method. Specifically, during model optimization, two subsets are constructed by randomly selecting part of k-space data from the undersampled data and then fed into…
Model-based Dynamic 3D MRI Reconstructions using Neural Fields and Tensor Product Expansions
Computational Imaging Group for MRI Therapy & Diagnostics, Department of Radiotherapy, University Medical Center Utrecht（MRI治疗与诊断计算成像组，放射治疗系，乌得勒支大学医学中心）
Cine cardiac magnetic resonance (CMR) imaging is considered the gold standard for cardiac function evaluation. However, cine CMR acquisition is inherently slow and in recent decades considerable effort has been put into accelerating scan times without compromising image quality or the accuracy of derived results. In this paper, we present a fully-automated, quality-controlled integrated framework for reconstruction, segmentation and downstream analysis of undersampled cine CMR data. The framework enables active acquisition of radial k-space data, in which acquisition can be stopped as soon as …
Yale University（耶鲁大学）；Chinese Academy of Sciences（中国科学院）；Peng Cheng Laboratory（鹏城实验室）
MRI with multiple protocols is commonly used for diagnosis, but it suffers from a long acquisition time, which yields the image quality vulnerable to say motion artifacts. To accelerate, various methods have been proposed to reconstruct full images from under-sampled k-space data. However, these algorithms are inadequate for two main reasons. Firstly, aliasing artifacts generated in the image domain are structural and non-local, so that sole image domain restoration is insufficient. Secondly, though MRI comprises multiple protocols during one exam, almost all previous studies only employ the r…
School of Biomedical Engineering & Imaging Sciences, King’s College London, UK（伦敦国王学院生物医学工程与成像科学学院）；Technical University of Munich, Germany（慕尼黑工业大学）；Biomedical Image Analysis Group, Imperial College London, UK（帝国理工学院生物医学图像分析组）；Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, London, UK（盖伊和圣托马斯国民健康服务信托基金会成人及儿科心脏病科）；Coimbra Institute for Biomedical Imaging and Translational Research, University of Coimbra, Portugal（科英布拉大学科英布拉生物医学成像与转化研究学院）；Helmholtz Center Munich, Germany（慕尼黑亥姆霍兹中心）
Cine cardiac MRI is routinely acquired for the assessment of cardiac health, but the imaging process is slow and typically requires several breath-holds to acquire sufficient k-space profiles to ensure good image quality. Several undersampling-based reconstruction techniques have been proposed during the last decades to speed up cine cardiac MRI acquisition. However, the undersampling factor is commonly fixed to conservative values before acquisition to ensure diagnostic image quality, potentially leading to unnecessarily long scan times. In this paper, we propose an end-to-end quality-aware c…
Hyperfine Research（Hyperfine研究院）；Yale University（耶鲁大学）；New York University（纽约大学）
While enabling accelerated acquisition and improved reconstruction accuracy, current deep MRI reconstruction networks are typically supervised, require fully sampled data, and are limited to Cartesian sampling patterns. These factors limit their practical adoption as fully-sampled MRI is prohibitively time-consuming to acquire clinically. Further, non-Cartesian sampling patterns are particularly desirable as they are more amenable to acceleration and show improved motion robustness. To this end, we present a fully self-supervised approach for accelerated non-Cartesian MRI reconstruction which …
Bilkent University（比尔肯特大学）；University of Southern California（南加利福尼亚大学）；Hacettepe University（哈杰泰佩大学）
Learning-based synthetic multi-contrast MRI commonly involves deep models trained using high-quality images of source and target contrasts, regardless of whether source and target domain samples are paired or unpaired. This results in undesirable reliance on fully-sampled acquisitions of all MRI contrasts, which might prove impractical due to limitations on scan costs and time. Here, we propose a novel semi-supervised deep generative model that instead learns to recover high-quality target images directly from accelerated acquisitions of source and target contrasts. To achieve this, the propos…
DuDoUniNeXt: Dual-domain unified hybrid model for single and multi-contrast undersampled MRI reconstruction
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China（中国科学技术大学生命科学与医学部生物医学工程学院）；Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advance Research, University of Science and Technology of China（中国科学技术大学苏州高等研究院医学影像、机器人、分析计算与学习中心）；School of Electrical Engineering and Computer Science, The University of Queensland（昆士兰大学电气工程与计算机科学学院）
Phase-contrast magnetic resonance imaging (MRI) provides time-resolved quantification of blood flow dynamics that can aid clinical diagnosis. Long in vivo scan times due to repeated three-dimensional (3D) volume sampling over cardiac phases and breathing cycles necessitate accelerated imaging techniques that leverage data correlations. Standard compressed sensing reconstruction methods require tuning of hyperparameters and are computationally expensive, which diminishes the potential reduction of examination times. We propose an efficient model-based deep neural reconstruction network and eval…
University of Notre Dame（圣母大学）；Pontificia Universidad Católica de Chile（智利天主教大学）
Novel Magnetic Resonance (MR) imaging modalities can quantify hemodynamics but require long acquisition times, precluding its widespread use for early diagnosis of cardiovascular disease. To reduce the acquisition times, reconstruction methods from undersampled measurements are routinely used, that leverage representations designed to increase image compressibility. Reconstructed anatomical and hemodynamic images may present visual artifacts. Although some of these artifact are essentially reconstruction errors, and thus a consequence of undersampling, others may be due to measurement noise or…
Bilkent University（比尔肯特大学）；National Magnetic Resonance Research Center, Bilkent University（比尔肯特大学国家磁共振研究中心）
Supervised reconstruction models are characteristically trained on matched pairs of undersampled and fully-sampled data to capture an MRI prior, along with supervision regarding the imaging operator to enforce data consistency. To reduce supervision requirements, the recent deep image prior framework instead conjoins untrained MRI priors with the imaging operator during inference. Yet, canonical convolutional architectures are suboptimal in capturing long-range relationships, and priors based on randomly initialized networks may yield suboptimal performance. To address these limitations, here …
University of California Los Angeles（加州大学洛杉矶分校）；Siemens Medical Solutions USA, Inc.（西门子医疗系统美国公司）
The recent development of deep learning combined with compressed sensing enables fast reconstruction of undersampled MR images and has achieved state-of-the-art performance for Cartesian k-space trajectories. However, non-Cartesian trajectories such as the radial trajectory need to be transformed onto a Cartesian grid in each iteration of the network training, slowing down the training process and posing inconvenience and delay during training. Multiple iterations of nonuniform Fourier transform in the networks offset the deep learning advantage of fast inference. Current approaches typically …
Deep learning-based image reconstruction methods have achieved promising results across multiple MRI applications. However, most approaches require large-scale fully-sampled ground truth data for supervised training. Acquiring fully-sampled data is often either difficult or impossible, particularly for dynamic contrast enhancement (DCE), 3D cardiac cine, and 4D flow. We present a deep learning framework for MRI reconstruction without any fully-sampled data using generative adversarial networks. We test the proposed method in two scenarios: retrospectively undersampled fast spin echo knee exams…
A plug-and-play synthetic data deep learning for undersampled magnetic resonance image reconstruction
Institute of Artificial Intelligence, Xiamen University（厦门大学人工智能学院）；Xiamen University（厦门大学）；Department of Electronic Science, Fujian Provincial Key Laboratory of Plasma and Magnetic Resonance, Xiamen University（厦门大学电子科学系）；Department of Microelectronics and Integrated Circuit, Xiamen University（厦门大学微电子与集成电路系）
Manhattan College（曼哈顿学院）；University of Iowa（爱荷华大学）
Recent research has explored using neural networks to reconstruct undersampled magnetic resonance imaging (MRI) data. Because of the complexity of the artifacts in the reconstructed images, there is a need to develop task-based approaches of image quality. Common metrics for evaluating image quality like the normalized root mean squared error (NRMSE) and structural similarity (SSIM) are global metrics which average out impact of subtle features in the images. Using measures of image quality which incorporate a subtle signal for a specific task allow for image quality assessment which locally e…
GE Research（通用电气研究院）；GE Healthcare（通用电气医疗）；Mayo Clinic（妙佑医疗国际）；Walter Reed National Military Medical Center（沃尔特里德国家军事医疗中心）；Uniformed Services University（美国三军卫生科学大学）
Purpose: To accelerate brain 3D MRI scans by using a deep learning method for reconstructing images from highly-undersampled multi-coil k-space data Methods: DL-Speed, an unrolled optimization architecture with dense skip-layer connections, was trained on 3D T1-weighted brain scan data to reconstruct complex-valued images from highly-undersampled k-space data. The trained model was evaluated on 3D MPRAGE brain scan data retrospectively-undersampled with a 10-fold acceleration, compared to a conventional parallel imaging method with a 2-fold acceleration. Scores of SNR, artifacts, gray/white ma…
Purpose: Task-based assessment of image quality in undersampled magnetic resonance imaging provides a way of evaluating the impact of regularization on task performance. In this work, we evaluated the effect of total variation (TV) and wavelet regularization on human detection of signals with a varying background and validated a model observer in predicting human performance. Approach: Human observer studies used two-alternative forced choice (2-AFC) trials with a small signal known exactly task but with varying backgrounds for fluid-attenuated inversion recovery images reconstructed from unde…
The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning
King’s College London（伦敦国王学院）；Technical University of Munich（慕尼黑工业大学）；Imperial College London（帝国理工学院）；Guy’s & St. Thomas’ NHS Foundation Trust（盖伊和圣托马斯国民保健服务基金会信托）；Evelina London Children’s Hospital（伊夫琳娜伦敦儿童医院）
Current deep learning-based manifold learning algorithms such as the variational autoencoder (VAE) require fully sampled data to learn the probability density of real-world datasets. Once learned, the density can be used for a variety of tasks, including data imputation. However, fully sampled data is often unavailable in a variety of problems, including the recovery of dynamic and high-resolution MRI data considered in this work. To overcome this problem, we introduce a novel variational approach to learn a manifold from undersampled data. The VAE uses a decoder fed by latent vectors, drawn f…
