Self-Consistent Nested Diffusion Bridge for Accelerated MRI Reconstruction
School of Information Science and Technology, Fudan University, Shanghai, China(复旦大学信息科学与技术学院);Department of Data Science & AI, Faculty of Information Technology, Monash University, Melbourne, Australia(墨尔本大学信息科技学院数据科学与人工智能系);Nuffield Department of Clinical Neurosciences, University of Oxford, London, UK(牛津大学临床神经科学系);School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu, China(电子科技大学机械与电子工程学院);Department of Radiology, Sichuan Provincial People’s Hospital, Chengdu, China(四川省人民医院放射科);Department of Radiology, Zhongda Hospital, Medical School, Southeast University, Nanjing, China(东南大学医学院中大医院放射科);Shanghai AI Lab, Shanghai, China(上海人工智能实验室);Sensetime Research, Shanghai, China(商汤研究)
Tao Song, Yicheng Wu, Minhao Hu, Xiangde Luo, Guoting Luo, Guotai Wang, Yi Guo, Feng Xu, Shaoting Zhang
Accelerated MRI reconstruction plays a vital role in reducing scan time while preserving image quality. While most existing methods rely on complex-valued image-space or k-space data, these formats are often inaccessible in clinical practice due to proprietary reconstruction pipelines, leaving only magnitude images stored in DICOM files. To address this gap, we focus on the underexplored task of magnitude-image-based MRI reconstruction. Recent advancements in diffusion models, particularly denoising diffusion probabilistic models (DDPMs), have demonstrated strong capabilities in modeling image priors. However, their task-agnostic denoising nature limits performance in source-to-target image translation tasks, such as MRI reconstruction. In this work, we propose a novel Self-Consistent Nested Diffusion Bridge (SC-NDB) framework that models accelerated MRI reconstruction as a bi-directional image translation process between under-sampled and fully-sampled magnitude MRI images. SC-NDB introduces a nested diffusion architecture with a self-consistency constraint and reverse bridge diffusion pathways to improve intermediate prediction fidelity and better capture the explicit priors of source images. Furthermore, we incorporate a Contour Decomposition Embedding Module (CDEM) to inject structural and textural knowledge by leveraging Laplacian pyramids and directional filter banks. Extensive experiments on the fastMRI and IXI datasets demonstrate that our method achieves state-of-the-art performance compared to both magnitude-based and non-magnitude-based diffusion models, confirming the effectiveness and clinical relevance of SC-NDB.
Dual-domain Multi-path Self-supervised Diffusion Model for Accelerated MRI Reconstruction
Department of Radiology, Northwestern University(放射科,西北大学);Department of Biomedical Engineering, Huazhong University of Science and Technology(生物医学工程系,华中科技大学)
Noise Level Adaptive Diffusion Model for Robust Reconstruction of Accelerated MRI
Shenzhen Technology University(深圳技术大学);Medical Center Göttingen University(哥廷根大学医学中心);The Chinese University of Hong Kong(香港中文大学);Longgang Central Hospital of Shenzhen(深圳市龙岗中心医院)
Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院)
Score-based diffusion models provide a powerful way to model images using the gradient of the data distribution. Leveraging the learned score function as a prior, here we introduce a way to sample data from a conditional distribution given the measurements, such that the model can be readily used for solving inverse problems in imaging, especially for accelerated MRI. In short, we train a continuous time-dependent score function with denoising score matching. Then, at the inference stage, we iterate between numerical SDE solver and data consistency projection step to achieve reconstruction. Ou…
Accelerated Patient-specific Non-Cartesian MRI Reconstruction using Implicit Neural Representations
University of California, San Francisco(加利福尼亚大学旧金山分校);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Keck School of Medicine, University of Southern California(南加州大学凯克医学院);University of San Francisco(旧金山大学)
Multi-contrast MRI acquisitions of an anatomy enrich the magnitude of information available for diagnosis. Yet, excessive scan times associated with additional contrasts may be a limiting factor. Two mainstream approaches for enhanced scan efficiency are reconstruction of undersampled acquisitions and synthesis of missing acquisitions. In reconstruction, performance decreases towards higher acceleration factors with diminished sampling density particularly at high-spatial-frequencies. In synthesis, the absence of data samples from the target contrast can lead to artefactual sensitivity or inse…
Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院(KAIST));Seoul National University College of Medicine, Seoul National University Bundang Hospital(首尔大学医学院,首尔大学盆唐医院)
Recently, deep learning approaches for accelerated MRI have been extensively studied thanks to their high performance reconstruction in spite of significantly reduced runtime complexity. These neural networks are usually trained in a supervised manner, so matched pairs of subsampled and fully sampled k-space data are required. Unfortunately, it is often difficult to acquire matched fully sampled k-space data, since the acquisition of fully sampled k-space data requires long scan time and often leads to the change of the acquisition protocol. Therefore, unpaired deep learning without matched la…
Adaptive Diffusion Priors for Accelerated MRI Reconstruction
Bilkent University(比尔肯特大学);National Magnetic Resonance Research Center (UMRAM)(国家磁共振研究中心(UMRAM));ASELSAN Research Center(ASELSAN研究中心);Amasya University(阿马西亚大学)
Accelerating Stroke MRI with Diffusion Probabilistic Models through Large-Scale Pre-training and Target-Specific Fine-Tuning
Chandra Family Department of Electrical and Computer Engineering(查克拉家族电气与计算机工程系);Department of Imaging Physics(成像物理系);Dell Medical School Department of Neurology(德莱尔医学院神经学系);Dell Medical School Department of Neurosurgery(德莱尔医学院神经外科系);Dell Medical School Department of Diagnostic Medicine(德莱尔医学院诊断医学系);Oden Institute for Computational Engineering and Sciences(奥登计算工程与科学研究院)
Phase-map synthesis from magnitude-only MR images using conditional score-based diffusion models with application in training of accelerated MRI reconstruction models
High-Frequency Space Diffusion Models for Accelerated MRI
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Shenzhen University(深圳大学);Pazhou Lab(琶洲实验室)
SPIRiT-Diffusion: Self-Consistency Driven Diffusion Model for Accelerated MRI
Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院劳特伯生物医学成像研究中心);Research Center for Medical AI, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院医学人工智能研究中心);School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University(深圳大学医学部生物医学工程学院)
Athinoula A. Martinos Center for Biomedical Imaging(阿西努拉·A·马蒂诺斯生物医学成像中心);Massachusetts General Hospital(马萨诸塞州总医院);Harvard Medical School(哈佛医学院);Boston University(波士顿大学);Harvard University(哈佛大学)
Low-field (LF) MRI scanners have the power to revolutionize medical imaging by providing a portable and cheaper alternative to high-field MRI scanners. However, such scanners are usually significantly noisier and lower quality than their high-field counterparts. The aim of this paper is to improve the SNR and overall image quality of low-field MRI scans to improve diagnostic capability. To address this issue, we propose a Nested U-Net neural network architecture super-resolution algorithm that outperforms previously suggested deep learning methods with an average PSNR of 78.83 and SSIM of 0.95…
Facebook AI Research(Facebook人工智能研究);fastMRI team(fastMRI团队)
Deep learning approaches to accelerated MRI take a matrix of sampled Fourier-space lines as input and produce a spatial image as output. In this work we show that by careful choice of the offset used in the sampling procedure, the symmetries in k-space can be better exploited, producing higher quality reconstructions than given by standard equally-spaced samples or randomized samples motivated by compressed sensing.
Bilkent University(比尔肯特大学);National Magnetic Resonance Research Center (UMRAM)(国家磁共振研究中心(UMRAM));Neuroscience Program, Aysel Sabuncu Brain Research Center, Bilkent University(比尔肯特大学艾塞尔·萨本居脑研究中心神经科学项目)
Deep neural networks (DNNs) have recently found emerging use in accelerated MRI reconstruction. DNNs typically learn data-driven priors from large datasets constituting pairs of undersampled and fully-sampled acquisitions. Acquiring such large datasets, however, might be impractical. To mitigate this limitation, we propose a few-shot learning approach for accelerated MRI that merges subject-driven priors obtained via physical signal models with data-driven priors obtained from a few training samples. Demonstrations on brain MR images from the NYU fastMRI dataset indicate that the proposed appr…
Monash Biomedical Imaging, Monash University(莫纳什大学生物医学成像中心);Department of Electrical and Computer Systems Engineering, Monash University(莫纳什大学电气与计算机系统工程系);School of Psychological Sciences, Monash University(莫纳什大学心理科学学院);Department of Data Science and AI, Monash University(莫纳什大学数据科学与人工智能系)
Global correlations are widely seen in human anatomical structures due to similarity across tissues and bones. These correlations are reflected in magnetic resonance imaging (MRI) scans as a result of close-range proton density and T1/T2 parameters. Furthermore, to achieve accelerated MRI, k-space data are undersampled which causes global aliasing artifacts. Convolutional neural network (CNN) models are widely utilized for accelerated MRI reconstruction, but those models are limited in capturing global correlations due to the intrinsic locality of the convolution operation. The self-attention-…
Facebook AI Research (FAIR)(Facebook人工智能研究院(FAIR));NYU School of Medicine(纽约大学医学院)
The slow acquisition speed of magnetic resonance imaging (MRI) has led to the development of two complementary methods: acquiring multiple views of the anatomy simultaneously (parallel imaging) and acquiring fewer samples than necessary for traditional signal processing methods (compressed sensing). While the combination of these methods has the potential to allow much faster scan times, reconstruction from such undersampled multi-coil data has remained an open problem. In this paper, we present a new approach to this problem that extends previously proposed variational methods by learning ful…
Evaluation of Machine Learning Reconstruction Techniques for Accelerated Brain MRI Scans
Humber River Hospital(亨伯河医院);Toronto Western Hospital, University of Toronto(多伦多大学多伦多西区医院);Foqus Technologies Inc.(Foqus 技术公司);Robarts Research Institute, Western University(西安大略大学罗巴茨研究所)
Yale University(耶鲁大学);New York University(纽约大学);Hyperfine Research(Hyperfine研究公司)
Multi-contrast MRI (MC-MRI) captures multiple complementary imaging modalities to aid in radiological decision-making. Given the need for lowering the time cost of multiple acquisitions, current deep accelerated MRI reconstruction networks focus on exploiting the redundancy between multiple contrasts. However, existing works are largely supervised with paired data and/or prohibitively expensive fully-sampled MRI sequences. Further, reconstruction networks typically rely on convolutional architectures which are limited in their capacity to model long-range interactions and may lead to suboptima…
Bilkent University(比尔肯特大学);University of Southern California(南加利福尼亚大学);Hacettepe University(哈杰泰佩大学)
Learning-based synthetic multi-contrast MRI commonly involves deep models trained using high-quality images of source and target contrasts, regardless of whether source and target domain samples are paired or unpaired. This results in undesirable reliance on fully-sampled acquisitions of all MRI contrasts, which might prove impractical due to limitations on scan costs and time. Here, we propose a novel semi-supervised deep generative model that instead learns to recover high-quality target images directly from accelerated acquisitions of source and target contrasts. To achieve this, the propos…
Unrolled neural networks have recently achieved state-of-the-art accelerated MRI reconstruction. These networks unroll iterative optimization algorithms by alternating between physics-based consistency and neural-network based regularization. However, they require several iterations of a large neural network to handle high-dimensional imaging tasks such as 3D MRI. This limits traditional training algorithms based on backpropagation due to prohibitively large memory and compute requirements for calculating gradients and storing intermediate activations. To address this challenge, we propose Gre…
Accelerating magnetic resonance image (MRI) reconstruction process is a challenging ill-posed inverse problem due to the excessive under-sampling operation in k-space. In this paper, we propose a recurrent transformer model, namely ReconFormer, for MRI reconstruction which can iteratively reconstruct high fertility magnetic resonance images from highly under-sampled k-space data. In particular, the proposed architecture is built upon Recurrent Pyramid Transformer Layers (RPTL), which jointly exploits intrinsic multi-scale information at every architecture unit as well as the dependencies of th…
Microsoft Research(微软研究院);University of Pennsylvania(宾夕法尼亚大学)
Accelerated MRI reconstructs images of clinical anatomies from sparsely sampled signal data to reduce patient scan times. While recent works have leveraged deep learning to accomplish this task, such approaches have often only been explored in simulated environments where there is no signal corruption or resource limitations. In this work, we explore augmentations to neural network MRI image reconstructors to enhance their clinical relevancy. Namely, we propose a ConvNet model for detecting sources of image artifacts that achieves a classifier $F_2$ score of 79.1%. We also demonstrate that tra…
Netherlands Cancer Institute(荷兰癌症研究所);qurAI group(qurAI团队);University of Amsterdam(阿姆斯特丹大学)
Magnetic Resonance Imaging can produce detailed images of the anatomy and physiology of the human body that can assist doctors in diagnosing and treating pathologies such as tumours. However, MRI suffers from very long acquisition times that make it susceptible to patient motion artifacts and limit its potential to deliver dynamic treatments. Conventional approaches such as Parallel Imaging and Compressed Sensing allow for an increase in MRI acquisition speed by reconstructing MR images from sub-sampled MRI data acquired using multiple receiver coils. Recent advancements in Deep Learning combi…
Xiamen University(厦门大学);Xiamen University of Technology(厦门理工学院);United Imaging Research Institute of Intelligent Imaging(联影智能影像研究院);Nanjing Medical University(南京医科大学);University of Texas at Austin(德克萨斯大学奥斯汀分校)
Deep learning has shown astonishing performance in accelerated magnetic resonance imaging (MRI). Most state-of-the-art deep learning reconstructions adopt the powerful convolutional neural network and perform 2D convolution since many magnetic resonance images or their corresponding k-space are in 2D. In this work, we present a new approach that explores the 1D convolution, making the deep network much easier to be trained and generalized. We further integrate the 1D convolution into the proposed deep network, named as One-dimensional Deep Low-rank and Sparse network (ODLS), which unrolls the …
Machine learning and artificial intelligence have shown remarkable performance in accelerated magnetic resonance imaging (MRI). Cloud computing technologies have great advantages in building an easily accessible platform to deploy advanced algorithms. In this work, we develop an open-access, easy-to-use and high-performance medical intelligence cloud computing platform (XCloud-pFISTA) to reconstruct MRI images from undersampled k-space data. Two state-of-the-art approaches of the Projected Fast Iterative Soft-Thresholding Algorithm (pFISTA) family have been successfully implemented on the clou…
Hyperfine Research(Hyperfine研究院);Yale University(耶鲁大学);New York University(纽约大学)
While enabling accelerated acquisition and improved reconstruction accuracy, current deep MRI reconstruction networks are typically supervised, require fully sampled data, and are limited to Cartesian sampling patterns. These factors limit their practical adoption as fully-sampled MRI is prohibitively time-consuming to acquire clinically. Further, non-Cartesian sampling patterns are particularly desirable as they are more amenable to acceleration and show improved motion robustness. To this end, we present a fully self-supervised approach for accelerated non-Cartesian MRI reconstruction which …
Technion - Israel Institute of Technology(以色列理工学院)
Magnetic Resonance Imaging (MRI) has long been considered to be among the gold standards of today's diagnostic imaging. The most significant drawback of MRI is long acquisition times, prohibiting its use in standard practice for some applications. Compressed sensing (CS) proposes to subsample the k-space (the Fourier domain dual to the physical space of spatial coordinates) leading to significantly accelerated acquisition. However, the benefit of compressed sensing has not been fully exploited; most of the sampling densities obtained through CS do not produce a trajectory that obeys the string…
Department of Electrical and Computer Engineering, University of Minnesota(明尼苏达大学电气与计算机工程系)
Long scan duration remains a challenge for high-resolution MRI. Deep learning has emerged as a powerful means for accelerated MRI reconstruction by providing data-driven regularizers that are directly learned from data. These data-driven priors typically remain unchanged for future data in the testing phase once they are learned during training. In this study, we propose to use a transfer learning approach to fine-tune these regularizers for new subjects using a self-supervision approach. While the proposed approach can compromise the extremely fast reconstruction time of deep learning MRI met…
Unrolled neural networks have enabled state-of-the-art reconstruction performance and fast inference times for the accelerated magnetic resonance imaging (MRI) reconstruction task. However, these approaches depend on fully-sampled scans as ground truth data which is either costly or not possible to acquire in many clinical medical imaging applications; hence, reducing dependence on data is desirable. In this work, we propose modeling the proximal operators of unrolled neural networks with scale-equivariant convolutional neural networks in order to improve the data-efficiency and robustness to …
University of Birmingham(伯明翰大学);Imperial College London(帝国理工学院);MRC London Institute of Medical Sciences(MRC伦敦医学科学研究所)
In this work, we propose a deep learning approach for parallel magnetic resonance imaging (MRI) reconstruction, termed a variable splitting network (VS-Net), for an efficient, high-quality reconstruction of undersampled multi-coil MR data. We formulate the generalized parallel compressed sensing reconstruction as an energy minimization problem, for which a variable splitting optimization method is derived. Based on this formulation we propose a novel, end-to-end trainable deep neural network architecture by unrolling the resulting iterative process of such variable splitting scheme. VS-Net is …
Anatomically Faithful Artifact Suppression in SENSE Accelerated Brain MRI
East China Normal University(华东师范大学);Affiliated Hospital of Guizhou Medical University(贵州医科大学附属医院);West China Hospital, Sichuan University(四川大学华西医院);Chinese Academy of Medical Sciences(中国医学科学院);RadioDynamic Medical(镭动医疗);Lucile Packard Children’s Hospital(露西尔·帕卡德儿童医院)
Magnetic resonance imaging (MRI) is a cornerstone of modern medical imaging. However, long image acquisition times, the need for qualitative expert analysis, and the lack of (and difficulty extracting) quantitative indicators that are sensitive to tissue health have curtailed widespread clinical and research studies. While recent machine learning methods for MRI reconstruction and analysis have shown promise for reducing this burden, these techniques are primarily validated with imperfect image quality metrics, which are discordant with clinically-relevant measures that ultimately hamper clini…
Magnetic Resonance Imaging (MRI) is considered today the golden-standard modality for soft tissues. The long acquisition times, however, make it more prone to motion artifacts as well as contribute to the relatively high costs of this examination. Over the years, multiple studies concentrated on designing reduced measurement schemes and image reconstruction schemes for MRI, however, these problems have been so far addressed separately. On the other hand, recent works in optical computational imaging have demonstrated growing success of the simultaneous learning-based design of the acquisition …
CMRxRecon2024: A Multi-Modality, Multi-View K-Space Dataset Boosting Universal Machine Learning for Accelerated Cardiac MRI
Xiamen University(厦门大学);Imperial College London(帝国理工学院);Royal Brompton Hospital(皇家布朗普顿医院);Brigham and Women’s Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);Fudan University(复旦大学);Shanghai Jiao Tong University School of Medicine(上海交通大学医学院);University of Shanghai for Science and Technology(上海理工大学);GE Healthcare(通用电气医疗集团);Siemens Healthineers Ltd.(西门子医疗有限公司);The Hong Kong Polytechnic University(香港理工大学);Pontificia Universidad Católica de Chile(智利天主教大学)
Rice University(莱斯大学);Technical University of Munich(慕尼黑工业大学)
Convolutional Neural Networks (CNNs) are highly effective for image reconstruction problems. Typically, CNNs are trained on large amounts of training images. Recently, however, un-trained CNNs such as the Deep Image Prior and Deep Decoder have achieved excellent performance for image reconstruction problems such as denoising and inpainting, \emph{without using any training data}. Motivated by this development, we address the reconstruction problem arising in accelerated MRI with un-trained neural networks. We propose a highly optimized un-trained recovery approach based on a variation of the D…
TC-KANRecon: High-Quality and Accelerated MRI Reconstruction via Adaptive KAN Mechanisms and Intelligent Feature Scaling
Hangzhou Dianzi University(杭州电子科技大学);Southern Medical University(南方医科大学);Shenzhen Research Institute of Big Data(深圳大数据研究院);Nanchang University(南昌大学);Gannan Normal University(赣南师范大学)
提出条件引导扩散模型 TC-KANRecon,通过 MF-UKAN、动态裁剪及全采样 k 空间融合,在高噪声、低采样率下实现高质量加速 MRI 重建。
Learning Task-Specific Strategies for Accelerated MRI
California Institute of Technology(加州理工学院);Massachusetts Institute of Technology(麻省理工学院);Athinoula A. Martinos Center for Biomedical Imaging(阿西努拉·A.马蒂诺斯生物医学成像中心);MGH(麻省总医院);Harvard Medical School(哈佛医学院)