Full data acquisition in MRI is inherently slow, which limits clinical throughput and increases patient discomfort. Compressed Sensing MRI (CS-MRI) seeks to accelerate acquisition by reconstructing images from under-sampled k-space data, requiring both an optimal sampling trajectory and a high-fidelity reconstruction model. In this work, we propose a novel active sampling framework that leverages the inherent discrete structure of a pretrained medical image tokenizer and a latent transformer. By representing anatomy through a dictionary of quantized visual tokens, the model provides a well-defined probability distribution over the latent space. We utilize this distribution to derive a principled uncertainty measure via token entropy, which guides the active sampling process. We introduce two strategies to exploit this latent uncertainty: (1) Latent Entropy Selection (LES), projecting patch-wise token entropy into the $k$-space domain to identify informative sampling lines, and (2) Gradient-based Entropy Optimization (GEO), which identifies regions of maximum uncertainty reduction via the $k$-space gradient of a total latent entropy loss. We evaluate our framework on the fastMRI singlecoil Knee and Brain datasets at $\times 8$ and $\times 16$ acceleration. Our results demonstrate that our active policies outperform state-of-the-art baselines in perceptual metrics, and feature-based distances. Our code is available at https://github.com/levayz/TRUST-MRI.
Segmentation of medical images is a challenging task owing to their complexity. A standard segmentation problem within Magnetic Resonance Imaging (MRI) is the task of labeling voxels according to their tissue type. Image segmentation provides volumetric quantification of liver area and thus helps in the diagnosis of disorders, such as Hepatitis, Cirrhosis, Jaundice, Hemochromatosis etc.This work deals with comparison of segmentation by applying Level Set Method,Fuzzy Level Information C-Means Clustering Algorithm and Gradient Vector Flow Snake Algorithm.The results are compared using the param…
WASABI: A Metric for Evaluating Morphometric Plausibility of Synthetic Brain MRIs
Department of Radiology, Weill Cornell Medicine, New York, NY, USA(放射科,韦尔·科恩医学中心,纽约,纽约州,美国);Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA(精神病学与行为科学系,斯坦福大学,斯坦福,加利福尼亚州,美国);Department of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA(电气与计算机工程系,康奈尔大学,伊萨卡,纽约州,美国)
TractGraphFormer: Anatomically Informed Hybrid Graph CNN-Transformer Network for Interpretable Sex and Age Prediction from Diffusion MRI Tractography
Brigham and Women's Hospital, Harvard Medical School(哈佛医学院布莱根妇女医院);University of Electronic Science and Technology of China(电子科技大学);Beth Israel Deaconess Medical Center, Harvard Medical School(哈佛医学院贝斯以色列女执事医疗中心);The University of Sydney(悉尼大学);University of New South Wales(新南威尔士大学);Boston University School of Medicine(波士顿大学医学院);Massachusetts General Hospital, Harvard Medical School(哈佛医学院麻省总医院)
AA-ViT: Anatomically Aware Vision Transformer with Structural and Frequency Guidance for Contrast Enhanced Brain MRI Synthesis
Atlantic Technological University(大西洋理工大学);Belfast Health and Social Care Trust(贝尔法斯特健康和社会关怀信托基金);King’s College Hospital NHS Foundation Trust(国王学院医院国民保健服务信托基金);King’s College London(伦敦国王学院);Queen’s University Belfast(贝尔法斯特女王大学)
Learning Subject-Specific Anatomical Representations via Manifold Expansion: Application to Accelerated Multi-Contrast MRI
Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital(马萨诸塞州总医院阿西诺拉·A·马丁诺斯生物医学成像中心);Harvard Medical School(哈佛医学院);Massachusetts General Hospital(马萨诸塞州总医院)
University of Sherbrooke(舍布鲁克大学);Université de Bourgogne Franche-Comté(勃艮第-弗朗什孔泰大学);CArdiac Simulation & Imaging Software(心脏模拟与成像软件公司);Université de Lyon(里昂大学)
Recent publications have shown that the segmentation accuracy of modern-day convolutional neural networks (CNN) applied on cardiac MRI can reach the inter-expert variability, a great achievement in this area of research. However, despite these successes, CNNs still produce anatomically inaccurate segmentations as they provide no guarantee on the anatomical plausibility of their outcome, even when using a shape prior. In this paper, we propose a cardiac MRI segmentation method which always produces anatomically plausible results. At the core of the method is an adversarial variational autoencod…
University of Florida(佛罗里达大学);Facebook AI Research(脸书人工智能研究院);NYU School of Medicine(纽约大学医学院)
The goal of MRI reconstruction is to restore a high fidelity image from partially observed measurements. This partial view naturally induces reconstruction uncertainty that can only be reduced by acquiring additional measurements. In this paper, we present a novel method for MRI reconstruction that, at inference time, dynamically selects the measurements to take and iteratively refines the prediction in order to best reduce the reconstruction error and, thus, its uncertainty. We validate our method on a large scale knee MRI dataset, as well as on ImageNet. Results show that (1) our system succ…
Radiological imaging of prostate is becoming more popular among researchers and clinicians in searching for diseases, primarily cancer. Scans might be acquired at different times, with patient movement between scans, or with different equipment, resulting in multiple datasets that need to be registered. For this issue, we introduce a registration method using anatomical feature-guided mutual information. Prostate scans of the same patient taken in three different orientations are first aligned for the accurate detection of anatomical features in 3D. Then, our pipeline allows for multiple modal…
Harvard Medical School(哈佛医学院);The University of Sydney(悉尼大学);The University of New South Wales(新南威尔士大学)
The structure and variability of the brain's connections can be investigated via prediction of non-imaging phenotypes using neural networks. However, known neuroanatomical relationships between input features are generally ignored in network design. We propose TractGraphCNN, a novel, anatomically informed graph CNN framework for machine learning tasks using diffusion MRI tractography. An EdgeConv module aggregates features from anatomically similar white matter connections indicated by graph edges, and an attention module enables interpretation of predictive white matter tracts. Results in a s…
Comparative Study of Anatomical and Learned Features in AI Models for Structural Brain MRI
Center for Data Science, New York University(纽约大学数据科学中心);NYU Grossman School of Medicine(纽约大学格罗斯曼医学院);Courant Institute of Mathematical Sciences, NYU(纽约大学柯朗数学科学研究所)
Task-Adaptive 3D Cross-Field MRI Translation via Field-Conditioned Content-Style Pretraining
School of Integrated Circuits and Electronics, Beijing Institute of Technology(北京理工大学集成电路与电子学院);School of Biomedical Engineering, Tsinghua Medicine, Tsinghua University(清华大学医学院生物医学工程学院);Department of Electronic Engineering, The Chinese University of Hong Kong(香港中文大学电子工程系)
Anatomically Faithful Artifact Suppression in SENSE Accelerated Brain MRI
East China Normal University(华东师范大学);Affiliated Hospital of Guizhou Medical University(贵州医科大学附属医院);West China Hospital, Sichuan University(四川大学华西医院);Chinese Academy of Medical Sciences(中国医学科学院);RadioDynamic Medical(镭动医疗);Lucile Packard Children’s Hospital(露西尔·帕卡德儿童医院)
This work addresses the problem of estimating proton density and T1 maps from two partially sampled K-space scans such that the total acquisition time remains approximately the same as a single scan. Existing multi parametric non linear curve fitting techniques require a large number (8 or more) of echoes to estimate the maps resulting in prolonged (clinically infeasible) acquisition times. Our simulation results show that our method yields very accurate and robust results from only two partially sampled scans (total scan time being the same as a single echo MRI). We model PD and T1 maps to be…
Cyclic Self-Supervised Diffusion for Ultra Low-field to High-field MRI Synthesis
Department of Bioengineering and Imperial-X, Imperial College London(生物工程系和Imperial-X,帝国理工学院伦敦分校);Department of Bioengineering, Imperial College London(生物工程系,帝国理工学院伦敦分校);School of Biomedical Engineering, Sun Yat-sen University(生物医学工程学院,中山大学);Monash Biomedical Imaging, Monash University(莫纳什大学生物医学成像)
University of São Paulo(圣保罗大学);Instituto da Criança – HC-FM(儿童研究所——医学院附属医院)
The importance of imaging exams, such as Magnetic Resonance Imaging (MRI), for the diagnostic and follow-up of pediatric pathologies and the assessment of anatomical structures' development has been increasingly highlighted in recent times. Manual analysis of MRIs is time-consuming, subjective, and requires significant expertise. To mitigate this, automatic techniques are necessary. Most techniques focus on adult subjects, while pediatric MRI has specific challenges such as the ongoing anatomical and histological changes related to normal development of the organs, reduced signal-to-noise rati…
Johns Hopkins University School of Medicine(约翰斯·霍普金斯大学医学院);Johns Hopkins University(约翰斯·霍普金斯大学);Johns Hopkins Hospital(约翰斯·霍普金斯医院)
Visualizing disease-induced scarring and fibrosis in the heart on cardiac magnetic resonance (CMR) imaging with contrast enhancement (LGE) is paramount in characterizing disease progression and quantifying pathophysiological substrates of arrhythmias. However, segmentation and scar/fibrosis identification from LGE-CMR is an intensive manual process prone to large inter-observer variability. Here, we present a novel fully-automated anatomically-informed deep learning solution for left ventricle (LV) and scar/fibrosis segmentation and clinical feature extraction from LGE-CMR. The technology invo…
Equivariant symmetry-aware head pose estimation for fetal MRI
MIT Computer Science and Artificial Intelligence Laboratory(麻省理工学院计算机科学与人工智能实验室);Boston Children's Hospital and Harvard Medical School(波士顿儿童医院和哈佛医学院);Inria, Université Côte d'Azur(法国国家科学研究中心(Inria)、蔚蓝海岸大学)
Dynamic Magnetic Resonance Imaging (MRI) is known to be a powerful and reliable technique for the dynamic imaging of internal organs and tissues, making it a leading diagnostic tool. A major difficulty in using MRI in this setting is the relatively long acquisition time (and, hence, increased cost) required for imaging in high spatio-temporal resolution, leading to the appearance of related motion artifacts and decrease in resolution. Compressed Sensing (CS) techniques have become a common tool to reduce MRI acquisition time by subsampling images in the k-space according to some acquisition tr…
Université Côte d’Azur(蔚蓝海岸大学);Inria(法国国家信息与自动化研究所);Centre Antoine Lacassagne(安托万·拉卡桑中心)
Planning of radiotherapy involves accurate segmentation of a large number of organs at risk, i.e. organs for which irradiation doses should be minimized to avoid important side effects of the therapy. We propose a deep learning method for segmentation of organs at risk inside the brain region, from Magnetic Resonance (MR) images. Our system performs segmentation of eight structures: eye, lens, optic nerve, optic chiasm, pituitary gland, hippocampus, brainstem and brain. We propose an efficient algorithm to train neural networks for an end-to-end segmentation of multiple and non-exclusive class…
Evaluation of 3D Counterfactual Brain MRI Generation
Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA Department of Radiology, Stanford University, Stanford, CA, USA Dept. of Psychiatry \& Behavioral Sciences, Stanford University, Stanford, CA, USA Department of Computer Science, Stanford University, Stanford, CA, USA Department of Bioengineering, Stanford University, Stanford, CA, USA Department of Electrical Engineering, Stanford University, Stanford, CA, USA
Fraunhofer MEVIS: Institute for Digital Medicine(弗劳恩霍夫数字医学MEVIS研究所);icometrix(icometrix公司);Universitätsklinikum Knappschaftskrankenhaus Bochum(波鸿克纳普沙夫特医院大学诊所)
In this work, we compare five deep learning solutions to automatically segment the resection cavity in postoperative MRI. The proposed methods are based on the same 3D U-Net architecture. We use a dataset of postoperative MRI volumes, each including four MRI sequences and the ground truth of the corresponding resection cavity. Four solutions are trained with a different MRI sequence. Besides, a method designed with all the available sequences is also presented. Our experiments show that the method trained only with the T1 weighted contrast-enhanced MRI sequence achieves the best results, with …
AnyCXR: Human Anatomy Segmentation of Chest X-ray at Any Acquisition Position using Multi-stage Domain Randomized Synthetic Data with Imperfect Annotations and Conditional Joint Annotation Regularization Learning
Department of Radiology, Northwestern University, Chicago, IL, USA(西北大学放射科);Data Science Institute, Vanderbilt University, Nashville, TN, USA(范德比尔特大学数据科学研究院);Department of Orthopedics, The Second Hospital of Shanxi Medical University, Taiyuan, Shanxi, P.R. China(山西医科大学第二医院骨科);Second Clinical Medical College, Shanxi Medical University, Taiyuan, Shanxi, P.R. China(山西医科大学第二临床医学院);School of Computer Science, University of Sydney, Sydney, NSW, Australia(悉尼大学计算机科学学院)
Vanderbilt University(范德堡大学);Vanderbilt University Medical Center(范德堡大学医学中心);Incyte Corporation(因赛特公司)
The findings of splenomegaly, abnormal enlargement of the spleen, is a non-invasive clinical biomarker for liver and spleen disease. Automated segmentation methods are essential to efficiently quantify splenomegaly from clinically acquired abdominal magnetic resonance imaging (MRI) scans. However, the task is challenging due to (1) large anatomical and spatial variations of splenomegaly, (2) large inter- and intra-scan intensity variations on multi-modal MRI, and (3) limited numbers of labeled splenomegaly scans. In this paper, we propose the Splenomegaly Segmentation Network (SS-Net) to intro…
University of Amsterdam(阿姆斯特丹大学);Facebook AI Research(Facebook人工智能研究院)
Most current approaches to undersampled multi-coil MRI reconstruction focus on learning the reconstruction model for a fixed, equidistant acquisition trajectory. In this paper, we study the problem of joint learning of the reconstruction model together with acquisition policies. To this end, we extend the End-to-End Variational Network with learnable acquisition policies that can adapt to different data points. We validate our model on a coil-compressed version of the large scale undersampled multi-coil fastMRI dataset using two undersampling factors: $4\times$ and $8\times$. Our experiments s…
Computational Radiology Laboratory, Boston Children’s Hospital(波士顿儿童医院计算放射实验室);Harvard Medical School(哈佛医学院)
Fast data acquisition in Magnetic Resonance Imaging (MRI) is vastly in demand and scan time directly depends on the number of acquired k-space samples. Recently, the deep learning-based MRI reconstruction techniques were suggested to accelerate MR image acquisition. The most common issues in any deep learning-based MRI reconstruction approaches are generalizability and transferability. For different MRI scanner configurations using these approaches, the network must be trained from scratch every time with new training dataset, acquired under new configurations, to be able to provide good recon…
Deep Learning-Based Diffusion MRI Tractography: Integrating Spatial and Anatomical Information
School of Biomedical Engineering, Southern Medical University(南方医科大学生物医学工程学院);School of Computer Science and Technology, Nanjing University of Science and Technology(南京理工大学计算机科学与技术学院);Shunde Hospital, Southern Medical University(南方医科大学顺德医院)
Harvard Medical School(哈佛医学院);Boston Children’s Hospital(波士顿儿童医院)
Fast data acquisition in Magnetic Resonance Imaging (MRI) is vastly in demand and scan time directly depends on the number of acquired k-space samples. Conventional MRI reconstruction methods for fast MRI acquisition mostly relied on different regularizers which represent analytical models of sparsity. However, recent data-driven methods based on deep learning has resulted in promising improvements in image reconstruction algorithms. In this paper, we propose a deep plug-and-play prior framework for parallel MRI reconstruction problems which utilize a deep neural network (DNN) as an advanced d…
Closed-loop coupling of personalised and foundation models for real-time treatment guidance with MRI
Image X Institute, Sydney School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia(悉尼大学医学与健康学院悉尼健康科学学院Image X研究所,悉尼,澳大利亚);GenesisCare, Sydney, Australia(GenesisCare,悉尼,澳大利亚);School of Clinical Medicine, Medicine & Health, University of New South Wales, Sydney, Australia(新南威尔士大学医学与健康学院临床医学系,悉尼,澳大利亚);Centre for Medical Radiation Physics, School of Mathematics and Physics, University of Wollongong, Wollongong, Australia(伍伦贡大学数学与物理学院医学辐射物理中心,伍伦贡,澳大利亚)
Rutgers University(罗格斯大学);United Imaging Intelligence(联影智能);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Accurate estimation of shape thickness from medical images is crucial in clinical applications. For example, the thickness of myocardium is one of the key to cardiac disease diagnosis. While mathematical models are available to obtain accurate dense thickness estimation, they suffer from heavy computational overhead due to iterative solvers. To this end, we propose novel methods for dense thickness estimation, including a fast solver that estimates thickness from binary annular shapes and an end-to-end network that estimates thickness directly from raw cardiac images.We test the proposed model…
University of Cambridge(剑桥大学);ShanghaiTech University(上海科技大学);Zhejiang University of Technology(浙江工业大学);Northwest University(西北大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能医疗科技有限公司)
Recent studies on T1-assisted MRI reconstruction for under-sampled images of other modalities have demonstrated the potential of further accelerating MRI acquisition of other modalities. Most of the state-of-the-art approaches have achieved improvement through the development of network architectures for fixed under-sampling patterns, without fully exploiting the complementary information between modalities. Although existing under-sampling pattern learning algorithms can be simply modified to allow the fully-sampled T1-weighted MR image to assist the pattern learning, no significant improveme…
SRMA-Mamba: Spatial Reverse Mamba Attention Network for Pathological Liver Segmentation in MRI Volumes
Chongqing University of Posts and Telecommunications(重庆邮电大学);Biomedical Perception & Intelligence Lab, University of South Dakota(南达科他大学生物医学感知与智能实验室);Aalto University(阿尔托大学);Malaviya National Institute of Technology Jaipur(马拉维亚国家理工学院斋浦尔分校);Machine & Hybrid Intelligence Lab, Northwestern University(西北大学机器与混合智能实验室)
Evaluating the Predictive Value of Preoperative MRI for Erectile Dysfunction Following Radical Prostatectomy
University of Amsterdam(阿姆斯特丹大学);Antoni van Leeuwenhoek-Netherlands Cancer Institute(安托尼·范·列文霍克-荷兰癌症研究所);Department of Urology(泌尿科部);AI Technology for Life(人工智能技术生命);Utrecht University(乌特勒支大学);GROW School for Oncology and Developmental Biology(GROW肿瘤学与发育生物学学院)
University of Waterloo(滑铁卢大学);University of Toronto(多伦多大学);Sunnybrook Research Institute(桑尼布鲁克研究所)
Magnetic Resonance Imaging (MRI) is a crucial medical imaging technology for the screening and diagnosis of frequently occurring cancers. However image quality may suffer by long acquisition times for MRIs due to patient motion, as well as result in great patient discomfort. Reducing MRI acquisition time can reduce patient discomfort and as a result reduces motion artifacts from the acquisition process. Compressive sensing strategies, when applied to MRI, have been demonstrated to be effective at decreasing acquisition times significantly by sparsely sampling the \emph{k}-space during the acqu…
BrainNormalizer: Anatomy-Informed Pseudo-Healthy Brain Reconstruction from Tumor MRI via Edge-Guided ControlNet
University of Pittsburgh(匹兹堡大学);Georgia Institute of Technology(佐治亚理工学院);University of Texas at Austin(德克萨斯大学奥斯汀分校);Cedars-Sinai Medical Center(西德萨斯医疗中心);Mayo Clinic Arizona(梅奥诊所亚利桑那分部)
Carotid artery vessel wall thickness measurement is an essential step in the monitoring of patients with atherosclerosis. This requires accurate segmentation of the vessel wall, i.e., the region between an artery's lumen and outer wall, in black-blood magnetic resonance (MR) images. Commonly used convolutional neural networks (CNNs) for semantic segmentation are suboptimal for this task as their use does not guarantee a contiguous ring-shaped segmentation. Instead, in this work, we cast vessel wall segmentation as a multi-task regression problem in a polar coordinate system. For each carotid a…
Harvard Medical School(哈佛医学院);Massachusetts General Hospital(麻省总医院);California Institute of Technology(加州理工学院);Massachusetts Institute of Technology(麻省理工学院)
In neuroimaging, MRI tissue properties characterize underlying neurobiology, provide quantitative biomarkers for neurological disease detection and analysis, and can be used to synthesize arbitrary MRI contrasts. Estimating tissue properties from a single scan session using a protocol available on all clinical scanners promises to reduce scan time and cost, enable quantitative analysis in routine clinical scans and provide scan-independent biomarkers of disease. However, existing tissue properties estimation methods - most often $\mathbf{T_1}$ relaxation, $\mathbf{T_2^*}$ relaxation, and proto…
Magnetic Resonance Imaging (MRI) has long been considered to be among "the gold standards" of diagnostic medical imaging. The long acquisition times, however, render MRI prone to motion artifacts, let alone their adverse contribution to the relative high costs of MRI examination. Over the last few decades, multiple studies have focused on the development of both physical and post-processing methods for accelerated acquisition of MRI scans. These two approaches, however, have so far been addressed separately. On the other hand, recent works in optical computational imaging have demonstrated gro…