Self-Supervised k-Space Regularization for Motion-Resolved Abdominal MRI Using Neural Implicit k-Space Representation
Helmholtz Center Munich（慕尼黑亥姆霍兹中心）；Technical University of Munich（慕尼黑工业大学）；Imperial College London（伦敦帝国学院）；Millenium Institute for Intelligent Healthcare Engineering（千禧智能医疗工程研究所）；Pontificia Universidad Católica de Chile（智利天主教大学）；King’s College London（伦敦国王学院）
Veronika Spieker, Hannah Eichhorn, Jonathan K. Stelter, Wenqi Huang, Rickmer F. Braren, Daniel Rückert, Francisco Sahli Costabal, Kerstin Hammernik, Claudia Pri… 展开作者
Veronika Spieker, Hannah Eichhorn, Jonathan K. Stelter, Wenqi Huang, Rickmer F. Braren, Daniel Rückert, Francisco Sahli Costabal, Kerstin Hammernik, Claudia Prieto, Dimitrios C. Karampinos, Julia A. Schnabel
Neural implicit k-space representations have shown promising results for dynamic MRI at high temporal resolutions. Yet, their exclusive training in k-space limits the application of common image regularization methods to improve the final reconstruction. In this work, we introduce the concept of parallel imaging-inspired self-consistency (PISCO), which we incorporate as novel self-supervised k-space regularization enforcing a consistent neighborhood relationship. At no additional data cost, the proposed regularization significantly improves neural implicit k-space reconstructions on simulated data. Abdominal in-vivo reconstructions using PISCO result in enhanced spatio-temporal image quality compared to state-of-the-art methods. Code is available at https://github.com/vjspi/PISCO-NIK.
Adhesions are an important cause of chronic pain following abdominal surgery. Recent developments in abdominal cine-MRI have enabled the non-invasive diagnosis of adhesions. Adhesions are identified on cine-MRI by the absence of sliding motion during movement. Diagnosis and mapping of adhesions improves the management of patients with pain. Detection of abdominal adhesions on cine-MRI is challenging from both a radiological and deep learning perspective. We focus on classifying presence or absence of adhesions in sagittal abdominal cine-MRI series. We experimented with spatio-temporal deep lea…
MRISegmentator-Abdomen: A Fully Automated Multi-Organ and Structure Segmentation Tool for T1-weighted Abdominal MRI
Radiology and Imaging Sciences（放射学与影像科学）；National Institutes of Health Clinical Center（国家卫生研究院临床中心）；Walter Reed National Military Medical Center（沃尔特·里德国家军事医学中心）；Biostatistics and Clinical Epidemiology Services（生物统计与临床流行病学服务）
DyABD: The Abdominal Muscle Segmentation in Dynamic MRI Benchmark
Science Foundation Ireland Centre for Research Training in Machine Learning（科学基金会爱尔兰机器学习研究培训中心）；Aix Marseille Univ, Univ Gustave Eiffel, LBA, Marseille France（马赛大学，奥古斯特·埃菲尔大学，LBA，法国马赛）；Aix Marseille Université, CNRS, CRMBM UMR 7339, Marseille France（马赛大学，法国国家科学研究中心，CRMBM UMR 7339，法国马赛）；Insight Centre for Data Analytics, University College Dublin（都柏林大学数据分析洞察中心）
German Center for Neurodegenerative Diseases (DZNE)（德国神经退行性疾病中心（DZNE））；University of Bonn（波恩大学）
Purpose: Development of a fast and fully automated deep learning pipeline (FatSegNet) to accurately identify, segment, and quantify abdominal adipose tissue on Dixon MRI from the Rhineland Study - a large prospective population-based study. Method: FatSegNet is composed of three stages: (i) consistent localization of the abdominal region using two 2D-Competitive Dense Fully Convolutional Networks (CDFNet), (ii) segmentation of adipose tissue on three views by independent CDFNets, and (iii) view aggregation. FatSegNet is trained with 33 manually annotated subjects, and validated by: 1) comparis…
Automated abdominal multi-organ segmentation is a crucial yet challenging task in the computer-aided diagnosis of abdominal organ-related diseases. Although numerous deep learning models have achieved remarkable success in many medical image segmentation tasks, accurate segmentation of abdominal organs remains challenging, due to the varying sizes of abdominal organs and the ambiguous boundaries among them. In this paper, we propose a boundary-aware network (BA-Net) to segment abdominal organs on CT scans and MRI scans. This model contains a shared encoder, a boundary decoder, and a segmentati…
The University of Hong Kong（香港大学）；Shenzhen Research Institute of Big Data, The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳）深圳大数据研究院）；Longgang Central Hospital of Shenzhen（深圳龙岗中心医院）；Longgang People Hospital of Shenzhen（深圳龙岗人民医院）
Despite the considerable progress in automatic abdominal multi-organ segmentation from CT/MRI scans in recent years, a comprehensive evaluation of the models' capabilities is hampered by the lack of a large-scale benchmark from diverse clinical scenarios. Constraint by the high cost of collecting and labeling 3D medical data, most of the deep learning models to date are driven by datasets with a limited number of organs of interest or samples, which still limits the power of modern deep models and makes it difficult to provide a fully comprehensive and fair estimate of various methods. To miti…
Muroran Institute of Technology（室兰工业大学）；Niigata University of Health and Welfare（新潟医疗福祉大学）
To promote the development of medical image segmentation technology, AMOS, a large-scale abdominal multi-organ dataset for versatile medical image segmentation, is provided and AMOS 2022 challenge is held by using the dataset. In this report, we present our solution for the AMOS 2022 challenge. We employ residual U-Net with deep super vision as our base model. The experimental results show that the mean scores of Dice similarity coefficient and normalized surface dice are 0.8504 and 0.8476 for CT only task and CT/MRI task, respectively.
Uppsala University（乌普萨拉大学）；Antaros Medical（安塔罗斯医疗公司）；Paracelsus Medical University（帕拉塞尔苏斯医科大学）
Purpose: An approach for the automated segmentation of visceral adipose tissue (VAT) and subcutaneous adipose tissue (SAT) in multicenter water-fat MRI scans of the abdomen was investigated, using two different neural network architectures. Methods: The two fully convolutional network architectures U-Net and V-Net were trained, evaluated and compared on the water-fat MRI data. Data of the study Tellus with 90 scans from a single center was used for a 10-fold cross-validation in which the most successful configuration for both networks was determined. These configurations were then tested on 20…
Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）
We developed a new joint probabilistic segmentation and image distribution matching generative adversarial network (PSIGAN) for unsupervised domain adaptation (UDA) and multi-organ segmentation from magnetic resonance (MRI) images. Our UDA approach models the co-dependency between images and their segmentation as a joint probability distribution using a new structure discriminator. The structure discriminator computes structure of interest focused adversarial loss by combining the generated pseudo MRI with probabilistic segmentations produced by a simultaneously trained segmentation sub-networ…
Clinical Center, NIH（美国国立卫生研究院临床中心）；National Center for Biotechnology Information, National Library of Medicine, NIH（美国国立卫生研究院国家医学图书馆国家生物技术信息中心）
Purpose: Identification of abdominal Lymph Nodes (LN) that are suspicious for metastasis in T2 Magnetic Resonance Imaging (MRI) scans is critical for staging of lymphoproliferative diseases. Prior work on LN detection has been limited to specific anatomical regions of the body (pelvis, rectum) in single MR slices. Therefore, the development of a universal approach to detect LN in full T2 MRI volumes is highly desirable. Methods: In this study, a Computer Aided Detection (CAD) pipeline to universally identify abdominal LN in volumetric T2 MRI using neural networks is proposed. First, we trained…
Eastern Hepatobiliary Surgery Hospital（东方肝胆外科医院）；Ping An Technology（平安科技）；Georgia Institute of Technology（佐治亚理工学院）；PAII Inc.（PAII公司）
Objectives: to propose a fully-automatic computer-aided diagnosis (CAD) solution for liver lesion characterization, with uncertainty estimation. Methods: we enrolled 400 patients who had either liver resection or a biopsy and was diagnosed with either hepatocellular carcinoma (HCC), intrahepatic cholangiocarcinoma, or secondary metastasis, from 2006 to 2019. Each patient was scanned with T1WI, T2WI, T1WI venous phase (T2WI-V), T1WI arterial phase (T1WI-A), and DWI MRI sequences. We propose a fully-automatic deep CAD pipeline that localizes lesions from 3D MRI studies using key-slice parsing an…
Parallel imaging is a widely-used technique to accelerate magnetic resonance imaging (MRI). However, current methods still perform poorly in reconstructing artifact-free MRI images from highly undersampled k-space data. Recently, implicit neural representation (INR) has emerged as a new deep learning paradigm for learning the internal continuity of an object. In this study, we adopted INR to parallel MRI reconstruction. The MRI image was modeled as a continuous function of spatial coordinates. This function was parameterized by a neural network and learned directly from the measured k-space it…
TotalSegmentator MRI: Robust Sequence-independent Segmentation of Multiple Anatomic Structures in MRI
University Hospital Basel（巴塞尔大学医院）；University of Freiburg（弗莱堡大学）；University Hospital of Tuebingen（蒂宾根大学医院）；German Cancer Research Center（德国癌症研究中心）；Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）
PISCO: Self-Supervised k-Space Regularization for Improved Neural Implicit k-Space Representations of Dynamic MRI
Helmholtz Munich（亥姆霍兹慕尼黑中心）；Technical University of Munich（慕尼黑工业大学）；Klinikum rechts der Isar（右岸医院（慕尼黑工业大学附属））；Imperial College London（帝国理工学院）；Pontificia Universidad Católica de Chile（智利天主教大学）；King’s College London（伦敦国王学院）
Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction
School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China（上海交通大学生物医学工程学院）；School of Information Science and Technology, ShanghaiTech University, Shanghai, China（上海科技大学信息科学与技术学院）；iHuman Institute, Shanghaitech University, Shanghai, China（上海科技大学iHuman研究所）
Accurate and robust segmentation of small organs in whole-body MRI is difficult due to anatomical variation and class imbalance. Recent deep network based approaches have demonstrated promising performance on abdominal multi-organ segmentations. However, the performance on small organs is still suboptimal as these occupy only small regions of the whole-body volumes with unclear boundaries and variable shapes. A coarse-to-fine, hierarchical strategy is a common approach to alleviate this problem, however, this might miss useful contextual information. We propose a two-stage approach with weight…
Otto von Guericke University Magdeburg（马格德堡奥托·冯·格里克大学）；Human Technopole（人类技术园）；German Centre for Neurodegenerative Disease（德国神经退行性疾病中心）；Centre for Behavioural Brain Sciences（行为脑科学中心）
Computed tomography and magnetic resonance imaging are two widely used clinical imaging modalities for non-invasive diagnosis. However, both of these modalities come with certain problems. CT uses harmful ionising radiation, and MRI suffers from slow acquisition speed. Both problems can be tackled by undersampling, such as sparse sampling. However, such undersampled data leads to lower resolution and introduces artefacts. Several techniques, including deep learning based methods, have been proposed to reconstruct such data. However, the undersampled reconstruction problem for these two modalit…
Volumetrically Consistent Implicit Atlas Learning via Neural Diffeomorphic Flow for Placenta MRI
MIT Computer Science and Artificial Intelligence Laboratory（麻省理工学院计算机科学与人工智能实验室）；Massachusetts General Hospital, Harvard Medical School（哈佛医学院麻省总医院）；Boston Children’s Hospital, Harvard Medical School（哈佛医学院波士顿儿童医院）
CitAI Research Centre（CitAI研究中心）；City, University of London（伦敦城市大学）；BioMedIA（生物医学影像分析组）；Imperial College（帝国理工学院）
U-Net has been the go-to architecture for medical image segmentation tasks, however computational challenges arise when extending the U-Net architecture to 3D images. We propose the Implicit U-Net architecture that adapts the efficient Implicit Representation paradigm to supervised image segmentation tasks. By combining a convolutional feature extractor with an implicit localization network, our implicit U-Net has 40% less parameters than the equivalent U-Net. Moreover, we propose training and inference procedures to capitalize sparse predictions. When comparing to an equivalent fully convolut…
Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）
Vision transformers, with their ability to more efficiently model long-range context, have demonstrated impressive accuracy gains in several computer vision and medical image analysis tasks including segmentation. However, such methods need large labeled datasets for training, which is hard to obtain for medical image analysis. Self-supervised learning (SSL) has demonstrated success in medical image segmentation using convolutional networks. In this work, we developed a \underline{s}elf-distillation learning with \underline{m}asked \underline{i}mage modeling method to perform SSL for vision \u…
CLADE: Cycle Loss Augmented Degradation Enhancement for Unpaired Super-Resolution of Anisotropic Medical Images
University College London（伦敦大学学院）；Institute of Cardiovascular Science（心血管科学研究所）；Centre for Medical Imaging（医学影像中心）；Frimley Health NHS Trust（弗林利健康 NHS 信托基金）；UCL NHS Trust（伦敦大学学院 NHS 信托基金）
Otto von Guericke University (OVGU)（奥托·冯·格里克大学（OVGU））
Dynamic MRI is a technique of acquiring a series of images continuously to follow the physiological changes over time. However, such fast imaging results in low resolution images. In this work, abdominal deformation model computed from dynamic low resolution images have been applied to high resolution image, acquired previously, to generate dynamic high resolution MRI. Dynamic low resolution images were simulated into different breathing phases (inhale and exhale). Then, the image registration between breathing time points was performed using the B-spline SyN deformable model and using cross-c…
Amsterdam UMC（阿姆斯特丹大学医学中心）；University of Amsterdam（阿姆斯特丹大学）；MS Center Amsterdam（阿姆斯特丹多发性硬化中心）；Amsterdam Neuroscience（阿姆斯特丹神经科学研究所）；Vrije Universiteit Amsterdam（阿姆斯特丹自由大学）；Leiden University（莱顿大学）；Delft University of Technology（代尔夫特理工大学）
Machine Learning methods can learn how to reconstruct Magnetic Resonance Images and thereby accelerate acquisition, which is of paramount importance to the clinical workflow. Physics-informed networks incorporate the forward model of accelerated MRI reconstruction in the learning process. With increasing network complexity, robustness is not ensured when reconstructing data unseen during training. We aim to embed data consistency (DC) in deep networks while balancing the degree of network complexity. While doing so, we will assess whether either explicit or implicit enforcement of DC in varyin…
The University of Hong Kong（香港大学）；Imperial College London（帝国理工学院）
Abdominal magnetic resonance imaging (MRI) provides a straightforward way of characterizing tissue and locating lesions of patients as in standard diagnosis. However, abdominal MRI often suffers from respiratory motion artifacts, which leads to blurring and ghosting that significantly deteriorate the imaging quality. Conventional methods to reduce or eliminate these motion artifacts include breath holding, patient sedation, respiratory gating, and image post-processing, but these strategies inevitably involve extra scanning time and patient discomfort. In this paper, we propose a novel deep-le…
Mask-guided Data Augmentation for Multiparametric MRI Generation with a Rare Hepatocellular Carcinoma
Universidad Industrial de Santander（桑坦德工业大学）；University of Toulouse（图卢兹大学）；Université Paul Sabatier Toulouse 3（图卢兹第三大学（保罗·萨巴蒂埃大学））；Bicêtre University Hospital（比塞特尔大学医院）；Assistance publique des hôpitaux de Paris（巴黎公共援助医院）；Université Claude Bernard Lyon 1（里昂第一大学（克洛德·贝尔纳里昂第一大学））
From Coarse to Continuous: Progressive Refinement Implicit Neural Representation for Motion-Robust Anisotropic MRI Reconstruction
Department of Bioengineering and Imperial-X, Imperial College London（生物工程系和Imperial-X，帝国理工学院伦敦分校）；Department of Bioengineering, Imperial College London（生物工程系，帝国理工学院伦敦分校）
School of Biomedical Engineering, Shanghai Jiao Tong University（上海交通大学生物医学工程学院）；School of Information Science and Technology, ShanghaiTech University（上海交通大学信息科学与技术学院）；School of Biomedical Engineering and the National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy (NERCAMRT), Shanghai Jiao Tong University（上海交通大学生物医学工程学院和先进磁共振诊断与治疗国家工程研究中心）
Efficient MRI Parallel Imaging Reconstruction by K-Space Rendering via Generalized Implicit Neural Representation
Department of Neuroradiology, University Hospital Heidelberg（神经放射科，海德堡大学医院）；School of Electrical Engineering and Automation, Wuhan University（电气工程与自动化学院，武汉大学）；Momoni AI；Department of Stomatology, Shenzhen People’s Hospital（口腔科，深圳人民医院）；College of Science and Engineering, James Cook University（科学与工程学院，詹姆斯库克大学）；Department of Game Design, Faculty of Arts, Uppsala University（游戏设计系，艺术学院，乌普萨拉大学）；School of Computer Science, University of Sydney（计算机科学学院，悉尼大学）；School of Biomedical Engineering, The University of Sydney（生物医学工程学院，悉尼大学）
提出一种基于广义 INR 的 MRI 并行成像重建框架，利用尺度嵌入编码器和体素先验渲染全采样 k 空间，在 4–6 倍加速下提升质量并降低计算开销。
Vanderbilt University（范德堡大学）；Vanderbilt University Medical Center（范德堡大学医学中心）；Incyte Corporation（因赛特公司）
The findings of splenomegaly, abnormal enlargement of the spleen, is a non-invasive clinical biomarker for liver and spleen disease. Automated segmentation methods are essential to efficiently quantify splenomegaly from clinically acquired abdominal magnetic resonance imaging (MRI) scans. However, the task is challenging due to (1) large anatomical and spatial variations of splenomegaly, (2) large inter- and intra-scan intensity variations on multi-modal MRI, and (3) limited numbers of labeled splenomegaly scans. In this paper, we propose the Splenomegaly Segmentation Network (SS-Net) to intro…
SGAM: Shared Gaussian Geometry with Implicit Amplitude Modeling for Scan-Specific 3D Multi-Contrast MRI Reconstruction
Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院劳特伯生物医学成像研究中心）
University of Florida（佛罗里达大学）；National Institutes of Health Clinical Center（国立卫生研究院临床中心）
Deep neural networks have demonstrated very promising performance on accurate segmentation of challenging organs (e.g., pancreas) in abdominal CT and MRI scans. The current deep learning approaches conduct pancreas segmentation by processing sequences of 2D image slices independently through deep, dense per-pixel masking for each image, without explicitly enforcing spatial consistency constraint on segmentation of successive slices. We propose a new convolutional/recurrent neural network architecture to address the contextual learning and segmentation consistency problem. A deep convolutional …
Technical University of Munich（慕尼黑工业大学）；LMU Hospital Grosshadern（路德维希-马克西米利安-慕尼黑大学格罗斯哈德恩医院）
Automatic segmentation of the liver and hepatic lesions is an important step towards deriving quantitative biomarkers for accurate clinical diagnosis and computer-aided decision support systems. This paper presents a method to automatically segment liver and lesions in CT and MRI abdomen images using cascaded fully convolutional neural networks (CFCNs) enabling the segmentation of a large-scale medical trial or quantitative image analysis. We train and cascade two FCNs for a combined segmentation of the liver and its lesions. In the first step, we train a FCN to segment the liver as ROI input …
Flow-Guided Implicit Neural Representation for Motion-Aware Dynamic MRI Reconstruction
School of Automation, Guangdong University of Technology（广东工业大学自动化学院）；Research Center for Medical AI, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究所医学人工智能研究中心）；Department of Computer Science and Engineering, The Hong Kong University of Science and Technology（香港科学与技术大学计算机科学与工程系）
School of Biomedical Engineering and Imaging Sciences, King’s College London（伦敦国王学院生物医学工程与成像科学学院）；Department of Women and Children’s Health, School of Life Course Sciences, King’s College London（伦敦国王学院生命历程科学学院妇幼健康系）
Accurately estimating and correcting the motion artifacts are crucial for 3D image reconstruction of the abdominal and in-utero magnetic resonance imaging (MRI). The state-of-art methods are based on slice-to-volume registration (SVR) where multiple 2D image stacks are acquired in three orthogonal orientations. In this work, we present a novel reconstruction pipeline that only needs one orientation of 2D MRI scans and can reconstruct the full high-resolution image without masking or registration steps. The framework consists of two main stages: the respiratory motion estimation using a self-su…
In this work, we address the TrackRAD2025 challenge of real-time tumor tracking in cine-MRI sequences of the thoracic and abdominal regions under strong data scarcity constraints. Two complementary strategies were explored: (i) unsupervised registration with the IMPACT similarity metric and (ii) foundation model-based segmentation leveraging SAM 2.1 and its recent variants through prompt-based interaction. Due to the one-second runtime constraint, the SAM-based method was ultimately selected. The final configuration used SAM2.1 b+ with mask-based prompts from the first annotated slice, fine-tu…
Enhancing Implicit Neural Representations with Image Feature Embedding for Unsupervised Cardiac Cine MRI Reconstruction
Division of Image Processing, Department of Radiology, Leiden University Medical Center（莱顿大学医学中心放射科图像处理部）；C.J. Gorter Center, Department of Radiology, Leiden University Medical Center（莱顿大学医学中心放射科C.J. 戈特中心）；Cardio Vascular Imaging Group, Department of Radiology, Leiden University Medical Center（莱顿大学医学中心放射科心血管成像组）；Philips Innovative Technologies（飞利浦创新技术公司）
University of Florida（佛罗里达大学）；Nvidia Corporation（英伟达公司）
Automatic pancreas segmentation in radiology images, eg., computed tomography (CT) and magnetic resonance imaging (MRI), is frequently required by computer-aided screening, diagnosis, and quantitative assessment. Yet pancreas is a challenging abdominal organ to segment due to the high inter-patient anatomical variability in both shape and volume metrics. Recently, convolutional neural networks (CNNs) have demonstrated promising performance on accurate segmentation of pancreas. However, the CNN-based method often suffers from segmentation discontinuity for reasons such as noisy image quality an…
KP-INR: A Dual-Branch Implicit Neural Representation Model for Cardiac Cine MRI Reconstruction
Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands（莱顿大学医学中心放射科）；Cardiologs, Philips, Paris, France（法国巴黎Philips心血管部门）；Faculty of Computer Science, Eindhoven University of Technology, Eindhoven, The Netherlands（埃因霍温理工大学计算机科学学院）；Philips Innovative Technologies, Hamburg, Germany（德国汉堡Philips创新技术）
B-FIRE: Binning-Free Diffusion Implicit Neural Representation for Hyper-Accelerated Motion-Resolved MRI
Radiation Oncology, University of California, San Francisco, California（加州大学旧金山分校放射肿瘤学系）；Radiology and Biomedical Imaging, University of California, San Francisco, California（加州大学旧金山分校放射学与生物医学成像系）；Siemens Medical Solutions USA, Inc., Cleveland, Ohio（西门子医疗解决方案美国公司，克利夫兰，俄亥俄）；Radiology at Children’s Hospital Los Angeles, Keck School of Medicine, University of Southern California, Los Angeles, California（洛杉矶儿童医院放射学，美国南加州大学凯克医学院，洛杉矶，加利福尼亚）
