Improved 3D Whole Heart Geometry from Sparse CMR Slices
School of Biomedical Engineering and Imaging Sciences, King’s College London（伦敦国王学院生物医学工程与影像科学学院）；College of Mathematical Medicine, Zhejiang Normal University（浙江师范大学数学医学院）；Imperial College London（伦敦帝国学院）；HeartFlow, Inc.（HeartFlow公司）；University/BHF Centre for Cardiovascular Science, University of Edinburgh（爱丁堡大学大学/英国心脏基金会心血管科学中心）
Yiyang Xu, Hao Xu, Matthew Sinclair, Esther Puyol-Antón, Steven A Niederer, Amedeo Chiribiri, Steven E Williams, Michelle C Williams, Alistair A Young
Cardiac magnetic resonance (CMR) imaging and computed tomography (CT) are two common non-invasive imaging methods for assessing patients with cardiovascular disease. CMR typically acquires multiple sparse 2D slices, with unavoidable respiratory motion artefacts between slices, whereas CT acquires isotropic dense data but uses ionising radiation. In this study, we explore the combination of Slice Shifting Algorithm (SSA), Spatial Transformer Network (STN), and Label Transformer Network (LTN) to: 1) correct respiratory motion between segmented slices, and 2) transform sparse segmentation data into dense segmentation. All combinations were validated using synthetic motion-corrupted CMR slice segmentation generated from CT in 1699 cases, where the dense CT serves as the ground truth. In 199 testing cases, SSA-LTN achieved the best results for Dice score and Huasdorff distance (94.0% and 4.7 mm respectively, average over 5 labels) but gave topological errors in 8 cases. STN was effective as a plug-in tool for correcting all topological errors with minimal impact on overall performance (93.5% and 5.0 mm respectively). SSA also proves to be a valuable plug-in tool, enhancing performance over both STN-based and LTN-based models. The code for these different combinations is available at https://github.com/XESchong/STACOM2024.
King’s College London（伦敦国王学院）；Guy’s and St Thomas’ NHS Foundation Trust（盖伊和圣托马斯国民保健基金会信托）；University Medical Center Utrecht（乌得勒支大学医学中心）
Current artificial intelligence (AI) algorithms for short-axis cardiac magnetic resonance (CMR) segmentation achieve human performance for slices situated in the middle of the heart. However, an often-overlooked fact is that segmentation of the basal and apical slices is more difficult. During manual analysis, differences in the basal segmentations have been reported as one of the major sources of disagreement in human interobserver variability. In this work, we aim to investigate the performance of AI algorithms in segmenting basal and apical slices and design strategies to improve their segm…
SAGCNet: Spatial-Aware Graph Completion Network for Missing Slice Imputation in Population CMR Imaging
School of Engineering, College of Engineering and Physical Sciences（工程学院，工程与物理科学学院）；University of Birmingham（伯明翰大学）；Oxford Center for Clinical Magnetic Resonance Research (OCMR)（牛津临床磁共振研究中心）；University of Oxford（牛津大学）；John Radcliffe Hospital（约翰·拉德克利夫医院）；Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院）；Queen Mary University London（伦敦女王大学）；Barts Health NHS Trust（巴特勒医院 NHS 信托）
School of Computation, Information and Technology（计算信息学院）；Technical University of Munich（慕尼黑技术大学）；School of Medicine, Klinikum Rechts der Isar（医学院）；Department of Computer Science（计算机科学系）；University of Sheffield（谢菲尔德大学）；Department of Quantitative Biomedicine（定量生物医学系）；University of Zurich（苏黎世大学）；Department of Computing（计算系）；Imperial College London（伦敦帝国理工学院）；Department of Engineering Science（工程科学系）；University of Oxford（牛津大学）
Guy’s and St. Thomas’ NHS Foundation Trust（盖伊和圣托马斯国民保健服务基金会信托）；King’s College London（伦敦国王学院）；University of Warwick（华威大学）
Patient-specific 3D printing of congenital heart anatomy demands an accurate segmentation of the thin tissue interfaces which characterise these diagnoses. Even when a label set has a high spatial overlap with the ground truth, inaccurate delineation of these interfaces can result in topological errors. These compromise the clinical utility of such models due to the anomalous appearance of defects. CNNs have achieved state-of-the-art performance in segmentation tasks. Whilst data augmentation has often played an important role, we show that conventional image resampling schemes used therein ca…
DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learning
Imperial College London（帝国理工学院）；University of Birmingham（伯明翰大学）；MRC London Institute of Medical Sciences（英国医学研究理事会伦敦医学科学研究所）；Technical University Munich（慕尼黑工业大学）；Klinikum rechts der Isar（伊萨尔河畔临床教学中心）
本文提出 DeepMesh 学习框架，利用多视图二维 CMR 图像重建个体心脏三维网格并估计逐顶点运动场，在 UK Biobank 上优于现有图像与网格类方法。
University of Sao Paulo（圣保罗大学）；Dalhousie University（达尔豪斯大学）
Magnetic resonance imaging (MRI) is a widely known medical imaging technique used to assess the heart function. Deep learning (DL) models perform several tasks in cardiac MRI (CMR) images with good efficacy, such as segmentation, estimation, and detection of diseases. Many DL models based on convolutional neural networks (CNN) were improved by detecting regions-of-interest (ROI) either automatically or by hand. In this paper we describe Visual-Motion-Focus (VMF), a module that detects the heart motion in the 4D MRI sequence, and highlights ROIs by focusing a Radial Basis Function (RBF) on the …
University College London（伦敦大学学院）；Great Ormond Street Hospital（大奥蒙德街医院）；University and ETH Zurich（苏黎世大学与苏黎世联邦理工学院）；University of Oulu（奥卢大学）
Background: Three-dimensional, whole heart, balanced steady state free precession (WH-bSSFP) sequences provide delineation of intra-cardiac and vascular anatomy. However, they have long acquisition times. Here, we propose significant speed ups using a deep learning single volume super resolution reconstruction, to recover high resolution features from rapidly acquired low resolution WH-bSSFP images. Methods: A 3D residual U-Net was trained using synthetic data, created from a library of high-resolution WH-bSSFP images by simulating 0.5 slice resolution and 0.5 phase resolution. The trained net…
Eindhoven University of Technology（埃因霍温理工大学）；Philips Research Laboratories（飞利浦研究院）；Philips Healthcare（飞利浦医疗）
We propose a hybrid controllable image generation method to synthesize anatomically meaningful 3D+t labeled Cardiac Magnetic Resonance (CMR) images. Our hybrid method takes the mechanistic 4D eXtended CArdiac Torso (XCAT) heart model as the anatomical ground truth and synthesizes CMR images via a data-driven Generative Adversarial Network (GAN). We employ the state-of-the-art SPatially Adaptive De-normalization (SPADE) technique for conditional image synthesis to preserve the semantic spatial information of ground truth anatomy. Using the parameterized motion model of the XCAT heart, we genera…
Heidelberg University Hospital（海德堡大学医院）；DZHK (German Centre for Cardiovascular Research)（德国心血管研究中心）；UT Southwestern Medical Center（德克萨斯大学西南医学中心）；German Competence Network for Congenital Heart Defects（德国先天性心脏病能力网络）
Anisotropic multi-slice Cardiac Magnetic Resonance (CMR) Images are conventionally acquired in patient-specific short-axis (SAX) orientation. In specific cardiovascular diseases that affect right ventricular (RV) morphology, acquisitions in standard axial (AX) orientation are preferred by some investigators, due to potential superiority in RV volume measurement for treatment planning. Unfortunately, due to the rare occurrence of these diseases, data in this domain is scarce. Recent research in deep learning-based methods mainly focused on SAX CMR images and they had proven to be very successfu…
Imperial College London（帝国理工学院）；National University of Defense Technology（国防科技大学）；MRC London Institute of Medical Sciences（英国医学研究委员会伦敦医学科学研究所）；Technical University Munich（慕尼黑工业大学）
3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and diagnosis of cardiovascular diseases. Most of the previous methods focus on estimating pixel-/voxel-wise motion fields in the full image space, which ignore the fact that motion estimation is mainly relevant and useful within the object of interest, e.g., the heart. In this work, we model the heart as a 3D geometric mesh and propose a novel deep learning-based method that can estimate 3D motion of the heart mesh from 2D short- and long-axis CMR images. By developing a …
University of Auckland（奥克兰大学）；Queen Mary University of London（伦敦玛丽女王大学）；University of Oxford（牛津大学）
Purpose: To demonstrate the feasibility and performance of a fully automated deep learning framework to estimate myocardial strain from short-axis cardiac magnetic resonance tagged images. Methods and Materials: In this retrospective cross-sectional study, 4508 cases from the UK Biobank were split randomly into 3244 training and 812 validation cases, and 452 test cases. Ground truth myocardial landmarks were defined and tracked by manual initialization and correction of deformable image registration using previously validated software with five readers. The fully automatic framework consisted …
An investigation into the causes of race bias in AI-based cine CMR segmentation
School of Biomedical Engineering & Imaging Sciences, King's College London（伦敦国王学院生物医学工程与影像科学学院）；HeartFlow Inc（HeartFlow公司）；Guy’s and St Thomas’ Hospital（盖伊和圣托马斯医院）；College of Electronic and Information Engineering, Tongji University（同济大学电子与信息工程学院）
Purpose: To develop a fully automatic method for extraction and directionality determination of respiratory signal in free-breathing, real-time (RT) cardiac MRI. Methods: The respiratory signal is extracted by a principal component analysis method from RT cine images. Then, a two-step procedure is used to determine the directionality (sign) of the respiratory signal. First, the signal polarity of all slices is made consistent with a reference slice. Second, a global sign correction is performed by maximizing the correlation of the respiratory signal with the zeroth-moment center curve. The pro…
Imperial College London（帝国理工学院）；Technical University Munich（慕尼黑工业大学）；University of Edinburgh（爱丁堡大学）；MRC London Institute of Medical Sciences（MRC伦敦医学科学研究所）
Recovering the 3D motion of the heart from cine cardiac magnetic resonance (CMR) imaging enables the assessment of regional myocardial function and is important for understanding and analyzing cardiovascular disease. However, 3D cardiac motion estimation is challenging because the acquired cine CMR images are usually 2D slices which limit the accurate estimation of through-plane motion. To address this problem, we propose a novel multi-view motion estimation network (MulViMotion), which integrates 2D cine CMR images acquired in short-axis and long-axis planes to learn a consistent 3D motion fi…
University of Karachi（卡拉奇大学）；Zhejiang University（浙江大学）；Iqra University（伊克拉大学）；Karachi Institute of Economics and Technology（卡拉奇经济与技术学院）；King Abdulaziz University（阿卜杜勒阿齐兹国王大学）
Heart is one of the vital organs of human body. A minor dysfunction of heart even for a short time interval can be fatal, therefore, efficient monitoring of its physiological state is essential for the patients with cardiovascular diseases. In the recent past, various computer assisted medical imaging systems have been proposed for the segmentation of the organ of interest. However, for the segmentation of heart using MRI, only few methods have been proposed each with its own merits and demerits. For further advancement in this area of research, we analyze automated heart segmentation methods …
Mannheim University of Applied Science（曼海姆应用科技大学）；UT Southwestern Medical Center（德克萨斯大学西南医学中心）；DZHK (German Centre for Cardiovascular Research)（德国心血管研究中心）；German Heart Centre Munich（慕尼黑德国心脏中心）；Hannover Medical School（汉诺威医学院）；Heidelberg University Hospital（海德堡大学医院）
Planning the optimal time of intervention for pulmonary valve replacement surgery in patients with the congenital heart disease Tetralogy of Fallot (TOF) is mainly based on ventricular volume and function according to current guidelines. Both of these two biomarkers are most reliably assessed by segmentation of 3D cardiac magnetic resonance (CMR) images. In several grand challenges in the last years, U-Net architectures have shown impressive results on the provided data. However, in clinical practice, data sets are more diverse considering individual pathologies and image properties derived fr…
Background: RSN whole-heart CMRA is a technique that estimates and corrects for respiratory motion. However, RSN has been limited to a 1D rigid correction which is often insufficient for patients with complex respiratory patterns. The goal of this work is therefore to improve the robustness and quality of 3D radial CMRA by incorporating both 3D motion information and nonrigid intra-acquisition correction of the data into a framework called focused navigation (fNAV). Methods: We applied fNAV to 500 data sets from a numerical simulation, 22 healthy volunteers, and 549 cardiac patients. We compar…
Rapid online deep artifact suppression for real-time spiral bSSFP CMR with blipped-CAIPI simultaneous multi-slice imaging at 1.5 T
Centre for Translational Cardiovascular Imaging, Institute of Cardiovascular Science, University College London（转化心血管成像中心，心血管科学研究所，伦敦大学学院）；Clinical Physiology, Department of Clinical Sciences Lund, Lund University, Skåne University Hospital（临床生理学，临床科学系，伦德大学，斯德哥尔摩大学医院）；Department of Biomedical Engineering, Faculty of Engineering, Lund University（生物医学工程系，工程学院，伦德大学）；Research & Collaborations GBI, Siemens Healthcare Ltd（研究与合作GBI，西门子医疗有限公司）
针对实时同步多层 bSSFP 心脏磁共振成像中采集和重建时间长的问题，提出基于 3D U-Net 的深度伪影抑制方法，实现快速在线重建，显著缩短采集和重建时间，同时保持诊断图像质量。
Intensity-based 3D motion correction for cardiac MR images
Munich Center for Machine Learning, Technical University Munich（慕尼黑工业大学慕尼黑机器学习中心）；School of Computation, Information and Technology, Technical University Munich（慕尼黑工业大学计算、信息与技术学院）；Klinikum Rechts der Isar, Technical University Munich（慕尼黑工业大学右岸医院）；Department of Computing, Imperial College London（伦敦帝国理工学院计算系）
Towards Cardiac MRI Foundation Models: Comprehensive Visual-Tabular Representations for Whole-Heart Assessment and Beyond
School of Computation, Information and Technology, Technical University of Munich（慕尼黑工业大学计算、信息与技术学院）；School of Medicine, Klinikum Rechts der Isar, Technical University of Munich（慕尼黑工业大学伊萨尔河畔右岸医院医学院）；Data Science Institute, Imperial College London（帝国理工学院数据科学研究所）；Department of Computing, Imperial College London（帝国理工学院计算系）；Department of Computer Science, University of Sheffield（谢菲尔德大学计算机科学系）；Department of Quantitative Biomedicine, University of Zurich（苏黎世大学定量生物医学系）
Latent Interpolation Learning Using Diffusion Models for Cardiac Volume Reconstruction
School of Computation, Information and Technology, Technical University Munich（技术大学慕尼黑计算信息学院）；Munich Center for Machine Learning（慕尼黑机器学习中心）；Department of Quantitative Biomedicine, University of Zurich（苏黎世大学定量生物医学系）；Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford（牛津大学生物医学工程研究所）；Imperial College London（伦敦帝国学院）；University of Sheffield（谢菲尔德大学）；NVIDIA（英伟达）；Department of Computing, Imperial College London（伦敦帝国学院计算机系）；Department AIBE of Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔兰根-纽伦堡大学AIBE系）；School of Medicine, Klinikum Rechts der Isar, Technical University of Munich（慕尼黑技术大学医学院，莱纳特医院）
Neural Implicit Heart Coordinates: 3D cardiac shape reconstruction from sparse segmentations
School of Biomedical Engineering and Imaging Sciences（生物医学工程与成像科学学院）；William Harvey Research Institute, NIHR Barts Biomedical Research Centre（威廉·哈里森研究机构、NIHR巴茨生物医学研究中心）；Simula Research Laboratory（Simula研究实验室）；Department of Informatics（信息学院）；Department of Bioengineering（生物工程学院）；Barts Heart Centre, Barts Health NHS Trust（巴茨心脏中心、巴茨健康 NHS信托）；Technical University of Munich（慕尼黑技术大学）
