The selection of an optimal pacing site, which is ideally scar-free and late activated, is critical to the response of cardiac resynchronization therapy (CRT). Despite the success of current approaches formulating the detection of such late mechanical activation (LMA) regions as a problem of activation time regression, their accuracy remains unsatisfactory, particularly in cases where myocardial scar exists. To address this issue, this paper introduces a multi-task deep learning framework that simultaneously estimates LMA amount and classify the scar-free LMA regions based on cine displacement encoding with stimulated echoes (DENSE) magnetic resonance imaging (MRI). With a newly introduced auxiliary LMA region classification sub-network, our proposed model shows more robustness to the complex pattern cause by myocardial scar, significantly eliminates their negative effects in LMA detection, and in turn improves the performance of scar classification. To evaluate the effectiveness of our method, we tests our model on real cardiac MR images and compare the predicted LMA with the state-of-the-art approaches. It shows that our approach achieves substantially increased accuracy. In addition, we employ the gradient-weighted class activation mapping (Grad-CAM) to visualize the feature maps learned by all methods. Experimental results suggest that our proposed model better recognizes the LMA region pattern.
Personalized 4D Whole Heart Geometry Reconstruction from Cine MRI for Cardiac Digital Twins
Department of Biomedical Engineering, National University of Singapore, Singapore（新加坡国立大学生物医学工程系）；School of Data Science, Fudan University, Shanghai, China（复旦大学数据科学学院）；Department of Engineering Science, University of Oxford, Oxford, UK（牛津大学工程科学系）；Department of Medicine, National University of Singapore, Singapore（新加坡国立大学医学系）；Department of Cardiology, National University Heart Centre Singapore, Singapore（新加坡国立心脏中心心内科部）
CineMesh4D: Personalized 4D Whole Heart Reconstruction from Sparse Cine MRI
Department of Biomedical Engineering, National University of Singapore, Singapore（新加坡国立大学生物医学工程系）；School of Automation, Southeast University, Nanjing, China（东南大学自动化学院）；Department of Medicine, National University of Singapore, Singapore（新加坡国立大学医学系）；Department of Cardiology, National University Heart Centre Singapore, Singapore（新加坡国立心脏中心心内科部）
本文提出 CineMesh4D，一种端到端的 4D 全心脏重建方法，通过跨域映射从多视角 2D cine MRI 直接重建患者特定的全心脏网格，提升重建质量和运动一致性。
Personalized 4D Whole-Heart Mesh Reconstruction from Cine MRI via Multi-Scale Temporal Modeling and Differentiable Contour Rendering
Department of Biomedical Engineering, National University of Singapore（新加坡国立大学生物医学工程系）；School of Automation, Southeast University（东南大学自动化学院）；Department of Medicine, National University of Singapore（新加坡国立大学医学系）；Department of Cardiology, National University Heart Centre Singapore（新加坡国立大学心脏中心心脏病学系）
Imperial College London（帝国理工学院）；Technical University Munich（慕尼黑工业大学）；University of Edinburgh（爱丁堡大学）；MRC London Institute of Medical Sciences（MRC伦敦医学科学研究所）
Recovering the 3D motion of the heart from cine cardiac magnetic resonance (CMR) imaging enables the assessment of regional myocardial function and is important for understanding and analyzing cardiovascular disease. However, 3D cardiac motion estimation is challenging because the acquired cine CMR images are usually 2D slices which limit the accurate estimation of through-plane motion. To address this problem, we propose a novel multi-view motion estimation network (MulViMotion), which integrates 2D cine CMR images acquired in short-axis and long-axis planes to learn a consistent 3D motion fi…
A Latent ODE Approach to Spatiotemporal Modeling of Cine Cardiac MRI
Swiss Data Science Center, EPFL and ETH Zürich（瑞士数据科学中心，EPFL 和 ETH 苏黎世）；Diagnostic and Interventional Radiology, University Hospital Zürich（诊断与介入放射学，苏黎世大学医院）；Institute for Biomedical Engineering, University and ETH Zürich（生物医学工程研究所，苏黎世大学和 ETH 苏黎世）；Biomedical Informatics Group, ETH Zürich（生物医学信息学小组，ETH 苏黎世）；Division of Preventive Medicine, Brigham and Women’s Hospital / Harvard Medical School（预防医学部，布莱根妇女医院/哈佛医学院）
University of California, Berkeley（加州大学伯克利分校）；Open Source Medical Software Corporation（开源医疗软件公司）
Automated construction of surface geometries of cardiac structures from volumetric medical images is important for a number of clinical applications. While deep-learning-based approaches have demonstrated promising reconstruction precision, these approaches have mostly focused on voxel-wise segmentation followed by surface reconstruction and post-processing techniques. However, such approaches suffer from a number of limitations including disconnected regions or incorrect surface topology due to erroneous segmentation and stair-case artifacts due to limited segmentation resolution. We propose …
A novel neural network architecture, known as DL-ESPIRiT, is proposed to reconstruct rapidly acquired cardiac MRI data without field-of-view limitations which are present in previously proposed deep learning-based reconstruction frameworks. Additionally, a novel convolutional neural network based on separable 3D convolutions is integrated into DL-ESPIRiT to more efficiently learn spatiotemporal priors for dynamic image reconstruction. The network is trained on fully-sampled 2D cardiac cine datasets collected from eleven healthy volunteers with IRB approval. DL-ESPIRiT is compared against a sta…
We propose a method to classify cardiac pathology based on a novel approach to extract image derived features to characterize the shape and motion of the heart. An original semi-supervised learning procedure, which makes efficient use of a large amount of non-segmented images and a small amount of images segmented manually by experts, is developed to generate pixel-wise apparent flow between two time points of a 2D+t cine MRI image sequence. Combining the apparent flow maps and cardiac segmentation masks, we obtain a local apparent flow corresponding to the 2D motion of myocardium and ventricu…
KP-INR: A Dual-Branch Implicit Neural Representation Model for Cardiac Cine MRI Reconstruction
Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands（莱顿大学医学中心放射科）；Cardiologs, Philips, Paris, France（法国巴黎Philips心血管部门）；Faculty of Computer Science, Eindhoven University of Technology, Eindhoven, The Netherlands（埃因霍温理工大学计算机科学学院）；Philips Innovative Technologies, Hamburg, Germany（德国汉堡Philips创新技术）
Florida International University（佛罗里达国际大学）；Technical University of Munich（慕尼黑工业大学）；Stanford University（斯坦福大学）
Chest X-ray radiography is one of the earliest medical imaging technologies and remains one of the most widely-used for diagnosis, screening, and treatment follow up of diseases related to lungs and heart. The literature in this field of research reports many interesting studies dealing with the challenging tasks of bone suppression and organ segmentation but performed separately, limiting any learning that comes with the consolidation of parameters that could optimize both processes. This study, and for the first time, introduces a multitask deep learning model that generates simultaneously t…
Friedrich-Alexander-University Erlangen-Nuremberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；University of Leeds（利兹大学）
Quantitative assessment of cardiac left ventricle (LV) morphology is essential to assess cardiac function and improve the diagnosis of different cardiovascular diseases. In current clinical practice, LV quantification depends on the measurement of myocardial shape indices, which is usually achieved by manual contouring of the endo- and epicardial. However, this process subjected to inter and intra-observer variability, and it is a time-consuming and tedious task. In this paper, we propose a spatio-temporal multi-task learning approach to obtain a complete set of measurements quantifying cardia…
CMRINet: Joint Groupwise Registration and Segmentation for Cardiac Function Quantification from Cine-MRI
Leiden University Medical Center（莱顿大学医学中心）；University of Sheffield（谢菲尔德大学）；INSIGNEO；Institute for In Silico Medicine（计算医学研究所）；Department of Infection, Immunity and Cardiovascular Disease（感染、免疫与心血管疾病部门）；Sheffield Teaching Hospitals（谢菲尔德教学医院）；Department of Clinical Radiology（临床放射学部门）
Cardiac cine magnetic resonance imaging (MRI) can be considered the optimal criterion for measuring cardiac function. This imaging technique can provide us with detailed information about cardiac structure, tissue composition and even blood flow. This work considers the application of the higher order dynamic mode decomposition (HODMD) method to a set of MR images of a heart, with the ultimate goal of identifying the main patterns and frequencies driving the heart dynamics. A novel algorithm based on singular value decomposition combined with HODMD is introduced, providing a three-dimensional …
Imperial College London（帝国理工学院）；National University of Defense Technology（国防科技大学）；MRC London Institute of Medical Sciences（英国医学研究委员会伦敦医学科学研究所）；Technical University Munich（慕尼黑工业大学）
3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and diagnosis of cardiovascular diseases. Most of the previous methods focus on estimating pixel-/voxel-wise motion fields in the full image space, which ignore the fact that motion estimation is mainly relevant and useful within the object of interest, e.g., the heart. In this work, we model the heart as a 3D geometric mesh and propose a novel deep learning-based method that can estimate 3D motion of the heart mesh from 2D short- and long-axis CMR images. By developing a …
University of Virginia（弗吉尼亚大学）；University of Virginia Health System（弗吉尼亚大学卫生系统）
Automated identification of myocardial scar from late gadolinium enhancement cardiac magnetic resonance images (LGE-CMR) is limited by image noise and artifacts such as those related to motion and partial volume effect. This paper presents a novel joint deep learning (JDL) framework that improves such tasks by utilizing simultaneously learned myocardium segmentations to eliminate negative effects from non-region-of-interest areas. In contrast to previous approaches treating scar detection and myocardium segmentation as separate or parallel tasks, our proposed method introduces a message passin…
Motion-Guided Causal Disentanglement for Robust Multi-View Cine Cardiac MRI Diagnosis
University of Virginia（弗吉尼亚大学）；University of Chicago（芝加哥大学）；Ohio State University（俄亥俄州立大学）；St. Francis Hospital & Heart Center（圣弗朗西斯医院及心脏中心）；Hartford HealthCare（哈特福德医疗集团）；Instituto do Coração (InCor)（心脏研究所（InCor））；Atlantic Health System（大西洋健康系统）；Sociedad Italiana de Beneficencia (Hospital Italiano)（意大利慈善协会（意大利医院））
The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning
King’s College London（伦敦国王学院）；Technical University of Munich（慕尼黑工业大学）；Imperial College London（帝国理工学院）；Guy’s & St. Thomas’ NHS Foundation Trust（盖伊和圣托马斯国民保健服务基金会信托）；Evelina London Children’s Hospital（伊夫琳娜伦敦儿童医院）
Towards Cardiac MRI Foundation Models: Comprehensive Visual-Tabular Representations for Whole-Heart Assessment and Beyond
School of Computation, Information and Technology, Technical University of Munich（慕尼黑工业大学计算、信息与技术学院）；School of Medicine, Klinikum Rechts der Isar, Technical University of Munich（慕尼黑工业大学伊萨尔河畔右岸医院医学院）；Data Science Institute, Imperial College London（帝国理工学院数据科学研究所）；Department of Computing, Imperial College London（帝国理工学院计算系）；Department of Computer Science, University of Sheffield（谢菲尔德大学计算机科学系）；Department of Quantitative Biomedicine, University of Zurich（苏黎世大学定量生物医学系）
WarpPINN: Cine-MR image registration with physics-informed neural networks
University of Bath（巴斯大学）；Pontificia Universidad Católica de Valparaíso（瓦尔帕莱索天主大学）；Millennium Institute for Intelligent Healthcare Engineering（千年智能医疗工程研究所）；Pontificia Universidad Católica de Chile（智利天主大学）
Deep Learning Assisted Outer Volume Removal for Highly-Accelerated Real-Time Dynamic MRI
Department of Electrical and Computer Engineering, University of Minnesota（电气与计算机工程系，明尼苏达大学）；Center for Magnetic Resonance Research, University of Minnesota（磁共振研究中心，明尼苏达大学）；Department of Imaging Physics, Delft University of Technology（成像物理系，代尔夫特理工大学）；HollandPTC, Delft, the Netherlands（HollandPTC，代尔夫特，荷兰）
An investigation into the causes of race bias in AI-based cine CMR segmentation
School of Biomedical Engineering & Imaging Sciences, King's College London（伦敦国王学院生物医学工程与影像科学学院）；HeartFlow Inc（HeartFlow公司）；Guy’s and St Thomas’ Hospital（盖伊和圣托马斯医院）；College of Electronic and Information Engineering, Tongji University（同济大学电子与信息工程学院）
Johns Hopkins University School of Medicine（约翰斯·霍普金斯大学医学院）；Johns Hopkins University（约翰斯·霍普金斯大学）；Johns Hopkins Hospital（约翰斯·霍普金斯医院）
Visualizing disease-induced scarring and fibrosis in the heart on cardiac magnetic resonance (CMR) imaging with contrast enhancement (LGE) is paramount in characterizing disease progression and quantifying pathophysiological substrates of arrhythmias. However, segmentation and scar/fibrosis identification from LGE-CMR is an intensive manual process prone to large inter-observer variability. Here, we present a novel fully-automated anatomically-informed deep learning solution for left ventricle (LV) and scar/fibrosis segmentation and clinical feature extraction from LGE-CMR. The technology invo…
United Imaging Intelligence（联影智能）；UIH America, Inc.（联影美国公司）
Real-time cardiac cine MRI does not require ECG gating in the data acquisition and is more useful for patients who can not hold their breaths or have abnormal heart rhythms. However, to achieve fast image acquisition, real-time cine commonly acquires highly undersampled data, which imposes a significant challenge for MRI image reconstruction. We propose a residual convolutional RNN for real-time cardiac cine reconstruction. To the best of our knowledge, this is the first work applying deep learning approach to Cartesian real-time cardiac cine reconstruction. Based on the evaluation from radiol…
King's College London（伦敦国王学院）；Guy’s and St Thomas’ Hospital（盖伊和圣托马斯医院）
In computer vision there has been significant research interest in assessing potential demographic bias in deep learning models. One of the main causes of such bias is imbalance in the training data. In medical imaging, where the potential impact of bias is arguably much greater, there has been less interest. In medical imaging pipelines, segmentation of structures of interest plays an important role in estimating clinical biomarkers that are subsequently used to inform patient management. Convolutional neural networks (CNNs) are starting to be used to automate this process. We present the fir…
In real-time (RT) cardiac cine imaging, a stack of 2D slices is collected sequentially under free-breathing conditions. A complete heartbeat from each slice is then used for cardiac function quantification. The inter-slice respiratory mismatch can compromise accurate quantification of cardiac function. Methods based on principal components analysis (PCA) have been proposed to extract the respiratory signal from RT cardiac cine, but these methods cannot resolve the inter-slice sign ambiguity of the respiratory signal. In this work, we propose a fully automatic sign correction procedure based on…
Purpose: To develop a method for banding-free bSSFP cardiac cine with substantially reduced flow artifacts. Methods: A projection-reconstruction (PR) trajectory is proposed for a frequency-modulated cine sequence, facilitating reconstruction of three phase cycles and a field-map time series from a short, breath-held scan. Data is also acquired during the gradient rewinders to enable generation of field maps using BMART, B$_0$ mapping using rewinding trajectories, where the rewind data forms the second TE image for calculating the field map. A field-map-based combination method is developed whi…
Cine cardiac MRI reconstruction using a convolutional recurrent network with refinement
Institute for Digital Communications, University of Edinburgh（爱丁堡大学数字通信研究所）；Institute of Information Science and Technologies “Alessandro Faedo”, National Research Council of Italy (CNR)（意大利国家研究委员会信息科学与技术研究所（亚历山德罗·法埃多））；Department of Information Engineering, University of Pisa（比萨大学信息工程系）；Institute for Infrastructure and Environment, University of Edinburgh（爱丁堡大学基础设施与环境研究所）；The Alan Turing Institute（阿兰·图灵研究所）
King’s College London（伦敦国王学院）；Guy’s and St Thomas’ NHS Foundation Trust（盖伊和圣托马斯国民保健基金会信托）；University Medical Center Utrecht（乌得勒支大学医学中心）
Current artificial intelligence (AI) algorithms for short-axis cardiac magnetic resonance (CMR) segmentation achieve human performance for slices situated in the middle of the heart. However, an often-overlooked fact is that segmentation of the basal and apical slices is more difficult. During manual analysis, differences in the basal segmentations have been reported as one of the major sources of disagreement in human interobserver variability. In this work, we aim to investigate the performance of AI algorithms in segmenting basal and apical slices and design strategies to improve their segm…
This paper presents a novel method to automatically identify late-activating regions of the left ventricle from cine Displacement Encoding with Stimulated Echo (DENSE) MR images. We develop a deep learning framework that identifies late mechanical activation in heart failure patients by detecting the Time to the Onset of circumferential Shortening (TOS). In particular, we build a cascade network performing end-to-end (i) segmentation of the left ventricle to analyze cardiac function, (ii) prediction of TOS based on spatiotemporal circumferential strains computed from displacement maps, and (ii…
WarpPINN-fibers: improved cardiac strain estimation from cine-MR with physics-informed neural networks
Millennium Institute for Intelligent Healthcare Engineering, iHEALTH；Department of Mechanical；Metallurgical Engineering, School of Engineering, Pontificia Universidad Cat\'olica de Chile, Santiago, Chile；Institute for Biological；Medical Engineering, Schools of Engineering, Medicine
Attention Incorporated Network for Sharing Low-rank, Image and K-space Information during MR Image Reconstruction to Achieve Single Breath-hold Cardiac Cine Imaging
University of Tuebingen（蒂宾根大学）；Technical University of Munich（慕尼黑工业大学）；Imperial College London（伦敦帝国学院）；Stanford University（斯坦福大学）；Klinikum Rechts der Isar, Technical University of Munich（慕尼黑工业大学右岸医院）
Purpose: To develop a fully automatic method for extraction and directionality determination of respiratory signal in free-breathing, real-time (RT) cardiac MRI. Methods: The respiratory signal is extracted by a principal component analysis method from RT cine images. Then, a two-step procedure is used to determine the directionality (sign) of the respiratory signal. First, the signal polarity of all slices is made consistent with a reference slice. Second, a global sign correction is performed by maximizing the correlation of the respiratory signal with the zeroth-moment center curve. The pro…
DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learning
Imperial College London（帝国理工学院）；University of Birmingham（伯明翰大学）；MRC London Institute of Medical Sciences（英国医学研究理事会伦敦医学科学研究所）；Technical University Munich（慕尼黑工业大学）；Klinikum rechts der Isar（伊萨尔河畔临床教学中心）
本文提出 DeepMesh 学习框架，利用多视图二维 CMR 图像重建个体心脏三维网格并估计逐顶点运动场，在 UK Biobank 上优于现有图像与网格类方法。
Opportunistic Cardiac Health Assessment: Estimating Phenotypes from Localizer MRI through Multi-Modal Representations
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital（人工智能在医疗与健康中的研究所，慕尼黑技术大学（TUM）和TUM大学医院）；Department of Diagnostic and Interventional Neuroradiology, School of Medicine, TUM University Hospital（诊断与介入神经放射科，医学院，TUM大学医院）；Department of Computing, Imperial College London（计算学院，伦敦帝国学院）；Munich Center for Machine Learning (MCML), Germany（慕尼黑机器学习中心（MCML），德国）
Real-time cardiac cine MRI -- A comparison of a diffusion probabilistic model with alternative state-of-the-art image reconstruction techniques for undersampled spiral acquisitions
