Cardiac segmentation is in great demand for clinical practice. Due to the enormous labor of manual delineation, unsupervised segmentation is desired. The ill-posed optimization problem of this task is inherently challenging, requiring well-designed constraints. In this work, we propose an unsupervised framework for multi-class segmentation with both intensity and shape constraints. Firstly, we extend a conventional non-convex energy function as an intensity constraint and implement it with U-Net. For shape constraint, synthetic images are generated from anatomical labels via image-to-image translation, as shape supervision for the segmentation network. Moreover, augmentation invariance is applied to facilitate the segmentation network to learn the latent features in terms of shape. We evaluated the proposed framework using the public datasets from MICCAI2019 MSCMR Challenge and achieved promising results on cardiac MRIs with Dice scores of 0.5737, 0.7796, and 0.6287 in Myo, LV, and RV, respectively.
TAI-GAN: A Temporally and Anatomically Informed Generative Adversarial Network for early-to-late frame conversion in dynamic cardiac PET inter-frame motion correction
Yale University（耶鲁大学）；IBM Research（IBM研究院）；Yale New Haven Hospital（耶鲁-纽黑文医院）；Yale School of Medicine（耶鲁医学院）
Eindhoven University of Technology（埃因霍温理工大学）；Philips Research Laboratories（飞利浦研究院）；Philips Healthcare（飞利浦医疗）
We propose a hybrid controllable image generation method to synthesize anatomically meaningful 3D+t labeled Cardiac Magnetic Resonance (CMR) images. Our hybrid method takes the mechanistic 4D eXtended CArdiac Torso (XCAT) heart model as the anatomical ground truth and synthesizes CMR images via a data-driven Generative Adversarial Network (GAN). We employ the state-of-the-art SPatially Adaptive De-normalization (SPADE) technique for conditional image synthesis to preserve the semantic spatial information of ground truth anatomy. Using the parameterized motion model of the XCAT heart, we genera…
Eindhoven University of Technology（埃因霍温理工大学）；Philips Research Laboratories（飞利浦研究实验室）；Philips Healthcare（飞利浦医疗）
Generative adversarial networks (GANs) have provided promising data enrichment solutions by synthesizing high-fidelity images. However, generating large sets of labeled images with new anatomical variations remains unexplored. We propose a novel method for synthesizing cardiac magnetic resonance (CMR) images on a population of virtual subjects with a large anatomical variation, introduced using the 4D eXtended Cardiac and Torso (XCAT) computerized human phantom. We investigate two conditional image synthesis approaches grounded on a semantically-consistent mask-guided image generation techniqu…
Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling
Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences（苏州生物医学工程与技术研究所，中国科学院）；SyCoIA, IMT Mines Ales（SyCoIA，IMT Mines Ales）
Université de Bourgogne Franche-Comté（勃艮第-弗朗什-孔泰大学）；Cardiac Simulation & Imaging Software（心脏模拟与成像软件公司）；University of Sherbrooke（舍布鲁克大学）；University Hospital of Dijon（第戎大学医院）
In this work, we propose a Variational Autoencoder (VAE) - Generative Adversarial Networks (GAN) model that can produce highly realistic MRI together with its pixel accurate groundtruth for the application of cine-MR image cardiac segmentation. On one side of our model is a Variational Autoencoder (VAE) trained to learn the latent representations of cardiac shapes. On the other side is a GAN that uses "SPatially-Adaptive (DE)Normalization" (SPADE) modules to generate realistic MR images tailored to a given anatomical map. At test time, the sampling of the VAE latent space allows to generate an…
University of Sherbrooke（舍布鲁克大学）；Université de Bourgogne Franche-Comté（勃艮第-弗朗什孔泰大学）；CArdiac Simulation & Imaging Software（心脏模拟与成像软件公司）；Université de Lyon（里昂大学）
Recent publications have shown that the segmentation accuracy of modern-day convolutional neural networks (CNN) applied on cardiac MRI can reach the inter-expert variability, a great achievement in this area of research. However, despite these successes, CNNs still produce anatomically inaccurate segmentations as they provide no guarantee on the anatomical plausibility of their outcome, even when using a shape prior. In this paper, we propose a cardiac MRI segmentation method which always produces anatomically plausible results. At the core of the method is an adversarial variational autoencod…
University of Edinburgh（爱丁堡大学）；Canon Medical Research Europe（佳能医疗欧洲研究中心）；The Alan Turing Institute（艾伦·图灵研究所）
Acquiring annotated data at scale with rare diseases or conditions remains a challenge. It would be extremely useful to have a method that controllably synthesizes images that can correct such underrepresentation. Assuming a proper latent representation, the idea of a "latent vector arithmetic" could offer the means of achieving such synthesis. A proper representation must encode the fidelity of the input data, preserve invariance and equivariance, and permit arithmetic operations. Motivated by the ability to disentangle images into spatial anatomy (tensor) factors and accompanying imaging (ve…
Synthetic Cardiac MRI Image Generation using Deep Generative Models
Department of Computer Engineering（计算机工程系）；University of Peradeniya（珀德尼亚大学）；University of Maryland（马里兰大学）；Department of Holistic Systems（整体系统系）；SimulaMet；Oslo, Norway（挪威奥斯陆）
Anatomy-Guided Residual Motion Diffusion for Controllable 4D Cardiac MRI Synthesis
Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Science（中国科学院苏州生物医学工程技术研究所）；Systemes Complexes et Intelligence Artificielle, IMT Mines Ales（复杂系统与人工智能实验室，IMT 阿莱斯矿业学院）；School of Artificial Intelligence and Advanced Computing, Xi’an Jiaotong-Liverpool University（西交利物浦大学人工智能与先进计算学院）
University of Sherbrooke（舍布鲁克大学）；University of Bourgogne Franche-Comte（勃艮第-弗朗什孔泰大学）；CASIS inc.（CASIS公司）；University of Lyon（里昂大学）
Convolutional neural networks (CNN) have had unprecedented success in medical imaging and, in particular, in medical image segmentation. However, despite the fact that segmentation results are closer than ever to the inter-expert variability, CNNs are not immune to producing anatomically inaccurate segmentations, even when built upon a shape prior. In this paper, we present a framework for producing cardiac image segmentation maps that are guaranteed to respect pre-defined anatomical criteria, while remaining within the inter-expert variability. The idea behind our method is to use a well-trai…
Biomedical Image Analysis Group, Imperial College London（伦敦帝国理工学院生物医学图像分析小组）；Data Science Institute, Imperial College London（伦敦帝国理工学院数据科学研究所）；Department of Medicine, Imperial College London（伦敦帝国理工学院医学院）
In this work, we present a fully automatic method to segment cardiac structures from late-gadolinium enhanced (LGE) images without using labelled LGE data for training, but instead by transferring the anatomical knowledge and features learned on annotated balanced steady-state free precession (bSSFP) images, which are easier to acquire. Our framework mainly consists of two neural networks: a multi-modal image translation network for style transfer and a cascaded segmentation network for image segmentation. The multi-modal image translation network generates realistic and diverse synthetic LGE …
CardioComposer: Leveraging Differentiable Geometry for Compositional Control of Anatomical Diffusion Models
Massachusetts Institute of Technology（麻省理工学院）；Brigham and Women’s Hospital（布里奇沃特医院）；American University in Cairo（开罗美国大学）；École Polytechnique Fédérale de Lausanne（洛桑联邦理工学院）
Johns Hopkins University School of Medicine（约翰斯·霍普金斯大学医学院）；Johns Hopkins University（约翰斯·霍普金斯大学）；Johns Hopkins Hospital（约翰斯·霍普金斯医院）
Visualizing disease-induced scarring and fibrosis in the heart on cardiac magnetic resonance (CMR) imaging with contrast enhancement (LGE) is paramount in characterizing disease progression and quantifying pathophysiological substrates of arrhythmias. However, segmentation and scar/fibrosis identification from LGE-CMR is an intensive manual process prone to large inter-observer variability. Here, we present a novel fully-automated anatomically-informed deep learning solution for left ventricle (LV) and scar/fibrosis segmentation and clinical feature extraction from LGE-CMR. The technology invo…
3D Cardiac Anatomy Generation Using Mesh Latent Diffusion Models
Department of Computer Science, University of Oxford（计算机科学系，牛津大学）；Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford（生物医学工程研究所，工程科学系，牛津大学）；Visual Geometry Group, Department of Engineering Science, University of Oxford（视觉几何组，工程科学系，牛津大学）；Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford（心血管医学部，拉德克利夫医学系，牛津大学）
Synthesis of Late Gadolinium Enhancement Images via Implicit Neural Representations for Cardiac Scar Segmentation
Amsterdam UMC, The Netherlands（阿姆斯特丹大学医学中心，荷兰）；University of Amsterdam, The Netherlands（阿姆斯特丹大学，荷兰）；Informatics Institute, University of Amsterdam, The Netherlands（阿姆斯特丹大学信息学院，荷兰）；Amsterdam Cardiovascular Sciences, Amsterdam UMC, The Netherlands（阿姆斯特丹心血管科学，阿姆斯特丹大学医学中心，荷兰）；Amsterdam Machine Learning Lab, University of Amsterdam, The Netherlands（阿姆斯特丹机器学习实验室，阿姆斯特丹大学，荷兰）；Department of Biomedical Engineering and Physics, Amsterdam UMC, The Netherlands（生物医学工程与物理系，阿姆斯特丹大学医学中心，荷兰）；Department of Experimental Cardiology, Amsterdam Cardiovascular Sciences, Heart Failure & Arrhythmias, Amsterdam UMC, The Netherlands（实验心脏病学系，阿姆斯特丹心血管科学，心力衰竭与心律失常，阿姆斯特丹大学医学中心，荷兰）；Department of Cardiology, Amsterdam UMC, The Netherlands（心脏病学系，阿姆斯特丹大学医学中心，荷兰）；Department of Radiology and Nuclear Medicine, Amsterdam UMC, The Netherlands（放射学与核医学系，阿姆斯特丹大学医学中心，荷兰）；Department of Radiology, Mayo Clinic, Rochester, United States of America（放射学系，梅奥诊所，罗切斯特，美国）
EchoFlow: A Foundation Model for Cardiac Ultrasound Image and Video Generation
Imperial College London（帝国理工学院）；University of Birmingham（伯明翰大学）；Ultromics Ltd.（奥特罗米克斯有限公司）；University of Oxford（牛津大学）；Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）
Rutgers University（罗格斯大学）；United Imaging Intelligence（联影智能）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
Accurate estimation of shape thickness from medical images is crucial in clinical applications. For example, the thickness of myocardium is one of the key to cardiac disease diagnosis. While mathematical models are available to obtain accurate dense thickness estimation, they suffer from heavy computational overhead due to iterative solvers. To this end, we propose novel methods for dense thickness estimation, including a fast solver that estimates thickness from binary annular shapes and an end-to-end network that estimates thickness directly from raw cardiac images.We test the proposed model…
Balancing Fidelity, Utility, and Privacy in Synthetic Cardiac MRI Generation: A Comparative Study
University of Peradeniya, Sri Lanka（斯里兰卡大学）；University of Maryland, College Park, USA（美国马里兰大学 College Park 分校）；Tulane University School of Medicine, USA（美国 Tulane 大学医学院）；Simula Research Laboratory, Norway（挪威 Simula 研究实验室）；SimulaMet, Norway（挪威 SimulaMet）
National Heart and Lung Institute, Imperial College London（帝国理工学院国家心肺研究所）；Royal Brompton Hospital（皇家布朗普顿医院）；University of the Basque Country UPV/EHU（巴斯克大学）；TECNALIA, Basque Research and Technology Alliance（巴斯克研究与技术联盟TECNALIA）；Beihang University（北京航空航天大学）；Shenzhen Second People’s Hospital（深圳市第二人民医院）
Synthetic digital twins based on medical data accelerate the acquisition, labelling and decision making procedure in digital healthcare. A core part of digital healthcare twins is model-based data synthesis, which permits the generation of realistic medical signals without requiring to cope with the modelling complexity of anatomical and biochemical phenomena producing them in reality. Unfortunately, algorithms for cardiac data synthesis have been so far scarcely studied in the literature. An important imaging modality in the cardiac examination is three-directional CINE multi-slice myocardial…
Fudan University（复旦大学）；Imperial College London（帝国理工学院）；University of Edinburgh（爱丁堡大学）；MRC London Institute of Medical Sciences（英国医学研究委员会伦敦医学科学研究所）；National Heart Research Institute, Singapore（新加坡国家心脏研究所）
In cardiac magnetic resonance (CMR) imaging, a 3D high-resolution segmentation of the heart is essential for detailed description of its anatomical structures. However, due to the limit of acquisition duration and respiratory/cardiac motion, stacks of multi-slice 2D images are acquired in clinical routine. The segmentation of these images provides a low-resolution representation of cardiac anatomy, which may contain artefacts caused by motion. Here we propose a novel latent optimisation framework that jointly performs motion correction and super resolution for cardiac image segmentations. Give…
Can Diffusion Models Bridge the Domain Gap in Cardiac MR Imaging?
Centre for Doctoral Training in AI for Medical Diagnosis and Care（人工智能医学诊断与护理博士培训中心）；School of Computing, University of Leeds（莱斯特大学计算机学院）；Leeds Cancer Centre, St James’s University Hospital, Leeds, UK（利兹癌症中心，圣詹姆斯大学医院，利兹，英国）
CardioDiT: Latent Diffusion Transformers for 4D Cardiac MRI Synthesis
Institute for Artificial Intelligence in Cardiovascular Medicine, Medical Faculty of Heidelberg University, Heidelberg University（海德堡大学医学院心血管医学人工智能研究所，海德堡大学）；Department of Cardiology, Angiology, Pneumology, Heidelberg University Hospital（海德堡大学医院心脏病学、血管学、肺病学系）；DZHK (German Centre for Cardiovascular Research), Partner Site Heidelberg/Mannheim（德国心血管研究中心（DZHK），海德堡/曼海姆合作站点）；Department of Radiology and Nuclear Medicine, University Medical Center Mannheim（曼海姆大学医学中心放射学与核医学系）；Section for Invasive Cardiology and Electrophysiology, I. Medical Department, Cardiology, Hemostasiology and Intensive Care, University Medical Centre Mannheim（曼海姆大学医学中心第一内科（心脏病学、止血学与重症监护）介入心脏病学与电生理学科）；University Medical Center of the Johannes Gutenberg-University Mainz（美因茨约翰内斯·古腾堡大学医学中心）；Department of Cardiology, Angiology, Hemostasis, and Medical Intensive Care, University Medical Centre Mannheim, Medical Faculty Mannheim, University of Heidelberg（海德堡大学曼海姆医学院曼海姆大学医学中心心脏病学、血管学、止血学与内科重症监护系）
本文提出CardioDiT，一种基于扩散变换器的4D潜在扩散模型，用于合成短轴 cine CMR，通过联合建模空间和时间实现连续心脏动态生成。
UltraTwin: Towards Cardiac Anatomical Twin Generation from Multi-view 2D Ultrasound
National-Regional Key Technology Engineering Laboratory for Medical Ultrasound（医学超声关键技术研发实验室）；School of Biomedical Engineering, Medical School, Shenzhen University（生物医学工程学院）；Faculty of Applied Sciences, Macao Polytechnic University（应用科学学院）；Centre for CIMIM, Manchester University（CIMIM研究中心）；Center for Cardiovascular Disease（心血管疾病中心）；The Affiliated Suzhou Hospital of Nanjing Medical University（南京医科大学附属苏州医院）；Suzhou Municipal Hospital, Gusu School, Suzhou, China（苏州 municipal 医院）；The First Affiliated Hospital of Kunming Medical University（昆明医科大学第一附属医院）；The First Affiliated Hospital of Anhui Medical University North（安徽医科大学北院）；The Second People’s Hospital（第二人民医院）；The First Affiliated Hospital of Anhui Medical University（安徽医科大学第一附属医院）；The People's Hospital of Tongren City（铜仁市人民医院）；The First People's Hospital of Taicang City（太仓市第一人民医院）；Guangdong Provincial People’s Hospital（广东省人民医院）
GE Vingmed Ultrasound, GE Healthcare（通用电气医疗集团GE Vingmed超声部门）；University of Oslo（奥斯陆大学）；Norwegian Computing Center（挪威计算中心）
Two-dimensional echocardiography (2DE) measurements of left ventricle (LV) dimensions are highly significant markers of several cardiovascular diseases. These measurements are often used in clinical care despite suffering from large variability between observers. This variability is due to the challenging nature of accurately finding the correct temporal and spatial location of measurement endpoints in ultrasound images. These images often contain fuzzy boundaries and varying reflection patterns between frames. In this work, we present a convolutional neural network (CNN) based approach to aut…
Retrieval-Augmented Anatomical Guidance for Text-to-CT Generation
Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy（人工智能与计算机系统单位，工程系，罗马生物医学大学，意大利罗马）；Department of Diagnostics and Intervention, Biomedical Engineering and Radiation Physics, Umeå University, Umeå, Sweden（诊断与介入系，生物医学工程与放射物理，乌梅大学，瑞典乌梅）
Crop and Couple: cardiac image segmentation using interlinked specialist networks
Queen Mary University of London（伦敦玛丽女王大学）；Queen Mary's Digital Environment Research Institute (DERI)（伦敦玛丽女王大学数字环境研究所）；University College London（伦敦大学学院）
Neural Implicit Heart Coordinates: 3D cardiac shape reconstruction from sparse segmentations
School of Biomedical Engineering and Imaging Sciences（生物医学工程与成像科学学院）；William Harvey Research Institute, NIHR Barts Biomedical Research Centre（威廉·哈里森研究机构、NIHR巴茨生物医学研究中心）；Simula Research Laboratory（Simula研究实验室）；Department of Informatics（信息学院）；Department of Bioengineering（生物工程学院）；Barts Heart Centre, Barts Health NHS Trust（巴茨心脏中心、巴茨健康 NHS信托）；Technical University of Munich（慕尼黑技术大学）
In nuclear imaging, limited resolution causes partial volume effects (PVEs) that affect image sharpness and quantitative accuracy. Partial volume correction (PVC) methods incorporating high-resolution anatomical information from CT or MRI have been demonstrated to be effective. However, such anatomical-guided methods typically require tedious image registration and segmentation steps. Accurately segmented organ templates are also hard to obtain, particularly in cardiac SPECT imaging, due to the lack of hybrid SPECT/CT scanners with high-end CT and associated motion artifacts. Slight mis-regist…
Amsterdam UMC, University of Amsterdam（阿姆斯特丹大学阿姆斯特丹大学医学中心）；Amsterdam University Medical Center, University of Amsterdam（阿姆斯特丹大学阿姆斯特丹大学医学中心）；University Medical Center Utrecht（乌得勒支大学医学中心）
Segmentation of cardiac anatomical structures in cardiac magnetic resonance images (CMRI) is a prerequisite for automatic diagnosis and prognosis of cardiovascular diseases. To increase robustness and performance of segmentation methods this study combines automatic segmentation and assessment of segmentation uncertainty in CMRI to detect image regions containing local segmentation failures. Three state-of-the-art convolutional neural networks (CNN) were trained to automatically segment cardiac anatomical structures and obtain two measures of predictive uncertainty: entropy and a measure deriv…
College of Physics and Information Engineering, Fuzhou University（福州大学物理与信息工程学院）；School of Basic Medical Science, Fudan University（复旦大学基础医学院）
Multi-sequence of cardiac magnetic resonance (CMR) images can provide complementary information for myocardial pathology (scar and edema). However, it is still challenging to fuse these underlying information for pathology segmentation effectively. This work presents an automatic cascade pathology segmentation framework based on multi-modality CMR images. It mainly consists of two neural networks: an anatomical structure segmentation network (ASSN) and a pathological region segmentation network (PRSN). Specifically, the ASSN aims to segment the anatomical structure where the pathology may exis…
Shape of my heart: Cardiac models through learned signed distance functions
Institute for Applied Mathematics, University of Bonn（波恩大学应用数学研究所）；University of Graz（格拉茨大学）；Institute for Biological and Medical Engineering, Pontificia Universidad Católica de Chile（智利天主教大学生物与医学工程研究所）；Center for Computational Medicine in Cardiology, Università della Svizzera italiana（瑞士意大利语区大学心血管计算医学中心）；FernUni Schweiz（瑞士远程教育大学）；Instituto Cardiocentro Ticino, EOC（提契诺心脏中心研究所（EOC））；University of Trento（特伦托大学）
MorphiNet: A Graph Subdivision Network for Adaptive Bi-ventricle Surface Reconstruction
School of Biomedical Engineering and Imaging Sciences, King’s College London（生物医学工程与影像科学学院，伦敦国王学院）；Brain Imaging & Neuro Epidemiology Department, Luxemboug Institute of Health（脑影像与神经流行病学部门，卢森堡健康研究所）；Department of Biostatistics and Health Informatics, King’s College London（生物统计学与健康信息学系，伦敦国王学院）
University of California, Los Angeles（加州大学洛杉矶分校）；University of Alberta（阿尔伯塔大学）；Mazankowski Alberta Heart Institute（马赞科夫斯基阿尔伯塔心脏研究所）
This study proposes a fully automated approach for the left atrial segmentation from routine cine long-axis cardiac magnetic resonance image sequences using deep convolutional neural networks and Bayesian filtering. The proposed approach consists of a classification network that automatically detects the type of long-axis sequence and three different convolutional neural network models followed by unscented Kalman filtering (UKF) that delineates the left atrium. Instead of training and predicting all long-axis sequence types together, the proposed approach first identifies the image sequence t…
DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learning
Imperial College London（帝国理工学院）；University of Birmingham（伯明翰大学）；MRC London Institute of Medical Sciences（英国医学研究理事会伦敦医学科学研究所）；Technical University Munich（慕尼黑工业大学）；Klinikum rechts der Isar（伊萨尔河畔临床教学中心）
本文提出 DeepMesh 学习框架，利用多视图二维 CMR 图像重建个体心脏三维网格并估计逐顶点运动场，在 UK Biobank 上优于现有图像与网格类方法。
Yale University（耶鲁大学）；Yale School of Medicine（耶鲁医学院）
Learning spatial-temporal correspondences in cardiac motion from images is important for understanding the underlying dynamics of cardiac anatomical structures. Many methods explicitly impose smoothness constraints such as the $\mathcal{L}_2$ norm on the displacement vector field (DVF), while usually ignoring biomechanical feasibility in the transformation. Other geometric constraints either regularize specific regions of interest such as imposing incompressibility on the myocardium or introduce additional steps such as training a separate network-based regularizer on physically simulated data…
University of Sherbrooke（舍布鲁克大学）；Univ Lyon（里昂大学）；Université Claude Bernard Lyon 1（里昂第一大学）；UJM-Saint Etienne（圣艾蒂安大学）；CNRS（法国国家科学研究中心）；Inserm（法国国家健康与医学研究院）；Institut Universitaire de France（法国大学研究院）
Convolutional neural networks (CNN) have demonstrated their ability to segment 2D cardiac ultrasound images. However, despite recent successes according to which the intra-observer variability on end-diastole and end-systole images has been reached, CNNs still struggle to leverage temporal information to provide accurate and temporally consistent segmentation maps across the whole cycle. Such consistency is required to accurately describe the cardiac function, a necessary step in diagnosing many cardiovascular diseases. In this paper, we propose a framework to learn the 2D+time apical long-axi…
We recently published a deep learning study on the potential of encoder-decoder networks for the segmentation of the 2D CAMUS ultrasound dataset. We propose in this abstract an extension of the evaluation criteria to anatomical assessment, as traditional geometric and clinical metrics in cardiac segmentation do not take into account the anatomical correctness of the predicted shapes. The completed study sheds a new light on the ranking of models.
Towards Robust Cardiac Segmentation using Graph Convolutional Networks
Norwegian University of Science and Technology（挪威科技大学）；University of Oslo（奥斯陆大学）；GE Research（GE研究中心）；St. Olavs hospital（圣奥拉夫斯医院）；Levanger hospital（莱旺厄尔医院）；SINTEF Health（辛特福健康研究院）
Imperial College London（伦敦帝国学院）；City, University of London（伦敦城市大学）；University of Birmingham（伯明翰大学）
Deep learning has become the most widely used approach for cardiac image segmentation in recent years. In this paper, we provide a review of over 100 cardiac image segmentation papers using deep learning, which covers common imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound (US) and major anatomical structures of interest (ventricles, atria and vessels). In addition, a summary of publicly available cardiac image datasets and code repositories are included to provide a base for encouraging reproducible research. Finally, we discuss the chall…
Many strides have been made in semantic segmentation of multiple classes within an image. This has been largely due to advancements in deep learning and convolutional neural networks (CNNs). Features within a CNN are automatically learned during training, which allows for the abstraction of semantic information within the images. These deep learning models are powerful enough to handle the segmentation of multiple classes without the need for multiple networks. Despite these advancements, few attempts have been made to automatically segment multiple anatomical features within medical imaging d…
University of Edinburgh（爱丁堡大学）；Imperial College London（帝国理工学院）；University of Essex（埃塞克斯大学）
Magnetic Resonance Imaging (MRI) typically recruits multiple sequences (defined here as "modalities"). As each modality is designed to offer different anatomical and functional clinical information, there are evident disparities in the imaging content across modalities. Inter- and intra-modality affine and non-rigid image registration is an essential medical image analysis process in clinical imaging, as for example before imaging biomarkers need to be derived and clinically evaluated across different MRI modalities, time phases and slices. Although commonly needed in real clinical scenarios, …
China University of Petroleum（中国石油大学）；Qingdao Women and Children’s Hospital（青岛市妇女儿童医院）
Echocardiography is a powerful prenatal examination tool for early diagnosis of fetal congenital heart diseases (CHDs). The four-chamber (FC) view is a crucial and easily accessible ultrasound (US) image among echocardiography images. Automatic analysis of FC views contributes significantly to the early diagnosis of CHDs. The first step to automatically analyze fetal FC views is locating the fetal four crucial chambers of heart in a US image. However, it is a greatly challenging task due to several key factors, such as numerous speckles in US images, the fetal cardiac chambers with small size …
University of Oxford（牛津大学）；Fuzhou University（福州大学）；Fudan University（复旦大学）
Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and improves the efficacy of cardiovascular interventions and clinical outcomes. Fully-automated processing and quantitative analysis of multi-modality cardiac images could have a direct impact on clinical research and evidence-based patient management. However, these require overcoming significant challenges including inter-modality misalignment and finding optima…
School of Data Science, Fudan University（复旦大学数据科学学院）
Cardiac segmentation from late gadolinium enhancement MRI is an important task in clinics to identify and evaluate the infarction of myocardium. The automatic segmentation is however still challenging, due to the heterogeneous intensity distributions and indistinct boundaries in the images. In this paper, we propose a new method, based on deep neural networks (DNN), for fully automatic segmentation. The proposed network, referred to as SRSCN, comprises a shape reconstruction neural network (SRNN) and a spatial constraint network (SCN). SRNN aims to maintain a realistic shape of the resulting s…
Learning from Acquisition: Metadata-driven Multimodal Pre-training for Cardiac MRI
Department of Surgery & Cancer（外科与癌症系）；Bioengineering Department and Imperial-X（生物工程系和Imperial-X）；National Heart and Lung Institute（国家心脏和肺研究所）；Cardiovascular Research Centre（心血管研究中心）；School of Biomedical Engineering & Imaging Sciences（生物医学工程与成像科学学院）
Imperial College London（帝国理工学院）；National University of Defense Technology（国防科技大学）；MRC London Institute of Medical Sciences（英国医学研究委员会伦敦医学科学研究所）；Technical University Munich（慕尼黑工业大学）
3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and diagnosis of cardiovascular diseases. Most of the previous methods focus on estimating pixel-/voxel-wise motion fields in the full image space, which ignore the fact that motion estimation is mainly relevant and useful within the object of interest, e.g., the heart. In this work, we model the heart as a 3D geometric mesh and propose a novel deep learning-based method that can estimate 3D motion of the heart mesh from 2D short- and long-axis CMR images. By developing a …
