Synthesis of Late Gadolinium Enhancement Images via Implicit Neural Representations for Cardiac Scar Segmentation
Amsterdam UMC, The Netherlands（阿姆斯特丹大学医学中心，荷兰）；University of Amsterdam, The Netherlands（阿姆斯特丹大学，荷兰）；Informatics Institute, University of Amsterdam, The Netherlands（阿姆斯特丹大学信息学院，荷兰）；Amsterdam Cardiovascular Sciences, Amsterdam UMC, The Netherlands（阿姆斯特丹心血管科学，阿姆斯特丹大学医学中心，荷兰）；Amsterdam Machine Learning Lab, University of Amsterdam, The Netherlands（阿姆斯特丹机器学习实验室，阿姆斯特丹大学，荷兰）；Department of Biomedical Engineering and Physics, Amsterdam UMC, The Netherlands（生物医学工程与物理系，阿姆斯特丹大学医学中心，荷兰）；Department of Experimental Cardiology, Amsterdam Cardiovascular Sciences, Heart Failure & Arrhythmias, Amsterdam UMC, The Netherlands（实验心脏病学系，阿姆斯特丹心血管科学，心力衰竭与心律失常，阿姆斯特丹大学医学中心，荷兰）；Department of Cardiology, Amsterdam UMC, The Netherlands（心脏病学系，阿姆斯特丹大学医学中心，荷兰）；Department of Radiology and Nuclear Medicine, Amsterdam UMC, The Netherlands（放射学与核医学系，阿姆斯特丹大学医学中心，荷兰）；Department of Radiology, Mayo Clinic, Rochester, United States of America（放射学系，梅奥诊所，罗切斯特，美国）
Soufiane Ben Haddou, Laura Alvarez-Florez, Erik J. Bekkers, Fleur V. Y. Tjong, Ahmad S. Amin, Connie R. Bezzina, Ivana Išgum
备注：
Paper accepted at SPIE Medical Imaging 2026 Conference
Late gadolinium enhancement (LGE) imaging is the clinical standard for myocardial scar assessment, but limited annotated datasets hinder the development of automated segmentation methods. We propose a novel framework that synthesises both LGE images and their corresponding segmentation masks using implicit neural representations (INRs) combined with denoising diffusion models. Our approach first trains INRs to capture continuous spatial representations of LGE data and associated myocardium and fibrosis masks. These INRs are then compressed into compact latent embeddings, preserving essential anatomical information. A diffusion model operates on this latent space to generate new representations, which are decoded into synthetic LGE images with anatomically consistent segmentation masks. Experiments on 133 cardiac MRI scans suggest that augmenting training data with 200 synthetic volumes contributes to improved fibrosis segmentation performance, with the Dice score showing an increase from 0.509 to 0.524. Our approach provides an annotation-free method to help mitigate data scarcity.The code for this research is publicly available.
Universitat de Barcelona（巴塞罗那大学）；Barts Health NHS Trust（巴特兹健康国民保健服务信托基金）；Queen Mary University of London（伦敦玛丽女王大学）；Universitat Pompeu Fabra（庞培法布拉大学）；ICREA（加泰罗尼亚研究与高级研究院）
Accurate segmentation of the cardiac boundaries in late gadolinium enhancement magnetic resonance images (LGE-MRI) is a fundamental step for accurate quantification of scar tissue. However, while there are many solutions for automatic cardiac segmentation of cine images, the presence of scar tissue can make the correct delineation of the myocardium in LGE-MRI challenging even for human experts. As part of the Multi-Sequence Cardiac MR Segmentation Challenge, we propose a solution for LGE-MRI segmentation based on two components. First, a generative adversarial network is trained for the task o…
Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling
Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences（苏州生物医学工程与技术研究所，中国科学院）；SyCoIA, IMT Mines Ales（SyCoIA，IMT Mines Ales）
Eindhoven University of Technology（埃因霍温理工大学）；Philips Healthcare（飞利浦医疗保健）；King’s College London（伦敦国王学院）
Background: The clinical utility of late gadolinium enhancement (LGE) cardiac MRI is limited by the lack of standardization, and time-consuming postprocessing. In this work, we tested the hypothesis that a cascaded deep learning pipeline trained with augmentation by synthetically generated data would improve model accuracy and robustness for automated scar quantification. Methods: A cascaded pipeline consisting of three consecutive neural networks is proposed, starting with a bounding box regression network to identify a region of interest around the left ventricular (LV) myocardium. Two furth…
Biomedical Image Analysis Group, Imperial College London（伦敦帝国理工学院生物医学图像分析小组）；Data Science Institute, Imperial College London（伦敦帝国理工学院数据科学研究所）；Department of Medicine, Imperial College London（伦敦帝国理工学院医学院）
In this work, we present a fully automatic method to segment cardiac structures from late-gadolinium enhanced (LGE) images without using labelled LGE data for training, but instead by transferring the anatomical knowledge and features learned on annotated balanced steady-state free precession (bSSFP) images, which are easier to acquire. Our framework mainly consists of two neural networks: a multi-modal image translation network for style transfer and a cascaded segmentation network for image segmentation. The multi-modal image translation network generates realistic and diverse synthetic LGE …
Arterys Inc.（Arterys公司）；University of Groningen, University Medical Center Groningen（格罗宁根大学格罗宁根大学医学中心）
Medical images with specific pathologies are scarce, but a large amount of data is usually required for a deep convolutional neural network (DCNN) to achieve good accuracy. We consider the problem of segmenting the left ventricular (LV) myocardium on late gadolinium enhancement (LGE) cardiovascular magnetic resonance (CMR) scans of which only some of the scans have scar tissue. We propose ScarGAN to simulate scar tissue on healthy myocardium using chained generative adversarial networks (GAN). Our novel approach factorizes the simulation process into 3 steps: 1) a mask generator to simulate th…
Myocardium segmentation of late gadolinium enhancement (LGE) Cardiac MR images is important for evaluation of infarction regions in clinical practice. The pathological myocardium in LGE images presents distinctive brightness and textures compared with the healthy tissues, making it much more challenging to be segment. Instead, the balanced-Steady State Free Precession (bSSFP) cine images show clearly boundaries and can be easily segmented. Given this fact, we propose a novel shape-transfer GAN for LGE images, which can 1) learn to generate realistic LGE images from bSSFP with the anatomical sh…
Seeing Beyond the Image: ECG and Anatomical Knowledge-Guided Myocardial Scar Segmentation from Late Gadolinium-Enhanced Images
School of Computer Science, University of Sheffield（谢菲尔德大学计算机科学学院）；Department of Cardiology, Trent Cardiac Centre, Nottingham City Hospital, Nottingham University Hospitals NHS Trust（诺丁汉大学医院NHS信托基金诺丁汉市医院特伦特心脏中心心脏病科）；School of Medicine, University of Nottingham（诺丁汉大学医学院）；Department of Engineering Science, University of Oxford（牛津大学工程科学系）
Fudan University（复旦大学）；Shanghai Jiao Tong University（上海交通大学）；Imperial College London（帝国理工学院）；Universitat de Barcelona（巴塞罗那大学）；Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；Harbin Institute of Technology（哈尔滨工业大学）；Southern University of Science and Technology（南方科技大学）；Technical University of Munich（慕尼黑工业大学）；INRIA（法国国家信息与自动化研究所）；Université Côte d’Azur（蔚蓝海岸大学）；NVIDIA（英伟达）；Xiamen University（厦门大学）；Sichuan University（四川大学）；Tencent AI Lab（腾讯人工智能实验室）
Accurate computing, analysis and modeling of the ventricles and myocardium from medical images are important, especially in the diagnosis and treatment management for patients suffering from myocardial infarction (MI). Late gadolinium enhancement (LGE) cardiac magnetic resonance (CMR) provides an important protocol to visualize MI. However, automated segmentation of LGE CMR is still challenging, due to the indistinguishable boundaries, heterogeneous intensity distribution and complex enhancement patterns of pathological myocardium from LGE CMR. Furthermore, compared with the other sequences LG…
National University of Singapore（新加坡国立大学）；National University Heart Centre（国立大学心脏中心）；National University Hospital（国立大学医院）
Late gadolinium enhanced (LGE) cardiac magnetic resonance (CMR) can directly visualize nonviable myocardium with hyperenhanced intensities with respect to normal myocardium. For heart attack patients, it is crucial to facilitate the decision of appropriate therapy by analyzing and quantifying their LGE CMR images. To achieve accurate quantification, LGE CMR images need to be processed in two steps: segmentation of the myocardium followed by classification of infarcts within the segmented myocardium. However, automatic segmentation is difficult usually due to the intensity heterogeneity of the …
Sun Yat-sen University（中山大学）；Royal Brompton Hospital（皇家布朗普顿医院）；Imperial College London（帝国理工学院）
Automated and accurate segmentations of left atrium (LA) and atrial scars from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images are in high demand for quantifying atrial scars. The previous quantification of atrial scars relies on a two-phase segmentation for LA and atrial scars due to their large volume difference (unbalanced atrial targets). In this paper, we propose an inter-cascade generative adversarial network, namely JAS-GAN, to segment the unbalanced atrial targets from LGE CMR images automatically and accurately in an end-to-end way. Firstly, JAS-GAN investigates a…
3D Cardiac Anatomy Generation Using Mesh Latent Diffusion Models
Department of Computer Science, University of Oxford（计算机科学系，牛津大学）；Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford（生物医学工程研究所，工程科学系，牛津大学）；Visual Geometry Group, Department of Engineering Science, University of Oxford（视觉几何组，工程科学系，牛津大学）；Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford（心血管医学部，拉德克利夫医学系，牛津大学）
National Heart and Lung Institute, Imperial College London（帝国理工学院国家心肺研究所）；Royal Brompton Hospital（皇家布朗普顿医院）；University of the Basque Country UPV/EHU（巴斯克大学）；TECNALIA, Basque Research and Technology Alliance（巴斯克研究与技术联盟TECNALIA）；Beihang University（北京航空航天大学）；Shenzhen Second People’s Hospital（深圳市第二人民医院）
Synthetic digital twins based on medical data accelerate the acquisition, labelling and decision making procedure in digital healthcare. A core part of digital healthcare twins is model-based data synthesis, which permits the generation of realistic medical signals without requiring to cope with the modelling complexity of anatomical and biochemical phenomena producing them in reality. Unfortunately, algorithms for cardiac data synthesis have been so far scarcely studied in the literature. An important imaging modality in the cardiac examination is three-directional CINE multi-slice myocardial…
Royal Brompton Hospital（皇家布朗普顿医院）；National Heart and Lung Institute, Imperial College London（帝国理工学院国家心肺研究所）；Fudan University（复旦大学）；Shanghai Jiao Tong University（上海交通大学）；University of Lincoln（林肯大学）；City University London（伦敦城市大学）
Purpose: Atrial fibrillation (AF) is the most common cardiac arrhythmia and is correlated with increased morbidity and mortality. It is associated with atrial fibrosis, which may be assessed non-invasively using late gadolinium-enhanced (LGE) magnetic resonance imaging (MRI) where scar tissue is visualised as a region of signal enhancement. In this study, we proposed a novel fully automatic pipeline to achieve an accurate and objective atrial scarring segmentation and assessment of LGE MRI scans for the AF patients. Methods: Our fully automatic pipeline uniquely combined: (1) a multi-atlas bas…
Balancing Fidelity, Utility, and Privacy in Synthetic Cardiac MRI Generation: A Comparative Study
University of Peradeniya, Sri Lanka（斯里兰卡大学）；University of Maryland, College Park, USA（美国马里兰大学 College Park 分校）；Tulane University School of Medicine, USA（美国 Tulane 大学医学院）；Simula Research Laboratory, Norway（挪威 Simula 研究实验室）；SimulaMet, Norway（挪威 SimulaMet）
Can Diffusion Models Bridge the Domain Gap in Cardiac MR Imaging?
Centre for Doctoral Training in AI for Medical Diagnosis and Care（人工智能医学诊断与护理博士培训中心）；School of Computing, University of Leeds（莱斯特大学计算机学院）；Leeds Cancer Centre, St James’s University Hospital, Leeds, UK（利兹癌症中心，圣詹姆斯大学医院，利兹，英国）
Synthetic Cardiac MRI Image Generation using Deep Generative Models
Department of Computer Engineering（计算机工程系）；University of Peradeniya（珀德尼亚大学）；University of Maryland（马里兰大学）；Department of Holistic Systems（整体系统系）；SimulaMet；Oslo, Norway（挪威奥斯陆）
LGE-Guided Cross-Modality Contrastive Learning for Gadolinium-Free Cardiomyopathy Screening in Cine CMR
School of Biomedical Engineering（生物医学工程学院）；State Key Laboratory of Advanced Medical Materials and Devices（先进医疗材料与设备国家重点实验室）；ShanghaiTech University（上海科技大学）；United Imaging Intelligence（联合影像智能）；Shanghai Clinical Research and Trial Center（上海临床研究与试验中心）；Capital Medical University（首都医科大学）；The First Hospital of Lanzhou University（兰州大学第一医院）
Robust Deep Learning for Myocardial Scar Segmentation in Cardiac MRI with Noisy Labels
Department of Cardiovascular Sciences, University of Leicester, Leicester, UK（莱斯特大学心血管科学系）；NIHR Leicester Biomedical Research Centre, Glenfield Hospital, Leicester, UK（莱斯特生物医学研究中心）；Department of Information Engineering and Mathematics, University of Siena, Italy（锡耶纳大学信息工程与数学系）；Department of Mathematics, University of Leicester, Leicester, UK（莱斯特大学数学系）；Department of Computer Science, University of Copenhagen, Copenhagen, DK（哥本哈根大学计算机科学系）
Auckland Bioengineering Institute, University of Auckland（奥克兰大学生物工程研究所）；Beihang University（北京航空航天大学）；Peking University（北京大学）；SenseTime Inc（商汤科技）；Tencent Jarvis Laboratory（腾讯Jarvis实验室）；Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；The Chinese University of Hong Kong（香港中文大学）；Shenzhen University（深圳大学）；Wuhan University（武汉大学）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；EPITA Research and Development Laboratory（EPITA研发实验室）；Imperial College London（伦敦帝国学院）；Shanghai Jiao Tong University（上海交通大学）；Fudan University（复旦大学）；Harbin Institute of Technology（哈尔滨工业大学）；University of Bologna（博洛尼亚大学）；Eindhoven University of Technology（埃因霍温理工大学）；Kings College London（伦敦国王学院）；University of Magdeburg（马格德堡大学）；Heidelberg University Hospital（海德堡大学医院）；Leiden University Medical Center（莱顿大学医学中心）；Universitat Pompeu Fabra（庞培法布拉大学）；Physense（Physense机构）
Segmentation of cardiac images, particularly late gadolinium-enhanced magnetic resonance imaging (LGE-MRI) widely used for visualizing diseased cardiac structures, is a crucial first step for clinical diagnosis and treatment. However, direct segmentation of LGE-MRIs is challenging due to its attenuated contrast. Since most clinical studies have relied on manual and labor-intensive approaches, automatic methods are of high interest, particularly optimized machine learning approaches. To address this, we organized the "2018 Left Atrium Segmentation Challenge" using 154 3D LGE-MRIs, currently the…
Fairness-Aware Data Augmentation for Cardiac MRI using Text-Conditioned Diffusion Models
Barcelona Artificial Intelligence in Medicine Lab (BCN-AIM)（巴塞罗那人工智能在医学实验室（BCN-AIM））；Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Spain（数学与计算机科学系，巴塞罗那大学，西班牙）；Helmholtz Center Munich（海德堡研究中心慕尼黑）；Technical University of Munich（慕尼黑技术大学）；William Harvey Research Institute, NIHR Barts Biomedical Research Centre, Queen Mary University London, Charterhouse Square, London, UK（威廉·哈维研究所，英国国家健康研究院巴特研究所，伦敦女王玛丽大学，查尔斯广场，伦敦，英国）；Barts Heart Centre, St Bartholomew’s Hospital, Barts Health NHS Trust, West Smithfield, London, UK（巴特心脏中心，圣巴塞洛缪医院，巴特健康国家卫生信托，西史密斯菲尔德，伦敦，英国）；Institució Catalana de Recerca i Estudis Avançats (ICREA)（加泰罗尼亚高级研究与教育研究所（ICREA））
Imperial College London（帝国理工学院）；Royal Brompton Hospital（皇家布朗普顿医院）
Segmentation of cardiac fibrosis and scar are essential for clinical diagnosis and can provide invaluable guidance for the treatment of cardiac diseases. Late Gadolinium enhancement (LGE) cardiovascular magnetic resonance (CMR) has been successful for its efficacy in guiding the clinical diagnosis and treatment reliably. For LGE CMR, many methods have demonstrated success in accurately segmenting scarring regions. Co-registration with other non-contrast-agent (non-CA) modalities, balanced steady-state free precession (bSSFP) and cine magnetic resonance imaging (MRI) for example, can further en…
National University of Singapore（新加坡国立大学）；National University Heart Centre（新加坡国立大学心脏中心）
Automatic segmentation of myocardium in Late Gadolinium Enhanced (LGE) Cardiac MR (CMR) images is often difficult due to the intensity heterogeneity resulting from accumulation of contrast agent in infarcted areas. In this paper, we propose an automatic segmentation framework that fully utilizes shared information between corresponding cine and LGE images of a same patient. Given myocardial contours in cine CMR images, the proposed framework achieves accurate segmentation of LGE CMR images in a coarse-to-fine manner. Affine registration is first performed between the corresponding cine and LGE…
University of Virginia（弗吉尼亚大学）；University of Virginia Health System（弗吉尼亚大学卫生系统）
Automated identification of myocardial scar from late gadolinium enhancement cardiac magnetic resonance images (LGE-CMR) is limited by image noise and artifacts such as those related to motion and partial volume effect. This paper presents a novel joint deep learning (JDL) framework that improves such tasks by utilizing simultaneously learned myocardium segmentations to eliminate negative effects from non-region-of-interest areas. In contrast to previous approaches treating scar detection and myocardium segmentation as separate or parallel tasks, our proposed method introduces a message passin…
Segmentation of the left atrial chamber and assessing its morphology, are essential for improving our understanding of atrial fibrillation, the most common type of cardiac arrhythmia. Automation of this process in 3D gadolinium enhanced-MRI (GE-MRI) data is desirable, as manual delineation is time-consuming, challenging and observer-dependent. Recently, deep convolutional neural networks (CNNs) have gained tremendous traction and achieved state-of-the-art results in medical image segmentation. However, it is difficult to incorporate local and global information without using contracting (pooli…
Metadata-Aware Adaptation of a Generative Foundation Model for Conditional CMR Synthesis
Facultat de Matemàtiques i Informàtica, Universitat de Barcelona（巴塞罗那大学数学与信息学院）；NIHR Barts Biomedical Research Centre（英国国立卫生研究院巴特生物医学研究中心）；St Bartholomew’s Hospital（圣巴塞洛缪医院）；Institució Catalana de Recerca i Estudis Avançats (ICREA)（加泰罗尼亚高级研究学院）
ScarNet: A Novel Foundation Model for Automated Myocardial Scar Quantification from LGE in Cardiac MRI
Northwestern University（西北大学）；Feinberg School of Medicine（费林伯格医学院）；University of Miami Miller School of Medicine（迈阿密大学米勒医学院）；Cedars-Sinai Medical Center（西达赛奈医疗中心）
Accurate cardiac computing, analysis and modeling from multi-modality images are important for the diagnosis and treatment of cardiac disease. Late gadolinium enhancement magnetic resonance imaging (LGE MRI) is a promising technique to visualize and quantify myocardial infarction (MI) and atrial scars. Automating quantification of MI and atrial scars can be challenging due to the low image quality and complex enhancement patterns of LGE MRI. Moreover, compared with the other sequences LGE MRIs with gold standard labels are particularly limited, which represents another obstacle for developing …
Johns Hopkins University School of Medicine（约翰斯·霍普金斯大学医学院）；Johns Hopkins University（约翰斯·霍普金斯大学）；Johns Hopkins Hospital（约翰斯·霍普金斯医院）
Visualizing disease-induced scarring and fibrosis in the heart on cardiac magnetic resonance (CMR) imaging with contrast enhancement (LGE) is paramount in characterizing disease progression and quantifying pathophysiological substrates of arrhythmias. However, segmentation and scar/fibrosis identification from LGE-CMR is an intensive manual process prone to large inter-observer variability. Here, we present a novel fully-automated anatomically-informed deep learning solution for left ventricle (LV) and scar/fibrosis segmentation and clinical feature extraction from LGE-CMR. The technology invo…
University of Bourgogne Franche-Comté（勃艮第-弗朗什孔泰大学）；University Hospital of Dijon（第戎大学医院）；CASIS company（CASIS公司）
Cardiac left ventricular (LV) segmentation from short-axis MRI acquired 10 minutes after the injection of a contrast agent (LGE-MRI) is a necessary step in the processing allowing the identification and diagnosis of cardiac diseases such as myocardial infarction. However, this segmentation is challenging due to high variability across subjects and the potential lack of contrast between structures. Then, the main objective of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI. To this end, 2.5 D residual neural n…
University of Burgundy（勃艮第大学）；Technical University of Munich（慕尼黑工业大学）；icometrix；Casis company（Casis公司）；University Hospital of Dijon（第戎大学医院）
Significance: Late gadolinium enhanced magnetic resonance imaging (LGE-MRI) is the gold standard technique for myocardial viability assessment. Although the technique accurately reflects the damaged tissue, there is no clinical standard for quantifying myocardial infarction (MI), demanding most algorithms to be expert dependent. Objectives and Methods: In this work a new automatic method for MI quantification from LGE-MRI is proposed. Our novel segmentation approach is devised for accurately detecting not only hyper-enhanced lesions, but also microvascular-obstructed areas. Moreover, it includ…
Synthesizing CTA Image Data for Type-B Aortic Dissection using Stable Diffusion Models
University of Galway（戈尔韦大学）；College of Science and Engineering, University of Galway（戈尔韦大学科学与工程学院）；Insight SFI Research Center for Data Analytics, University of Galway（戈尔韦大学Insight SFI数据分析研究中心）；University Hospital Galway（戈尔韦大学医院）
本研究基于用户文本提示词微调 Stable Diffusion 模型，仅用有限 CTA 图像输入生成具有急性 B 型主动脉夹层特征的合成心脏 CTA 图像，以缓解医学数据稀缺问题。
CLAIM: Clinically-Guided LGE Augmentation for Realistic and Diverse Myocardial Scar Synthesis and Segmentation
Insigneo Institute for in-silico, Medicine, University of Sheffield, Sheffield, UK（Insigneo医学研究所（in-silico），谢菲尔德大学）；School of Computer Science, University of Sheffield, Sheffield, UK（谢菲尔德大学计算机科学学院）；Department of Cardiology, Nottingham University Hospitals NHS Trust, Nottingham, UK（诺丁汉大学医院心脏科）；School of Medicine, University of Nottingham, Nottingham, UK（诺丁汉大学医学院）
Contrast-Free Myocardial Scar Segmentation in Cine MRI using Motion and Texture Fusion
University of Oxford（牛津大学）；University of Southampton（南安普顿大学）；National University of Singapore（新加坡国立大学）；Fudan University（复旦大学）；Zhongshan Hospital, Fudan University（复旦大学附属中山医院）
Medical image segmentation has significantly benefitted thanks to deep learning architectures. Furthermore, semi-supervised learning (SSL) has recently been a growing trend for improving a model's overall performance by leveraging abundant unlabeled data. Moreover, learning multiple tasks within the same model further improves model generalizability. To generate smoother and accurate segmentation masks from 3D cardiac MR images, we present a Multi-task Cross-task learning consistency approach to enforce the correlation between the pixel-level (segmentation) and the geometric-level (distance ma…
University of Dundee（邓迪大学）；Technical University of Munich（慕尼黑工业大学）；Shenzhen Institute of Artificial Intelligence and Robotics for Society（深圳人工智能与机器人研究院）；Southern University of Science and Technology（南方科技大学）
Analysis and modeling of the ventricles and myocardium are important in the diagnostic and treatment of heart diseases. Manual delineation of those tissues in cardiac MR (CMR) scans is laborious and time-consuming. The ambiguity of the boundaries makes the segmentation task rather challenging. Furthermore, the annotations on some modalities such as Late Gadolinium Enhancement (LGE) MRI, are often not available. We propose an end-to-end segmentation framework based on convolutional neural network (CNN) and adversarial learning. A dilated residual U-shape network is used as a segmentor to genera…
Anhui University（安徽大学）；Sun Yat-Sen University（中山大学）；Royal Brompton Hospital（皇家布朗普顿医院）；Imperial College London（帝国理工学院）
Deep learning based task systems normally rely on a large amount of manually labeled training data, which is expensive to obtain and subject to operator variations. Moreover, it does not always hold that the manually labeled data and the unlabeled data are sitting in the same distribution. In this paper, we alleviate these problems by proposing a discriminative consistent domain generation (DCDG) approach to achieve a semi-supervised learning. The discriminative consistent domain is achieved by a double-sided domain adaptation. The double-sided domain adaptation aims to make a fusion of the fe…
Southeast University（东南大学）；Shenzhen University（深圳大学）；Fudan University（复旦大学）；Shanghai Jiao Tong University（上海交通大学）；Kings College London（伦敦国王学院）；Affiliated Drum Tower Hospital of Nanjing University Medical School（南京大学医学院附属鼓楼医院）
Multi-sequence cardiac magnetic resonance (CMR) provides essential pathology information (scar and edema) to diagnose myocardial infarction. However, automatic pathology segmentation can be challenging due to the difficulty of effectively exploring the underlying information from the multi-sequence CMR data. This paper aims to tackle the scar and edema segmentation from multi-sequence CMR with a novel auto-weighted supervision framework, where the interactions among different supervised layers are explored under a task-specific objective using reinforcement learning. Furthermore, we design a c…
University of Alberta（阿尔伯塔大学）；Mazankowski Alberta Heart Institute（马赞科夫斯基阿尔伯塔心脏研究所）
Myocardial characterization is essential for patients with myocardial infarction and other myocardial diseases, and the assessment is often performed using cardiac magnetic resonance (CMR) sequences. In this study, we propose a fully automated approach using deep convolutional neural networks (CNN) for cardiac pathology segmentation, including left ventricular (LV) blood pool, right ventricular blood pool, LV normal myocardium, LV myocardial edema (ME) and LV myocardial scars (MS). The input to the network consists of three CMR sequences, namely, late gadolinium enhancement (LGE), T2 and balan…
School of Data Science, Fudan University（复旦大学数据科学学院）
Cardiac segmentation from late gadolinium enhancement MRI is an important task in clinics to identify and evaluate the infarction of myocardium. The automatic segmentation is however still challenging, due to the heterogeneous intensity distributions and indistinct boundaries in the images. In this paper, we propose a new method, based on deep neural networks (DNN), for fully automatic segmentation. The proposed network, referred to as SRSCN, comprises a shape reconstruction neural network (SRNN) and a spatial constraint network (SCN). SRNN aims to maintain a realistic shape of the resulting s…
In this work, we attempt the segmentation of cardiac structures in late gadolinium-enhanced (LGE) magnetic resonance images (MRI) using only minimal supervision in a two-step approach. In the first step, we register a small set of five LGE cardiac magnetic resonance (CMR) images with ground truth labels to a set of 40 target LGE CMR images without annotation. Each manually annotated ground truth provides labels of the myocardium and the left ventricle (LV) and right ventricle (RV) cavities, which are used as atlases. After multi-atlas label fusion by majority voting, we possess noisy labels fo…
Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；University of Leeds（利兹大学）
Left ventricle segmentation and morphological assessment are essential for improving diagnosis and our understanding of cardiomyopathy, which in turn is imperative for reducing risk of myocardial infarctions in patients. Convolutional neural network (CNN) based methods for cardiac magnetic resonance (CMR) image segmentation rely on supervision with pixel-level annotations, and may not generalize well to images from a different domain. These methods are typically sensitive to variations in imaging protocols and data acquisition. Since annotating multi-sequence CMR images is tedious and subject …
National University of Singapore（新加坡国立大学）；National University Heart Centre（新加坡国立大学心脏中心）；National University Hospital（新加坡国立大学医院）
Automatic segmentation of the left ventricle (LV) in late gadolinium enhanced (LGE) cardiac MR (CMR) images is difficult due to the intensity heterogeneity arising from accumulation of contrast agent in infarcted myocardium. In this paper, we present a comprehensive framework for automatic 3D segmentation of the LV in LGE CMR images. Given myocardial contours in cine images as a priori knowledge, the framework initially propagates the a priori segmentation from cine to LGE images via 2D translational registration. Two meshes representing respectively endocardial and epicardial surfaces are the…
College of Physics and Information Engineering, Fuzhou University（福州大学物理与信息工程学院）；School of Basic Medical Science, Fudan University（复旦大学基础医学院）
Multi-sequence of cardiac magnetic resonance (CMR) images can provide complementary information for myocardial pathology (scar and edema). However, it is still challenging to fuse these underlying information for pathology segmentation effectively. This work presents an automatic cascade pathology segmentation framework based on multi-modality CMR images. It mainly consists of two neural networks: an anatomical structure segmentation network (ASSN) and a pathological region segmentation network (PRSN). Specifically, the ASSN aims to segment the anatomical structure where the pathology may exis…
Fuzhou University（福州大学）；College of Physics and Information Engineering, Fuzhou University（福州大学物理与信息工程学院）
Automatic segmentation of left atrial (LA) scars from late gadolinium enhanced CMR images is a crucial step for atrial fibrillation (AF) recurrence analysis. However, delineating LA scars is tedious and error-prone due to the variation of scar shapes. In this work, we propose a boundary-aware LA scar segmentation network, which is composed of two branches to segment LA and LA scars, respectively. We explore the inherent spatial relationship between LA and LA scars. By introducing a Sobel fusion module between the two segmentation branches, the spatial information of LA boundaries can be propag…
LA-CaRe-CNN: Cascading Refinement CNN for Left Atrial Scar Segmentation
Gottfried Schatz Research Center: Medical Physics and Biophysics（戈特弗里德·施蔡茨研究所以及生物物理学）；Medical University of Graz（格拉茨医科大学）；Institute of Computer Graphics and Vision（计算机图形学与视觉研究所）；Graz University of Technology（格拉茨理工大学）；AVL List GmbH；Institute for Medical Informatics, Statistics and Documentation（医学信息学、统计学与文档研究所）
Friedrich-Alexander-University Erlangen-Nuremberg（弗里德里希-亚历山大-埃尔朗根-纽伦堡大学）；University of Leeds（利兹大学）；CISTIB, Centre for Computational Imaging and Simulation Technologies in Biomedicine（生物医学计算成像与模拟技术中心）；School of Computing（计算机学院）；LICAMM Leeds Institute of Cardiovascular and Metabolic Medicine（利兹心血管与代谢医学研究所）；School of Medicine（医学院）
Deep learning models are sensitive to domain shift phenomena. A model trained on images from one domain cannot generalise well when tested on images from a different domain, despite capturing similar anatomical structures. It is mainly because the data distribution between the two domains is different. Moreover, creating annotation for every new modality is a tedious and time-consuming task, which also suffers from high inter- and intra- observer variability. Unsupervised domain adaptation (UDA) methods intend to reduce the gap between source and target domains by leveraging source domain labe…
CineMyoPS: Segmenting Myocardial Pathologies from Cine Cardiac MR
School of Medical Imaging, Fujian Medical University（福建医科大学医学影像学院）；College of Physics and Information Engineering, Fuzhou University（福州大学物理与信息工程学院）；Department of Biomedical Engineering, National University of Singapore（新加坡国立大学生物医学工程系）；School of Data Science, Fudan University（复旦大学数据科学学院）；Department of Radiology, Renji Hospital, School of Medicine, Shanghai Jiao Tong University（上海交通大学医学院仁济医院放射科）
Imperial College London（伦敦帝国学院）；City, University of London（伦敦城市大学）；University of Birmingham（伯明翰大学）
Deep learning has become the most widely used approach for cardiac image segmentation in recent years. In this paper, we provide a review of over 100 cardiac image segmentation papers using deep learning, which covers common imaging modalities including magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound (US) and major anatomical structures of interest (ventricles, atria and vessels). In addition, a summary of publicly available cardiac image datasets and code repositories are included to provide a base for encouraging reproducible research. Finally, we discuss the chall…
Personalized 3D Myocardial Infarct Geometry Reconstruction from Cine MRI for Cardiac Digital Twins
Department of Biomedical Engineering, National University of Singapore（新加坡国立大学生物医学工程系）；Department of Medicine, National University of Singapore（新加坡国立大学医学系）；Department of Cardiology, National University Heart Centre Singapore（新加坡国立心脏中心心内科部）
