CineMyoPS: Segmenting Myocardial Pathologies from Cine Cardiac MR
School of Medical Imaging, Fujian Medical University(福建医科大学医学影像学院);College of Physics and Information Engineering, Fuzhou University(福州大学物理与信息工程学院);Department of Biomedical Engineering, National University of Singapore(新加坡国立大学生物医学工程系);School of Data Science, Fudan University(复旦大学数据科学学院);Department of Radiology, Renji Hospital, School of Medicine, Shanghai Jiao Tong University(上海交通大学医学院仁济医院放射科)
Myocardial infarction (MI) is a leading cause of death worldwide. Late gadolinium enhancement (LGE) and T2-weighted cardiac magnetic resonance (CMR) imaging can respectively identify scarring and edema areas, both of which are essential for MI risk stratification and prognosis assessment. Although combining complementary information from multi-sequence CMR is useful, acquiring these sequences can be time-consuming and prohibitive, e.g., due to the administration of contrast agents. Cine CMR is a rapid and contrast-free imaging technique that can visualize both motion and structural abnormalities of the myocardium induced by acute MI. Therefore, we present a new end-to-end deep neural network, referred to as CineMyoPS, to segment myocardial pathologies, \ie scars and edema, solely from cine CMR images. Specifically, CineMyoPS extracts both motion and anatomy features associated with MI. Given the interdependence between these features, we design a consistency loss (resembling the co-training strategy) to facilitate their joint learning. Furthermore, we propose a time-series aggregation strategy to integrate MI-related features across the cardiac cycle, thereby enhancing segmentation accuracy for myocardial pathologies. Experimental results on a multi-center dataset demonstrate that CineMyoPS achieves promising performance in myocardial pathology segmentation, motion estimation, and anatomy segmentation.
National University of Singapore(新加坡国立大学);National University Heart Centre(新加坡国立大学心脏中心)
Automatic segmentation of myocardium in Late Gadolinium Enhanced (LGE) Cardiac MR (CMR) images is often difficult due to the intensity heterogeneity resulting from accumulation of contrast agent in infarcted areas. In this paper, we propose an automatic segmentation framework that fully utilizes shared information between corresponding cine and LGE images of a same patient. Given myocardial contours in cine CMR images, the proposed framework achieves accurate segmentation of LGE CMR images in a coarse-to-fine manner. Affine registration is first performed between the corresponding cine and LGE…
Contrast-Free Myocardial Scar Segmentation in Cine MRI using Motion and Texture Fusion
University of Oxford(牛津大学);University of Southampton(南安普顿大学);National University of Singapore(新加坡国立大学);Fudan University(复旦大学);Zhongshan Hospital, Fudan University(复旦大学附属中山医院)
University of Kansas(堪萨斯大学);Rochester Institute of Technology(罗切斯特理工学院)
Patient-specific left ventricle (LV) myocardial models have the potential to be used in a variety of clinical scenarios for improved diagnosis and treatment plans. Cine cardiac magnetic resonance (MR) imaging provides high resolution images to reconstruct patient-specific geometric models of the LV myocardium. With the advent of deep learning, accurate segmentation of cardiac chambers from cine cardiac MR images and unsupervised learning for image registration for cardiac motion estimation on a large number of image datasets is attainable. Here, we propose a deep leaning-based framework for th…
Personalized 3D Myocardial Infarct Geometry Reconstruction from Cine MRI with Explicit Cardiac Motion Modeling
Department of Biomedical Engineering, National University of Singapore, Singapore(新加坡国立大学生物医学工程系);Department of Computer Science, National University of Singapore, Singapore(新加坡国立大学计算机科学系);Auckland Bioengineering Institute, University of Auckland, Auckland, New Zealand(奥克兰大学生物工程研究所);School of Biomedical Engineering and Imaging Sciences, King’s College London, UK(伦敦国王学院生物医学工程与成像科学学校);Department of Medicine, National University of Singapore, Singapore(新加坡国立大学医学系);Department of Cardiology, National University Heart Centre Singapore, Singapore(新加坡国立心脏中心心血管科)
Brigham and Women's Hospital(布莱根妇女医院);Harvard Medical School(哈佛医学院);Bariloche Atomic Center(巴里洛切原子中心);CONICET(阿根廷国家科学与技术研究委员会);Instituto Balseiro(巴尔塞罗研究所);Universidad Nacional de Cuyo(库约国立大学);Sanatorio San Carlos(圣卡洛斯疗养院);INTECNUS(INTECNUS研究所);CNEA – Comisión Nacional de Energía Atómica(阿根廷国家原子能委员会)
Background: Artificial intelligence techniques have demonstrated great potential in cardiology, especially to detect imperceptible patterns for the human eye. In this sense, these techniques seem to be adequate to identify patterns in the myocardial texture which could lead to characterize and quantify fibrosis. Purpose: The aim of this study was to postulate a new artificial intelligence method to identify fibrosis in cine cardiac magnetic resonance (CMR) imaging. Methods: A retrospective observational study was carried out in a population of 75 subjects from a clinical center of San Carlos d…
Imperial College London(帝国理工学院);Technical University Munich(慕尼黑工业大学);University of Edinburgh(爱丁堡大学);MRC London Institute of Medical Sciences(MRC伦敦医学科学研究所)
Recovering the 3D motion of the heart from cine cardiac magnetic resonance (CMR) imaging enables the assessment of regional myocardial function and is important for understanding and analyzing cardiovascular disease. However, 3D cardiac motion estimation is challenging because the acquired cine CMR images are usually 2D slices which limit the accurate estimation of through-plane motion. To address this problem, we propose a novel multi-view motion estimation network (MulViMotion), which integrates 2D cine CMR images acquired in short-axis and long-axis planes to learn a consistent 3D motion fi…
University of Virginia(弗吉尼亚大学);University of Virginia Health System(弗吉尼亚大学卫生系统)
The selection of an optimal pacing site, which is ideally scar-free and late activated, is critical to the response of cardiac resynchronization therapy (CRT). Despite the success of current approaches formulating the detection of such late mechanical activation (LMA) regions as a problem of activation time regression, their accuracy remains unsatisfactory, particularly in cases where myocardial scar exists. To address this issue, this paper introduces a multi-task deep learning framework that simultaneously estimates LMA amount and classify the scar-free LMA regions based on cine displacement…
University of Edinburgh(爱丁堡大学);Fudan University(复旦大学);Imperial College London(帝国理工学院);Technical University of Munich(慕尼黑工业大学)
Myocardial motion and deformation are rich descriptors that characterize cardiac function. Image registration, as the most commonly used technique for myocardial motion tracking, is an ill-posed inverse problem which often requires prior assumptions on the solution space. In contrast to most existing approaches which impose explicit generic regularization such as smoothness, in this work we propose a novel method that can implicitly learn an application-specific biomechanics-informed prior and embed it into a neural network-parameterized transformation model. Particularly, the proposed method …
Fuzhou University(福州大学);University of Oxford(牛津大学);Fudan University(复旦大学);Zhongshan Hospital, Fudan University(复旦大学附属中山医院);Shanghai Medical School, Fudan University(复旦大学上海医学院);Shanghai Institute of Medical Imaging(上海医学影像研究所)
Myocardial pathology segmentation (MyoPS) is critical for the risk stratification and treatment planning of myocardial infarction (MI). Multi-sequence cardiac magnetic resonance (MS-CMR) images can provide valuable information. For instance, balanced steady-state free precession cine sequences present clear anatomical boundaries, while late gadolinium enhancement and T2-weighted CMR sequences visualize myocardial scar and edema of MI, respectively. Existing methods usually fuse anatomical and pathological information from different CMR sequences for MyoPS, but assume that these images have bee…
Myocardium segmentation of late gadolinium enhancement (LGE) Cardiac MR images is important for evaluation of infarction regions in clinical practice. The pathological myocardium in LGE images presents distinctive brightness and textures compared with the healthy tissues, making it much more challenging to be segment. Instead, the balanced-Steady State Free Precession (bSSFP) cine images show clearly boundaries and can be easily segmented. Given this fact, we propose a novel shape-transfer GAN for LGE images, which can 1) learn to generate realistic LGE images from bSSFP with the anatomical sh…
National Heart and Lung Institute, Imperial College London(帝国理工学院国家心肺研究所);Royal Brompton Hospital(皇家布朗普顿医院);University of the Basque Country UPV/EHU(巴斯克大学);TECNALIA, Basque Research and Technology Alliance(巴斯克研究与技术联盟TECNALIA);Beihang University(北京航空航天大学);Shenzhen Second People’s Hospital(深圳市第二人民医院)
Synthetic digital twins based on medical data accelerate the acquisition, labelling and decision making procedure in digital healthcare. A core part of digital healthcare twins is model-based data synthesis, which permits the generation of realistic medical signals without requiring to cope with the modelling complexity of anatomical and biochemical phenomena producing them in reality. Unfortunately, algorithms for cardiac data synthesis have been so far scarcely studied in the literature. An important imaging modality in the cardiac examination is three-directional CINE multi-slice myocardial…
National University of Singapore(新加坡国立大学);National University Heart Centre(新加坡国立大学心脏中心);National University Hospital(新加坡国立大学医院)
Automatic segmentation of the left ventricle (LV) in late gadolinium enhanced (LGE) cardiac MR (CMR) images is difficult due to the intensity heterogeneity arising from accumulation of contrast agent in infarcted myocardium. In this paper, we present a comprehensive framework for automatic 3D segmentation of the LV in LGE CMR images. Given myocardial contours in cine images as a priori knowledge, the framework initially propagates the a priori segmentation from cine to LGE images via 2D translational registration. Two meshes representing respectively endocardial and epicardial surfaces are the…
Improve Myocardial Strain Estimation based on Deformable Groupwise Registration with a Locally Low-Rank Dissimilarity Metric
Shanghai Jiao Tong University(上海交通大学);School of Biomedical Engineering(生物医学工程学院);National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy(国家医学诊疗先进磁共振技术工程研究中心);Renji Hospital, School of Medicine, Shanghai Jiao Tong University(上海交通大学医学院附属仁济医院)
National Heart and Lung Institute, Imperial College London(帝国理工学院国家心肺研究所);Imperial College London(帝国理工学院);Royal Brompton Hospital(皇家布朗普顿医院)
Temporal patterns of cardiac motion provide important information for cardiac disease diagnosis. This pattern could be obtained by three-directional CINE multi-slice left ventricular myocardial velocity mapping (3Dir MVM), which is a cardiac MR technique providing magnitude and phase information of the myocardial motion simultaneously. However, long acquisition time limits the usage of this technique by causing breathing artifacts, while shortening the time causes low temporal resolution and may provide an inaccurate assessment of cardiac motion. In this study, we proposed a frame synthesis al…
Multi-Source and Multi-Sequence Myocardial Pathology Segmentation Using a Cascading Refinement CNN
Institute of Computer Graphics and Vision, Graz University of Technology(格拉茨工业大学计算机图形学与视觉研究所);AVL List GmbH(AVL List 有限公司);Institute for Medical Informatics, Statistics and Documentation, Medical University of Graz(格拉茨医科大学医学信息学、统计学与文献学研究所)
Universitat Pompeu Fabra(庞培法布拉大学);BCN MedTech(巴塞罗那医疗科技中心);Queen Mary University of London(伦敦玛丽女王大学);William Harvey Research Institute(威廉·哈维研究所);Stanford University(斯坦福大学);Catalan Institution for Research and Advanced Studies (ICREA)(加泰罗尼亚研究与高级研究所)
Use expert visualization or conventional clinical indices can lack accuracy for borderline classications. Advanced statistical approaches based on eigen-decomposition have been mostly concerned with shape and motion indices. In this paper, we present a new approach to identify CVDs from cine-MRI by estimating large pools of radiomic features (statistical, shape and textural features) encoding relevant changes in anatomical and image characteristics due to CVDs. The calculated cine-MRI radiomic features are assessed using sequential forward feature selection to identify the most relevant ones f…
In the clinical environment, myocardial infarction (MI) as one com-mon cardiovascular disease is mainly evaluated based on the late gadolinium enhancement (LGE) cardiac magnetic resonance images (CMRIs). The auto-matic segmentations of left ventricle (LV), right ventricle (RV), and left ven-tricular myocardium (LVM) in the LGE CMRIs are desired for the aided diag-nosis in clinic. To accomplish this segmentation task, this paper proposes a modified U-net architecture by combining multi-sequence CMRIs, including the cine, LGE, and T2-weighted CMRIs. The cine and T2-weighted CMRIs are used to ass…
University of Bourgogne Franche-Comte(勃艮第-弗朗什-孔泰大学);CASIS inc.(CASIS公司);University of Sherbrooke(舍布鲁克大学);University Hospital of Dijon(第戎大学医院)
Deep learning methods are the de-facto solutions to a multitude of medical image analysis tasks. Cardiac MRI segmentation is one such application which, like many others, requires a large number of annotated data so a trained network can generalize well. Unfortunately, the process of having a large number of manually curated images by medical experts is both slow and utterly expensive. In this paper, we set out to explore whether expert knowledge is a strict requirement for the creation of annotated datasets that machine learning can successfully train on. To do so, we gauged the performance o…
MCM: Mamba-based Cardiac Motion Tracking using Sequential Images in MRI
School of Computer Science, University of Birmingham(英国伯明翰大学计算机科学学院);Division of Informatics, Imaging and Data Sciences, University of Manchester(曼彻斯特大学信息学与数据科学系);Centre for Computational Imaging and Modelling in Medicine, University of Manchester(曼彻斯特大学医学计算成像与建模中心);Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(广东省计算机视觉与虚拟现实技术重点实验室,深圳先进技术研究院,中国科学院);MRC Laboratory of Medical Sciences, Imperial College London(伦敦帝国理工学院医学科学实验室);UKRI CDT in AI for Healthcare, Imperial College London(伦敦帝国理工学院人工智能与医疗健康CDT);Department of Computing, Imperial College London(伦敦帝国理工学院计算机科学系)
Extreme Cardiac MRI Analysis under Respiratory Motion: Results of the CMRxMotion Challenge
Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, Shanghai 200032, China;Shanghai Key Laboratory of MICCAI, Fudan University, Shanghai, Shanghai 200032, China;Department of Electrical;Electronic Engineering \& I-X, Imperial College London, London, London SW7 2AZ, United Kingdom;Department of Radiology, Zhongshan Hospital Affiliated to Fudan University, Shanghai, Shanghai 200032, China;Department of Computing, Imperial College London, London, London SW7 2AZ, United Kingdom;School of Computer Science, University of Sheffield, Sheffield, S1 4DP, United Kingdom;Department of Engineering Science, University of Oxford, Oxford, OX2 0ES, United Kingdom;Shanghai Pudong Hospital;Human Phenome Institute, Fudan University, Shanghai, 201203, China;School of Computer Science, University of Nottingham, Nottingham, NG8 1BB, United Kingdom;Diagnostic Imaging, University of Alberta, Edmonton, AB T6G 1K4, Canada;Department of Computer Science;Engineering, The Chinese University of Hong Kong, Hong Kong, Hong Kong 000000, China;The D-Lab, Department of Precision Medicine, GROW - Research Institute for Oncology;Reproduction, Maastricht University, 6220 MD Maastricht, The Netherlands;Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven 5612 AZ, The Netherlands;Department of Radiology, Northwestern University, 737 N. Michigan Ave, Suite 1600, Chicago 60611, United States;United Imaging Research, 393 Middle Huaxia Road, Pudong, Shanghai 201210, China;Division of Image Processing, Department of Radiology, Leiden University Medical Center, PO Box 9600, Leiden 2300 RC, The Netherlands;Université Bourgogne Europe, CNRS, ICMUB UMR 6302, 21000 Dijon, France;Istanbul Technical University, Maslak, 34467, İstanbul, Türkiye;Computer Science, Technical University of Darmstadt, Karolinenpl. 5, 64289 Darmstadt, Germany;Lung Institute, Faculty of Medicine, Imperial College London, Guy Scadding Building, Cale Street, London, SW3 6LY,United Kingdom;Hawkes Institute, Department of Computer Science, University College London, 66-72 Gower St, London, United Kingdom;School of Medicine, University College Dublin, Belfield, Dublin, D04 V1W8, Ireland;CeADAR: Ireland's Centre for AI, University College Dublin, Belfield, Dublin, D04 V1W8, Ireland;Sano Centre for Computational Medicine, Czarnowiejska 36, 30-054, Krakow, Poland;Faculty of Mathematics;Computer Science, Jagiellonian University, S. Łojasiewicza 6, Krakow, Poland;Department of Electronic;Computer Engineering, The Hong Kong University of Science;School of Instrument Science;Engineering, Southeast University, Nanjing, Nanjing 210096, China;College of Artificial Intelligence, Nanjing University of Aeronautics;Academy for Engineering;Technology, Fudan University, Shanghai, Shanghai 200433, China;College of Biomedical Engineering, Fudan University, Shanghai, Shanghai 200433, China;Institute of Science;Technology for Brain-inspired Intelligence, Fudan University, Shanghai, Shanghai 200433, China;Department of Brain Sciences, Imperial College London, London, London SW7 2AZ, United Kingdom;Data Science Institute, Imperial College London, London, London SW7 2AZ, United Kingdom