MyI-Net: Fully Automatic Detection and Quantification of Myocardial Infarction from Cardiovascular MRI Images
University of Leicester（莱斯特大学）；NIHR Leicester Biomedical Research Centre（NIHR莱斯特生物医学研究中心）；Glenfield Hospital（格伦菲尔德医院）；Norwegian University of Science and Technology (NTNU)（挪威科技大学）；Saint-Petersburg State Electrotechnical University（圣彼得堡国立电工大学）
Shuihua Wang, Ahmed M. S. E. K Abdelaty, Kelly Parke, J Ranjit Arnold, Gerry P McCann, Ivan Y Tyukin
A "heart attack" or myocardial infarction (MI), occurs when an artery supplying blood to the heart is abruptly occluded. The "gold standard" method for imaging MI is Cardiovascular Magnetic Resonance Imaging (MRI), with intravenously administered gadolinium-based contrast (late gadolinium enhancement). However, no "gold standard" fully automated method for the quantification of MI exists. In this work, we propose an end-to-end fully automatic system (MyI-Net) for the detection and quantification of MI in MRI images. This has the potential to reduce the uncertainty due to the technical variability across labs and inherent problems of the data and labels. Our system consists of four processing stages designed to maintain the flow of information across scales. First, features from raw MRI images are generated using feature extractors built on ResNet and MoblieNet architectures. This is followed by the Atrous Spatial Pyramid Pooling (ASPP) to produce spatial information at different scales to preserve more image context. High-level features from ASPP and initial low-level features are concatenated at the third stage and then passed to the fourth stage where spatial information is recovered via up-sampling to produce final image segmentation output into: i) background, ii) heart muscle, iii) blood and iv) scar areas. New models were compared with state-of-art models and manual quantification. Our models showed favorable performance in global segmentation and scar tissue detection relative to state-of-the-art work, including a four-fold better performance in matching scar pixels to contours produced by clinicians.
This work evaluates deep learning-based myocardial infarction (MI) quantification using Segment cardiovascular magnetic resonance (CMR) software. Segment CMR software incorporates the expectation-maximization, weighted intensity, a priori information (EWA) algorithm used to generate the infarct scar volume, infarct scar percentage, and microvascular obstruction percentage. Here, Segment CMR software segmentation algorithm is updated with semantic segmentation with U-net to achieve and evaluate fully automated or deep learning-based MI quantification. The direct observation of graphs and the nu…
Automatic segmentation of myocardial contours and relevant areas like infraction and no-reflow is an important step for the quantitative evaluation of myocardial infarction. In this work, we propose a cascaded convolutional neural network for automatic myocardial infarction segmentation from delayed-enhancement cardiac MRI. We first use a 2D U-Net to focus on the intra-slice information to perform a preliminary segmentation. After that, we use a 3D U-Net to utilize the volumetric spatial information for a subtle segmentation. Our method is evaluated on the MICCAI 2020 EMIDEC challenge dataset …
Multi-Source and Multi-Sequence Myocardial Pathology Segmentation Using a Cascading Refinement CNN
Institute of Computer Graphics and Vision, Graz University of Technology（格拉茨工业大学计算机图形学与视觉研究所）；AVL List GmbH（AVL List 有限公司）；Institute for Medical Informatics, Statistics and Documentation, Medical University of Graz（格拉茨医科大学医学信息学、统计学与文献学研究所）
ImViA Laboratory, University of Burgundy（勃艮第大学ImViA实验室）；CHU Dijon（第戎大学医院）；CGFL；Institut Curie（居里研究所）
In this paper, we propose a new deep learning framework for an automatic myocardial infarction evaluation from clinical information and delayed enhancement-MRI (DE-MRI). The proposed framework addresses two tasks. The first task is automatic detection of myocardial contours, the infarcted area, the no-reflow area, and the left ventricular cavity from a short-axis DE-MRI series. It employs two segmentation neural networks. The first network is used to segment the anatomical structures such as the myocardium and left ventricular cavity. The second network is used to segment the pathological area…
Nanjing University of Science and Technology（南京理工大学）
Automatic evaluation of myocardium and pathology plays an important role in the quantitative analysis of patients suffering from myocardial infarction. In this paper, we present a cascaded convolutional neural network framework for myocardial infarction segmentation and classification in delayed-enhancement cardiac MRI. Specifically, we first use a 2D U-Net to segment the whole heart, including the left ventricle and the myocardium. Then, we crop the whole heart as a region of interest (ROI). Finally, a new 2D U-Net is used to segment the infraction and no-reflow areas in the whole heart ROI. …
In this report, I investigate the use of end-to-end deep residual learning with dilated convolutions for myocardial infarction (MI) detection and localization from electrocardiogram (ECG) signals. Although deep residual learning has already been applied to MI detection and localization, I propose a more accurate system that distinguishes among a higher number (i.e., six) of MI locations. Inspired by speech waveform processing with neural networks, I found a more robust front-end than directly arranging the multi-lead ECG signal into an input matrix consisting of the use of a single one-dimensi…
The University of Winnipeg（温尼伯大学）；Qatar University（卡塔尔大学）；Hamad Medical Corporation（哈马德医疗公司）
Cardiac imaging known as echocardiography is a non-invasive tool utilized to produce data including images and videos, which cardiologists use to diagnose cardiac abnormalities in general and myocardial infarction (MI) in particular. Echocardiography machines can deliver abundant amounts of data that need to be quickly analyzed by cardiologists to help them make a diagnosis and treat cardiac conditions. However, the acquired data quality varies depending on the acquisition conditions and the patient's responsiveness to the setup instructions. These constraints are challenging to doctors especi…
Tampere University（坦佩雷大学）；Qatar University（卡塔尔大学）；Hamad Medical Corporation（哈马德医疗公司）
Myocardial infarction (MI), or commonly known as heart attack, is a life-threatening health problem worldwide from which 32.4 million people suffer each year. Early diagnosis and treatment of MI are crucial to prevent further heart tissue damages or death. The earliest and most reliable sign of ischemia is regional wall motion abnormality (RWMA) of the affected part of the ventricular muscle. Echocardiography can easily, inexpensively, and non-invasively exhibit the RWMA. In this article, we introduce a three-phase approach for early MI detection in low-quality echocardiography: 1) segmentatio…
Predicting Lethal Outcome (Cause) And Understanding Key Biomarkers Linked With Acute Myocardial Infarction Using Deep Artificial Neural Network And Ensemble Of Machine Learning Methodologies
National University of Singapore（新加坡国立大学）；National University Heart Centre（新加坡国立大学心脏中心）；National University Hospital（新加坡国立大学医院）
Automatic segmentation of the left ventricle (LV) in late gadolinium enhanced (LGE) cardiac MR (CMR) images is difficult due to the intensity heterogeneity arising from accumulation of contrast agent in infarcted myocardium. In this paper, we present a comprehensive framework for automatic 3D segmentation of the LV in LGE CMR images. Given myocardial contours in cine images as a priori knowledge, the framework initially propagates the a priori segmentation from cine to LGE images via 2D translational registration. Two meshes representing respectively endocardial and epicardial surfaces are the…
University of Bourgogne Franche-Comté（勃艮第-弗朗什孔泰大学）；University Hospital of Dijon（第戎大学医院）；CASIS company（CASIS公司）
Cardiac left ventricular (LV) segmentation from short-axis MRI acquired 10 minutes after the injection of a contrast agent (LGE-MRI) is a necessary step in the processing allowing the identification and diagnosis of cardiac diseases such as myocardial infarction. However, this segmentation is challenging due to high variability across subjects and the potential lack of contrast between structures. Then, the main objective of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI. To this end, 2.5 D residual neural n…
Lund University（隆德大学）；Skåne University Hospital（斯科讷大学医院）
In this work, the best size for late gadolinium enhancement (LGE) magnetic resonance imaging (MRI) images in the training dataset was determined to optimize deep learning training outcomes. Non-extra pixel and extra pixel interpolation algorithms were used to determine the new size of the LGE-MRI images. A novel strategy was introduced to handle interpolation masks and remove extra class labels in interpolated ground truth (GT) segmentation masks. The expectation maximization, weighted intensity, a priori information (EWA) algorithm was used for quantification of myocardial infarction (MI) in …
Southeast University（东南大学）；Shenzhen University（深圳大学）；Fudan University（复旦大学）；Shanghai Jiao Tong University（上海交通大学）；Kings College London（伦敦国王学院）；Affiliated Drum Tower Hospital of Nanjing University Medical School（南京大学医学院附属鼓楼医院）
Multi-sequence cardiac magnetic resonance (CMR) provides essential pathology information (scar and edema) to diagnose myocardial infarction. However, automatic pathology segmentation can be challenging due to the difficulty of effectively exploring the underlying information from the multi-sequence CMR data. This paper aims to tackle the scar and edema segmentation from multi-sequence CMR with a novel auto-weighted supervision framework, where the interactions among different supervised layers are explored under a task-specific objective using reinforcement learning. Furthermore, we design a c…
University of Burgundy（勃艮第大学）；University Hospital of Dijon（第戎大学医院）；University of Franche-Comté（弗朗什-孔泰大学）；CASIS Company（CASIS公司）；University of Sousse（苏塞大学）；University of Monastir（莫纳斯提尔大学）；Erasmus MC（伊拉斯姆斯大学医学中心）
A key factor for assessing the state of the heart after myocardial infarction (MI) is to measure whether the myocardium segment is viable after reperfusion or revascularization therapy. Delayed enhancement-MRI or DE-MRI, which is performed several minutes after injection of the contrast agent, provides high contrast between viable and nonviable myocardium and is therefore a method of choice to evaluate the extent of MI. To automatically assess myocardial status, the results of the EMIDEC challenge that focused on this task are presented in this paper. The challenge's main objectives were twofo…
Contrast-Free Myocardial Scar Segmentation in Cine MRI using Motion and Texture Fusion
University of Oxford（牛津大学）；University of Southampton（南安普顿大学）；National University of Singapore（新加坡国立大学）；Fudan University（复旦大学）；Zhongshan Hospital, Fudan University（复旦大学附属中山医院）
Myocardium segmentation of late gadolinium enhancement (LGE) Cardiac MR images is important for evaluation of infarction regions in clinical practice. The pathological myocardium in LGE images presents distinctive brightness and textures compared with the healthy tissues, making it much more challenging to be segment. Instead, the balanced-Steady State Free Precession (bSSFP) cine images show clearly boundaries and can be easily segmented. Given this fact, we propose a novel shape-transfer GAN for LGE images, which can 1) learn to generate realistic LGE images from bSSFP with the anatomical sh…
Fuzhou University（福州大学）；University of Oxford（牛津大学）；Fudan University（复旦大学）；Zhongshan Hospital, Fudan University（复旦大学附属中山医院）；Shanghai Medical School, Fudan University（复旦大学上海医学院）；Shanghai Institute of Medical Imaging（上海医学影像研究所）
Myocardial pathology segmentation (MyoPS) is critical for the risk stratification and treatment planning of myocardial infarction (MI). Multi-sequence cardiac magnetic resonance (MS-CMR) images can provide valuable information. For instance, balanced steady-state free precession cine sequences present clear anatomical boundaries, while late gadolinium enhancement and T2-weighted CMR sequences visualize myocardial scar and edema of MI, respectively. Existing methods usually fuse anatomical and pathological information from different CMR sequences for MyoPS, but assume that these images have bee…
The MYOSAIQ Challenge: Myocardial Segmentation with Automated Infarct Quantification
INSA-Lyon, Universite Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1294（里昂国立应用科学学院、里昂第一大学克洛德·贝尔纳大学、圣艾蒂安大学、法国国家科学研究中心、法国国家健康与医学研究院、CREATIS联合研究机构）；Institut Universitaire de France (IUF)（法兰西大学研究院）；University of Sherbrooke（谢布鲁克大学）；Huazhong University of Science and Technology（华中科技大学）；Sunnybrook Research Institute, University of Toronto（多伦多大学桑尼布鲁克研究所）；Imperial College London（伦敦帝国理工学院）；University College London（伦敦大学学院）；Fudan University（复旦大学）；Medical University of Graz（格拉茨医科大学）；Graz University of Technology（格拉茨技术大学）；Universidad de Zaragoza（萨拉戈萨大学）；Instituto de Investigación Sanitaria de Aragón (IIS Aragón)（阿拉贡卫生研究所）；Centre Hospitalier Annecy Genevois（阿讷西日内瓦中心医院）；Hôpital Universitaire Cardiologique Louis Pradel（路易·普拉德尔大学心脏病医院）
CineMyoPS: Segmenting Myocardial Pathologies from Cine Cardiac MR
School of Medical Imaging, Fujian Medical University（福建医科大学医学影像学院）；College of Physics and Information Engineering, Fuzhou University（福州大学物理与信息工程学院）；Department of Biomedical Engineering, National University of Singapore（新加坡国立大学生物医学工程系）；School of Data Science, Fudan University（复旦大学数据科学学院）；Department of Radiology, Renji Hospital, School of Medicine, Shanghai Jiao Tong University（上海交通大学医学院仁济医院放射科）
University of Alberta（阿尔伯塔大学）；Mazankowski Alberta Heart Institute（马赞科夫斯基阿尔伯塔心脏研究所）
Myocardial characterization is essential for patients with myocardial infarction and other myocardial diseases, and the assessment is often performed using cardiac magnetic resonance (CMR) sequences. In this study, we propose a fully automated approach using deep convolutional neural networks (CNN) for cardiac pathology segmentation, including left ventricular (LV) blood pool, right ventricular blood pool, LV normal myocardium, LV myocardial edema (ME) and LV myocardial scars (MS). The input to the network consists of three CMR sequences, namely, late gadolinium enhancement (LGE), T2 and balan…
Fudan University（复旦大学）；University of Oxford（牛津大学）；Zhongshan Hospital, Fudan University（复旦大学附属中山医院）；Shanghai Medical School, Fudan University（复旦大学上海医学院）；Shanghai Institute of Medical Imaging（上海医学影像研究所）
Myocardial pathology segmentation (MyoPS) can be a prerequisite for the accurate diagnosis and treatment planning of myocardial infarction. However, achieving this segmentation is challenging, mainly due to the inadequate and indistinct information from an image. In this work, we develop an end-to-end deep neural network, referred to as MyoPS-Net, to flexibly combine five-sequence cardiac magnetic resonance (CMR) images for MyoPS. To extract precise and adequate information, we design an effective yet flexible architecture to extract and fuse cross-modal features. This architecture can tackle …
Qatar University（卡塔尔大学）；Liverpool John Moores University（利物浦约翰摩尔斯大学）；University of Kurdistan Hewler（库尔德斯坦休勒尔大学）；Firat University（菲拉特大学）；Sulaimani Polytechnic University（苏莱曼尼亚理工大学）
The reliable and rapid identification of the COVID-19 has become crucial to prevent the rapid spread of the disease, ease lockdown restrictions and reduce pressure on public health infrastructures. Recently, several methods and techniques have been proposed to detect the SARS-CoV-2 virus using different images and data. However, this is the first study that will explore the possibility of using deep convolutional neural network (CNN) models to detect COVID-19 from electrocardiogram (ECG) trace images. In this work, COVID-19 and other cardiovascular diseases (CVDs) were detected using deep-lear…
Personalized 3D Myocardial Infarct Geometry Reconstruction from Cine MRI with Explicit Cardiac Motion Modeling
Department of Biomedical Engineering, National University of Singapore, Singapore（新加坡国立大学生物医学工程系）；Department of Computer Science, National University of Singapore, Singapore（新加坡国立大学计算机科学系）；Auckland Bioengineering Institute, University of Auckland, Auckland, New Zealand（奥克兰大学生物工程研究所）；School of Biomedical Engineering and Imaging Sciences, King’s College London, UK（伦敦国王学院生物医学工程与成像科学学校）；Department of Medicine, National University of Singapore, Singapore（新加坡国立大学医学系）；Department of Cardiology, National University Heart Centre Singapore, Singapore（新加坡国立心脏中心心血管科）
Fudan University（复旦大学）；Shanghai Jiao Tong University（上海交通大学）；Universitat de Barcelona（巴塞罗那大学）；Universitat Autònoma de Barcelona（巴塞罗那自治大学）；University of Electronic Science and Technology of China（电子科技大学）；Northwestern Polytechnical University（西北工业大学）；Hunan University（湖南大学）；National Engineering Laboratory for Robot Visual Perception and Control Technology（机器人视觉感知与控制技术国家工程实验室）；Fuzhou University（福州大学）；Comprehensive Heart Failure Center（综合心力衰竭中心）
Assessment of myocardial viability is essential in diagnosis and treatment management of patients suffering from myocardial infarction, and classification of pathology on myocardium is the key to this assessment. This work defines a new task of medical image analysis, i.e., to perform myocardial pathology segmentation (MyoPS) combining three-sequence cardiac magnetic resonance (CMR) images, which was first proposed in the MyoPS challenge, in conjunction with MICCAI 2020. The challenge provided 45 paired and pre-aligned CMR images, allowing algorithms to combine the complementary information fr…
Accurate cardiac computing, analysis and modeling from multi-modality images are important for the diagnosis and treatment of cardiac disease. Late gadolinium enhancement magnetic resonance imaging (LGE MRI) is a promising technique to visualize and quantify myocardial infarction (MI) and atrial scars. Automating quantification of MI and atrial scars can be challenging due to the low image quality and complex enhancement patterns of LGE MRI. Moreover, compared with the other sequences LGE MRIs with gold standard labels are particularly limited, which represents another obstacle for developing …
Myocardial infarction (MI) is a scientific term that refers to heart attack. In this study, we infer highly relevant second harmonic generation (SHG) cues from collagen fibers exhibiting highly non-centrosymmetric assembly together with two-photon excited cellular autofluorescence in infarcted mouse heart to quantitatively probe fibrosis, especially targeted at an early stage after MI. We present a robust one-shot machine learning algorithm that enables determination of 2D assembly of collagen with high spatial resolution along with its structural arrangement in heart tissues post-MI with spec…
Echocardiography to Cardiac MRI View Transformation for Real-Time Blind Restoration
Tampere University（坦佩雷大学）；Qatar University（卡塔尔大学）；VTT Technical Research Centre of Finland（芬兰国家技术研究中心）；Hamad Medical Corporation Hospital（哈马德医疗公司医院）；Hayatabad Medical Complex（海亚特阿巴德医疗中心）
School of Data Science, Fudan University（复旦大学数据科学学院）
Cardiac segmentation from late gadolinium enhancement MRI is an important task in clinics to identify and evaluate the infarction of myocardium. The automatic segmentation is however still challenging, due to the heterogeneous intensity distributions and indistinct boundaries in the images. In this paper, we propose a new method, based on deep neural networks (DNN), for fully automatic segmentation. The proposed network, referred to as SRSCN, comprises a shape reconstruction neural network (SRNN) and a spatial constraint network (SCN). SRNN aims to maintain a realistic shape of the resulting s…
Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；University of Leeds（利兹大学）
Left ventricle segmentation and morphological assessment are essential for improving diagnosis and our understanding of cardiomyopathy, which in turn is imperative for reducing risk of myocardial infarctions in patients. Convolutional neural network (CNN) based methods for cardiac magnetic resonance (CMR) image segmentation rely on supervision with pixel-level annotations, and may not generalize well to images from a different domain. These methods are typically sensitive to variations in imaging protocols and data acquisition. Since annotating multi-sequence CMR images is tedious and subject …
Universitat Pompeu Fabra（庞培法布拉大学）；BCN MedTech（巴塞罗那医疗科技中心）；Queen Mary University of London（伦敦玛丽女王大学）；William Harvey Research Institute（威廉·哈维研究所）；Stanford University（斯坦福大学）；Catalan Institution for Research and Advanced Studies (ICREA)（加泰罗尼亚研究与高级研究所）
Use expert visualization or conventional clinical indices can lack accuracy for borderline classications. Advanced statistical approaches based on eigen-decomposition have been mostly concerned with shape and motion indices. In this paper, we present a new approach to identify CVDs from cine-MRI by estimating large pools of radiomic features (statistical, shape and textural features) encoding relevant changes in anatomical and image characteristics due to CVDs. The calculated cine-MRI radiomic features are assessed using sequential forward feature selection to identify the most relevant ones f…
School of Engineering, University of Edinburgh（爱丁堡大学工程学院）；Center for Cardiovascular Science, University of Edinburgh（爱丁堡大学心血管科学中心）；The Alan Turing Institute（艾伦·图灵研究所）
Automatic segmentation of multi-sequence (multi-modal) cardiac MR (CMR) images plays a significant role in diagnosis and management for a variety of cardiac diseases. However, the performance of relevant algorithms is significantly affected by the proper fusion of the multi-modal information. Furthermore, particular diseases, such as myocardial infarction, display irregular shapes on images and occupy small regions at random locations. These facts make pathology segmentation of multi-modal CMR images a challenging task. In this paper, we present the Max-Fusion U-Net that achieves improved path…
