Multivessel Coronary Artery Segmentation and Stenosis Localisation using Ensemble Learning
Birmingham City University(伯明翰城市大学);University of the West of England (UWE)(西英格兰大学);Institute of Accounting and Administration, University of Aveiro(阿威罗大学会计与行政学院);NUS High School of Math and Science(新加坡国立大学数学与科学高中);Qatar University(卡塔尔大学);Information Technology University(信息技术大学);Bristol Heart Institute, University of Bristol(布里斯托大学布里斯托心脏研究所)
冠状动脉造影分析是心内科医生通过评估动脉粥样硬化斑块积聚来诊断冠状动脉疾病(CAD)的一项常见临床任务。本研究介绍了一种端到端机器学习解决方案,该方案是我们为 MICCAI 2023 基于区域的冠状动脉疾病自动诊断——使用 X 射线血管造影图像(ARCADE)挑战赛所开发解决方案的一部分,该挑战赛旨在为基于 X 射线冠状动脉造影的多支冠状动脉分割和潜在狭窄病变定位提供基准。我们采用了一种稳健的基线模型训练策略以逐步提升性能,该策略包括五个连续阶段:二分类预训练、多支血管分割、使用类别频率加权数据加载器进行微调、使用基于 F1 的课程学习策略(F1-CLS)进行微调,以及最后基于多目标血管造影视图分类器的集体自适应。与许多其他医学成像任务不同,该任务表现出显著的观察者间变异性。我们的集成模型使用加权集成方法将六个基线模型的输出进行组合,我们的分析表明该方法使所提出解决方案的预测准确率提高了一倍。最终预测进一步得到细化,针对误分类斑块进行校正。我们的解决方案在冠状动脉分割上取得了 37.69% 的平均 F1 分数,在狭窄定位上取得了 39.41% 的平均 F1 分数,使我们的团队在两个排行榜上均位列第 5 名。这项工作证明了自动化工具在辅助 CAD 诊断、指导干预以及提高临床环境中支架植入准确性方面的潜力。
英文摘要:
Coronary angiography analysis is a common clinical task performed by cardiologists to diagnose coronary artery disease (CAD) through an assessment of atherosclerotic plaque's accumulation. This study introduces an end-to-end machine learning solution developed as part of our solution for the MICCAI 2023 Automatic Region-based Coronary Artery Disease diagnostics using x-ray angiography imagEs (ARCADE) challenge, which aims to benchmark solutions for multivessel coronary artery segmentation and potential stenotic lesion localisation from X-ray coronary angiograms. We adopted a robust baseline model training strategy to progressively improve performance, comprising five successive stages of binary class pretraining, multivessel segmentation, fine-tuning using class frequency weighted dataloaders, fine-tuning using F1-based curriculum learning strategy (F1-CLS), and finally multi-target angiogram view classifier-based collective adaptation. Unlike many other medical imaging procedures, this task exhibits a notable degree of interobserver variability. %, making it particularly amenable to automated analysis. Our ensemble model combines the outputs from six baseline models using the weighted ensembling approach, which our analysis shows is found to double the predictive accuracy of the proposed solution. The final prediction was further refined, targeting the correction of misclassified blobs. Our solution achieved a mean F1 score of $37.69\%$ for coronary artery segmentation, and $39.41\%$ for stenosis localisation, positioning our team in the 5th position on both leaderboards. This work demonstrates the potential of automated tools to aid CAD diagnosis, guide interventions, and improve the accuracy of stent injections in clinical settings.
Myocardial Region-guided Feature Aggregation Net for Automatic Coronary artery Segmentation and Stenosis Assessment using Coronary Computed Tomography Angiography
School of Computer Science and Technology, Zhengzhou University of Light Industry(郑州轻工业大学计算机与通信工程学院);School of Information Management and Engineering, Shanghai University of Finance and Economics(上海财经大学信息管理与工程学院);Department of Applied Computing, Michigan Technological University(密歇根理工大学应用计算系);Health Research Institute, Michigan Technological University(密歇根理工大学健康研究所);Department of Computer Science, Kennesaw State University(肯尼索州立大学计算机科学系)
Image Sciences Institute, University Medical Center Utrecht(乌得勒支大学医学中心影像科学研究所);University Medical Center Utrecht(乌得勒支大学医学中心);Utrecht University(乌得勒支大学);Amsterdam University Medical Center(阿姆斯特丹大学医学中心)
Treatment of patients with obstructive coronary artery disease is guided by the functional significance of a coronary artery stenosis. Fractional flow reserve (FFR), measured during invasive coronary angiography (ICA), is considered the gold standard to define the functional significance of a coronary stenosis. Here, we present a method for non-invasive detection of patients with functionally significant coronary artery stenosis, combining analysis of the coronary artery tree and the left ventricular (LV) myocardium in cardiac CT angiography (CCTA) images. We retrospectively collected CCTA sca…
School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);National Heart & Lung Institute, Imperial College London(帝国理工学院国家心肺研究所);Key Laboratory of Intelligent Computing and Signal Processing, Ministry of Education, Anhui University(安徽大学智能计算与信号处理教育部重点实验室);Cardiovascular Research Centre, Royal Brompton Hospital(皇家布朗普顿医院心血管研究中心);School of Biomedical Engineering, Sun Yat-Sen University(中山大学生物医学工程学院);Western University(韦仕敦大学)
The quantification of the coronary artery stenosis is of significant clinical importance in coronary artery disease diagnosis and intervention treatment. It aims to quantify the morphological indices of the coronary artery lesions such as minimum lumen diameter, reference vessel diameter, lesion length, and these indices are the reference of the interventional stent placement. In this study, we propose a direct multiview quantitative coronary angiography (DMQCA) model as an automatic clinical tool to quantify the coronary artery stenosis from X-ray coronary angiography images. The proposed DMQ…
Fudan University(复旦大学);Shanghai East Hospital, Tongji University(同济大学附属东方医院);Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属瑞金医院)
We proposed a novel unsupervised methodology named Disarranged Zone Learning (DZL) to automatically recognize stenosis in coronary angiography. The methodology firstly disarranges the frames in a video, secondly it generates an effective zone and lastly trains an encoder-decoder GRU model to learn the capability to recover disarranged frames. The breakthrough of our study is to discover and validate the Sequence Intensity (Recover Difficulty) is a measure of Coronary Artery Stenosis Status. Hence, the prediction accuracy of DZL is used as an approximator of coronary stenosis indicator. DZL is …
Coronary artery disease (CAD) has posed a leading threat to the lives of cardiovascular disease patients worldwide for a long time. Therefore, automated diagnosis of CAD has indispensable significance in clinical medicine. However, the complexity of coronary artery plaques that cause CAD makes the automatic detection of coronary artery stenosis in Coronary CT angiography (CCTA) a difficult task. In this paper, we propose a Transformer network (TR-Net) for the automatic detection of significant stenosis (i.e. luminal narrowing > 50%) while practically completing the computer-assisted diagnosis …
Coronary angiography is the "gold standard" for diagnosing coronary artery disease (CAD). At present, the methods for detecting and evaluating coronary artery stenosis cannot satisfy the clinical needs, e.g., there is no prior study of detecting stenoses in prespecified vessel segments, which is necessary in clinical practice. Two vascular stenosis detection methods are proposed to assist the diagnosis. The first one is an automatic method, which can automatically extract the entire coronary artery tree and mark all the possible stenoses. The second one is an interactive method. With this meth…
To decrease patient waiting time for diagnosis of the Coronary Artery Disease, automatic methods are applied to identify its severity using Coronary Computed Tomography Angiography scans or extracted Multiplanar Reconstruction (MPR) images, giving doctors a second-opinion on the priority of each case. The main disadvantage of previous studies is the lack of large set of data that could guarantee their reliability. Another limitation is the usage of handcrafted features requiring manual preprocessing, such as centerline extraction. We overcome both limitations by applying a different automated …
School of Computer Science and Technology, Ocean University of China(中国海洋大学计算机科学与技术学院);School of Material Science and Engineering, Ocean University of China(中国海洋大学材料科学与工程学院);School of Mathematical Sciences, Ocean University of China(中国海洋大学数学科学学院);Department of Cardiology, Qilu Hospital (Qingdao), Cheeloo College of Medicine, Shandong University(山东大学齐鲁医学院齐鲁医院(青岛)心内科)
Coronary angiography is the "gold standard" for diagnosing coronary artery disease (CAD). At present, the methods for detecting and evaluating coronary artery stenosis cannot satisfy the clinical needs, e.g., there is no prior study of detecting stenoses in prespecified vessel segments, which is necessary in clinical practice. Two vascular stenosis detection methods are proposed to assist the diagnosis. The first one is an automatic method, which can automatically extract the entire coronary artery tree and mark all the possible stenoses. The second one is an interactive method. With this meth…
University of New South Wales(新南威尔士大学);UNSW Sydney(新南威尔士大学悉尼分校);Prince of Wales Hospital(威尔士亲王医院);Auckland City Hospital(奥克兰市医院)
Computed Tomography Coronary Angiography (CTCA) is a non-invasive method to evaluate coronary artery anatomy and disease. CTCA is ideal for geometry reconstruction to create virtual models of coronary arteries. To our knowledge there is no public dataset that includes centrelines and segmentation of the full coronary tree. We provide anonymized CTCA images, voxel-wise annotations and associated data in the form of centrelines, calcification scores and meshes of the coronary lumen in 20 normal and 20 diseased cases. Images were obtained along with patient information with informed, written cons…
Frangi Filters are one of the widely used filters for enhancing vessels in medical images. Since they were first proposed, the threshold of the vesselness function of Frangi Filters is to be arranged for each individual application. These thresholds are changed manually for individual fluoroscope, for enhancing coronary angiogram images. Hence it is felt, there is a need of mitigating the tuning procedure of threshold values for every fluoroscope. The current papers approach has been devised in order to treat the coronary angiogram images uniformly, irrespective of the fluoroscopes through whi…
Instituto Superior Técnico(高等技术学院);University of Lisbon(里斯本大学);CCUL(里斯本大学中心学院);Lisbon School of Medicine(里斯本医学院)
Coronary artery disease leading up to stenosis, the partial or total blocking of coronary arteries, is a severe condition that affects millions of patients each year. Automated identification and classification of stenosis severity from minimally invasive procedures would be of great clinical value, but existing methods do not match the accuracy of experienced cardiologists, due to the complexity of the task. Although a number of computational approaches for quantitative assessment of stenosis have been proposed to date, the performance of these methods is still far from the required levels fo…
Michigan Technological University(密歇根理工大学);University of Southern Mississippi(南密西西比大学);Tulane University(杜兰大学);Ochsner Medical Center(奥克斯纳医疗中心)
In stable coronary artery disease (CAD), reduction in mortality and/or myocardial infarction with revascularization over medical therapy has not been reliably achieved. Coronary arteries are usually extracted to perform stenosis detection. We aim to develop an automatic algorithm by deep learning to extract coronary arteries from ICAs.In this study, a multi-input and multi-scale (MIMS) U-Net with a two-stage recurrent training strategy was proposed for the automatic vessel segmentation. Incorporating features such as the Inception residual module with depth-wise separable convolutional layers,…
O2CTA: Introducing Annotations from OCT to CCTA in Coronary Plaque Analysis
Dushu Lake Hospital Affiliated to Soochow University(苏州大学附属独墅湖医院);Institution for Hypertension of Soochow University(苏州大学高血压研究所);University of Science and Technology of China(中国科学技术大学)
A Deep Learning Model for Coronary Artery Segmentation and Quantitative Stenosis Detection in Angiographic Images
School of Mathematical Sciences, Ocean University of China(中国海洋大学数学科学学院);School of Haide, Ocean University of China(中国海洋大学海德学院);School of Ocean and Atmosphere, Ocean University of China(中国海洋大学海洋与大气学院);Qilu Hospital (Qingdao), Cheeloo College of Medicine, Shandong University(山东大学齐鲁医院(青岛))
Bioinformatics Institute, Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局生物信息学研究所);Hwa Chong Institution (College)(华侨中学(高中部));National Heart Centre Singapore(新加坡国家心脏中心);Duke-NUS Medical School(杜克-新加坡国立大学医学院);School of Computing, National University of Singapore(新加坡国立大学计算学院);Singapore Eye Research Institute (SERI)(新加坡眼科研究所);Rehabilitation Research Institute of Singapore(新加坡康复研究所);Institute of Bioengineering and Nanotechnology, A*STAR(新加坡科技研究局生物工程与纳米技术研究所)
The evaluation of obstructions (stenosis) in coronary arteries is currently done by a physician's visual assessment of coronary angiography video sequences. It is laborious, and can be susceptible to interobserver variation. Prior studies have attempted to automate this process, but few have demonstrated an integrated suite of algorithms for the end-to-end analysis of angiograms. We report an automated analysis pipeline based on deep learning to rapidly and objectively assess coronary angiograms, highlight coronary vessels of interest, and quantify potential stenosis. We propose a 3-stage auto…
Image Sciences Institute, University Medical Center Utrecht(乌得勒支大学医学中心影像科学研究所);University Medical Center Utrecht(乌得勒支大学医学中心);Amsterdam University Medical Center(阿姆斯特丹大学医学中心);Utrecht University(乌得勒支大学)
In patients with obstructive coronary artery disease, the functional significance of a coronary artery stenosis needs to be determined to guide treatment. This is typically established through fractional flow reserve (FFR) measurement, performed during invasive coronary angiography (ICA). We present a method for automatic and non-invasive detection of patients requiring ICA, employing deep unsupervised analysis of complete coronary arteries in cardiac CT angiography (CCTA) images. We retrospectively collected CCTA scans of 187 patients, 137 of them underwent invasive FFR measurement in 192 dif…
the Second Affiliated Hospital Zhengzhou University(郑州大学第二附属医院);School of Information Engineering Zhengzhou University(郑州大学信息工程学院)
How to accurately classify and diagnose whether an individual has Coronary Stenosis (CS) without invasive physical examination? This problem has not been solved satisfactorily. To this end, the four machine learning (ML) algorithms, i.e., Boosted Tree (BT), Decision Tree (DT), Logistic Regression (LR) and Random Forest (RF) are employed in this paper. First, eleven features including basic information of an individual, symptoms and results of routine physical examination are selected, as well as one label is specified, indicating whether an individual suffers from different severity of coronar…
Coronary heart disease (CHD) is the leading cause of adult death in the United States and worldwide, and for which the coronary angiography procedure is the primary gateway for diagnosis and clinical management decisions. The standard-of-care for interpretation of coronary angiograms depends upon ad-hoc visual assessment by the physician operator. However, ad-hoc visual interpretation of angiograms is poorly reproducible, highly variable and bias prone. Here we show for the first time that fully-automated angiogram interpretation to estimate coronary artery stenosis is possible using a sequenc…
Vessel stenosis is a major risk factor in cardiovascular diseases (CVD). To analyze the degree of vessel stenosis for supporting the treatment management, extraction of coronary artery area from Computed Tomographic Angiography (CTA) is regarded as a key procedure. However, manual segmentation by cardiologists may be a time-consuming task, and present a significant inter-observer variation. Although various computer-aided approaches have been developed to support segmentation of coronary arteries in CTA, the results remain unreliable due to complex attenuation appearance of plaques, which are …
Babol Noshirvani University of Technology(巴博勒努希尔瓦尼技术大学);Italian Institute of Technology(意大利技术研究院);Royan Institute for Stem Cell Biology and Technology(罗扬干细胞生物学与技术研究所);Sharif University of Technology(谢里夫理工大学)
Prediction of the blood flow characteristics is of utmost importance for understanding the behavior of the blood arterial network, especially in the presence of vascular diseases such as stenosis. Computational fluid dynamics (CFD) has provided a powerful and efficient tool to determine these characteristics including the pressure and velocity fields within the network. Despite numerous studies in the field, the extremely high computational cost of CFD has led the researchers to develop new platforms including Machine Learning approaches that instead provide faster analyses at a much lower cos…
Tsinghua University(清华大学);Beijing Anzhen Hospital, Capital Medical University(首都医科大学附属北京安贞医院);The First Affiliated Hospital of Zhengzhou University(郑州大学第一附属医院)
Coronary angiography is an indispensable assistive technique for cardiac interventional surgery. Segmentation and extraction of blood vessels from coronary angiography videos are very essential prerequisites for physicians to locate, assess and diagnose the plaques and stenosis in blood vessels. This article proposes a new video segmentation framework that can extract the clearest and most comprehensive coronary angiography images from a video sequence, thereby helping physicians to better observe the condition of blood vessels. This framework combines a 3D convolutional layer to extract spati…
Coronary Heart Disease (CHD) is a leading cause of death in the modern world. The development of modern analytical tools for diagnostics and treatment of CHD is receiving substantial attention from the scientific community. Deep learning-based algorithms, such as segmentation networks and detectors, play an important role in assisting medical professionals by providing timely analysis of a patient's angiograms. This paper focuses on X-Ray Coronary Angiography (XCA), which is considered to be a "gold standard" in the diagnosis and treatment of CHD. First, we describe publicly available datasets…
Image Sciences Institute(影像科学研究所);University Medical Center Utrecht(乌得勒支大学医学中心);Department of Radiology(放射科)
Detection of coronary artery stenosis in coronary CT angiography (CCTA) requires highly personalized surface meshes enclosing the coronary lumen. In this work, we propose to use graph convolutional networks (GCNs) to predict the spatial location of vertices in a tubular surface mesh that segments the coronary artery lumen. Predictions for individual vertex locations are based on local image features as well as on features of neighboring vertices in the mesh graph. The method was trained and evaluated using the publicly available Coronary Artery Stenoses Detection and Quantification Evaluation …
Cross-Modal Contrastive Learning of ECG and Angiography Representations for Severe Stenosis Classification
Chair for AI in Healthcare and Medicine, Technical University of Munich and TUM University Hospital(人工智能在医疗与医学中的研究所,慕尼黑技术大学及慕尼黑大学医院);Department of Computing, Imperial College London(伦敦帝国理工学院计算机系);Munich Center for Machine Learning (MCML), Munich, Germany(慕尼黑机器学习中心(MCML));Department of Internal Medicine, TUM University Hospital(慕尼黑大学医院内科学系)
CADICA: a new dataset for coronary artery disease detection by using invasive coronary angiography
University of Málaga(马拉加大学);Instituto de Investigación Biomédica de Málaga y Plataforma en Nanomedicina-IBIMA Plataforma BIONAND(马拉加生物医学与纳米医学平台研究所-IBIMA BIONAND平台);Centro de Investigación Biomédica en Red de Enfermedades Cardiovasculares (CIBERCV)(心血管疾病网络生物医学研究中心);Instituto de Salud Carlos III (ISCIII)(卡洛斯三世卫生研究所)
Background. Percutaneous coronary intervention(PCI) in stable coronary artery disease(CAD) is commonly triggered by abnormal myocardial perfusion imaging(MPI). However, due to the possibilities of multivessel disease and variability of coronary artery perfusion distribution, opportunity exists to better align anatomic stenosis with perfusion abnormalities to improve revascularization decisions. This study aims to develop a 3D multi-modality fusion approach to assist decision-making for PCI. Methods. Coronary arteries from fluoroscopic angiography(FA) were reconstructed into 3D artery anatomy. …
The purpose of this study is to present a new semi-automated methodology for three-dimensional (3D) reconstruction of coronary arteries and their plaque morphology using Computed Tomography Angiography (CTA) images. The methodology is summarized in seven stages: pre-processing of the acquired CTA images, extraction of the vessel tree centerline, estimation of a weight function for lumen, outer wall and calcified plaque, lumen segmentation, outer wall segmentation, plaque detection, and finally 3D surfaces construction. The methodology was evaluated using both expert manual annotations and esti…
In recent years, coronary artery disease is escalating and is likely to assume an epidemic proportion by 2030. Currently the reliable methods for detection of coronary arterial lesions are either conventional coronary angiogram (CAG) or MDCT (Multiple Detector Computed Tomography) coronary angiogram. Conventional CAG is an invasive procedure. Conventional CAG and CT (Computed Tomography) angiogram, both require expert supervision of either an interventional cardiologist or a radiologist. In this work, we have proposed a novel design and method for non-invasive detection and localization of cor…
CAD-RADS scoring of coronary CT angiography with Multi-Axis Vision Transformer: a clinically-inspired deep learning pipeline
University of Pavia(帕维亚大学);Centro Cardiologico Monzino IRCCS(蒙齐诺心脏病学中心IRCCS);University of Milan(米兰大学);IRCCS Istituti Clinici Scientifici Maugeri(IRCCS莫杰里科学临床研究所)
Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡大学);Siemens Healthcare GmbH(西门子医疗有限公司);Das Radiologische Zentrum - Radiology Center(放射中心)
Coronary CT angiography (CCTA) has established its role as a non-invasive modality for the diagnosis of coronary artery disease (CAD). The CAD-Reporting and Data System (CAD-RADS) has been developed to standardize communication and aid in decision making based on CCTA findings. The CAD-RADS score is determined by manual assessment of all coronary vessels and the grading of lesions within the coronary artery tree. We propose a bottom-up approach for fully-automated prediction of this score using deep-learning operating on a segment-wise representation of the coronary arteries. The method relies…
ImageCAS: A Large-Scale Dataset and Benchmark for Coronary Artery Segmentation based on Computed Tomography Angiography Images
Guangdong University of Technology(广东工业大学);Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences)(广东省人民医院(广东省医学科学院));Southern Medical University(南方医科大学);Missouri University of Science and Technology(密苏里科技大学)