AGMN: Association Graph-based Graph Matching Network for Coronary Artery Semantic Labeling on Invasive Coronary Angiograms
Michigan Technological University（密歇根理工大学）；The First Affiliated Hospital of Nanjing Medical University（南京医科大学第一附属医院）；Medical University of South Carolina（南卡罗来纳医科大学）；Chang Bing Show Chwan Memorial Hospital（彰滨秀传纪念医院）
Semantic labeling of coronary arterial segments in invasive coronary angiography (ICA) is important for automated assessment and report generation of coronary artery stenosis in the computer-aided diagnosis of coronary artery disease (CAD). Inspired by the training procedure of interventional cardiologists for interpreting the structure of coronary arteries, we propose an association graph-based graph matching network (AGMN) for coronary arterial semantic labeling. We first extract the vascular tree from invasive coronary angiography (ICA) and convert it into multiple individual graphs. Then, an association graph is constructed from two individual graphs where each vertex represents the relationship between two arterial segments. Using the association graph, the AGMN extracts the vertex features by the embedding module, aggregates the features from adjacent vertices and edges by graph convolution network, and decodes the features to generate the semantic mappings between arteries. By learning the mapping of arterial branches between two individual graphs, the unlabeled arterial segments are classified by the labeled segments to achieve semantic labeling. A dataset containing 263 ICAs was employed to train and validate the proposed model, and a five-fold cross-validation scheme was performed. Our AGMN model achieved an average accuracy of 0.8264, an average precision of 0.8276, an average recall of 0.8264, and an average F1-score of 0.8262, which significantly outperformed existing coronary artery semantic labeling methods. In conclusion, we have developed and validated a new algorithm with high accuracy, interpretability, and robustness for coronary artery semantic labeling on ICAs.
Coronary heart disease (CHD) is the leading cause of adult death in the United States and worldwide, and for which the coronary angiography procedure is the primary gateway for diagnosis and clinical management decisions. The standard-of-care for interpretation of coronary angiograms depends upon ad-hoc visual assessment by the physician operator. However, ad-hoc visual interpretation of angiograms is poorly reproducible, highly variable and bias prone. Here we show for the first time that fully-automated angiogram interpretation to estimate coronary artery stenosis is possible using a sequenc…
Shanghai Jiao Tong University（上海交通大学）；Peking Union Medical College Hospital（北京协和医院）
The segmentation of coronary arteries by convolutional neural network is promising yet requires a large amount of labor-intensive manual annotations. Transferring knowledge from retinal vessels in widely-available public labeled fundus images (FIs) has a potential to reduce the annotation requirement for coronary artery segmentation in X-ray angiograms (XAs) due to their common tubular structures. However, it is challenged by the cross-anatomy domain shift due to the intrinsically different vesselness characteristics in different anatomical regions under even different imaging protocols. To so…
Frangi Filters are one of the widely used filters for enhancing vessels in medical images. Since they were first proposed, the threshold of the vesselness function of Frangi Filters is to be arranged for each individual application. These thresholds are changed manually for individual fluoroscope, for enhancing coronary angiogram images. Hence it is felt, there is a need of mitigating the tuning procedure of threshold values for every fluoroscope. The current papers approach has been devised in order to treat the coronary angiogram images uniformly, irrespective of the fluoroscopes through whi…
CASR-Net: An Image Processing-focused Deep Learning-based Coronary Artery Segmentation and Refinement Network for X-ray Coronary Angiogram
Military Institute of Science and Technology（军事科学技术学院）；University of Dhaka（达卡大学）；Qatar University（卡塔尔大学）；Kuwait College of Science and Technology（科威特科学技术学院）；Vels Institute of Sciences, Technology, and Advanced Studies（韦尔斯科学技术与高级研究学院）；Majmaah University（马杰马阿大学）；Prince Sattam Bin Abdulaziz University（萨塔姆·本·阿卜杜勒阿齐兹亲王大学）；Manipal Academy of Higher Education（马尼帕尔高等教育学院）；Hamad Medical Corporation（哈马德医疗公司）
University of New South Wales（新南威尔士大学）；UNSW Sydney（新南威尔士大学悉尼分校）；Prince of Wales Hospital（威尔士亲王医院）；Auckland City Hospital（奥克兰市医院）
Computed Tomography Coronary Angiography (CTCA) is a non-invasive method to evaluate coronary artery anatomy and disease. CTCA is ideal for geometry reconstruction to create virtual models of coronary arteries. To our knowledge there is no public dataset that includes centrelines and segmentation of the full coronary tree. We provide anonymized CTCA images, voxel-wise annotations and associated data in the form of centrelines, calcification scores and meshes of the coronary lumen in 20 normal and 20 diseased cases. Images were obtained along with patient information with informed, written cons…
Automatic extraction of coronary arteries using deep learning in invasive coronary angiograms
Zhengzhou University of Light Industry（郑州轻工业大学）；Michigan Technological University（密歇根理工大学）；The First Affiliated Hospital of Nanjing Medical University（南京医科大学第一附属医院）
Coronary angiography is the "gold standard" for diagnosing coronary artery disease (CAD). At present, the methods for detecting and evaluating coronary artery stenosis cannot satisfy the clinical needs, e.g., there is no prior study of detecting stenoses in prespecified vessel segments, which is necessary in clinical practice. Two vascular stenosis detection methods are proposed to assist the diagnosis. The first one is an automatic method, which can automatically extract the entire coronary artery tree and mark all the possible stenoses. The second one is an interactive method. With this meth…
School of Computer Science and Technology, Ocean University of China（中国海洋大学计算机科学与技术学院）；School of Material Science and Engineering, Ocean University of China（中国海洋大学材料科学与工程学院）；School of Mathematical Sciences, Ocean University of China（中国海洋大学数学科学学院）；Department of Cardiology, Qilu Hospital (Qingdao), Cheeloo College of Medicine, Shandong University（山东大学齐鲁医学院齐鲁医院（青岛）心内科）
Coronary angiography is the "gold standard" for diagnosing coronary artery disease (CAD). At present, the methods for detecting and evaluating coronary artery stenosis cannot satisfy the clinical needs, e.g., there is no prior study of detecting stenoses in prespecified vessel segments, which is necessary in clinical practice. Two vascular stenosis detection methods are proposed to assist the diagnosis. The first one is an automatic method, which can automatically extract the entire coronary artery tree and mark all the possible stenoses. The second one is an interactive method. With this meth…
CDSA-Net:Collaborative Decoupling of Vascular Structure and Background for High-Fidelity Coronary Digital Subtraction Angiography
School of Artificial Intelligence and Digital Economy Industry, Guangzhou Institute of Science and Technology（人工智能与数字经济学院，广州科学技术研究院）；Department of Cardiology, Second Affiliated Hospital of Nanchang University（南昌大学第二附属医院心内科）；School of Artificial Intelligence, Guangzhou Institute of Science and Technology（人工智能学院，广州科学技术研究院）
Michigan Technological University（密歇根理工大学）；University of Southern Mississippi（南密西西比大学）；Tulane University（杜兰大学）；Ochsner Medical Center（奥克斯纳医疗中心）
In stable coronary artery disease (CAD), reduction in mortality and/or myocardial infarction with revascularization over medical therapy has not been reliably achieved. Coronary arteries are usually extracted to perform stenosis detection. We aim to develop an automatic algorithm by deep learning to extract coronary arteries from ICAs.In this study, a multi-input and multi-scale (MIMS) U-Net with a two-stage recurrent training strategy was proposed for the automatic vessel segmentation. Incorporating features such as the Inception residual module with depth-wise separable convolutional layers,…
Neural network-based coronary dominance classification of RCA angiograms
Sber AI Lab（俄罗斯联邦储蓄银行人工智能实验室）；Moscow Power Engineering Institute（莫斯科动力学院）；MIREA（莫斯科国立无线电工程、电子与自动化学院（MIREA））；Artificial Intelligence Institute（人工智能研究所）；Tyumen Cardiology Research Center（秋明心脏病学研究中心）；Tomsk National Research Medical Center（托木斯克国家研究医学中心）；Russian Academy of Science（俄罗斯科学院）
A method for supervoxel-wise association studies of age and other non-imaging variables from coronary computed tomography angiograms
Radiology, Department of Surgical Sciences, Uppsala University（乌普萨拉大学放射科）；Antaros Medical（Antaros医疗）；Department of Molecular and Clinical Medicine, Institute of Medicine, Sahlgrenska Academy, University of Gothenburg（哥德堡大学医学院分子与临床医学系）
Bioinformatics Institute, Agency for Science, Technology and Research (A*STAR)（新加坡科技研究局生物信息学研究所）；Hwa Chong Institution (College)（华侨中学（高中部））；National Heart Centre Singapore（新加坡国家心脏中心）；Duke-NUS Medical School（杜克-新加坡国立大学医学院）；School of Computing, National University of Singapore（新加坡国立大学计算学院）；Singapore Eye Research Institute (SERI)（新加坡眼科研究所）；Rehabilitation Research Institute of Singapore（新加坡康复研究所）；Institute of Bioengineering and Nanotechnology, A*STAR（新加坡科技研究局生物工程与纳米技术研究所）
The evaluation of obstructions (stenosis) in coronary arteries is currently done by a physician's visual assessment of coronary angiography video sequences. It is laborious, and can be susceptible to interobserver variation. Prior studies have attempted to automate this process, but few have demonstrated an integrated suite of algorithms for the end-to-end analysis of angiograms. We report an automated analysis pipeline based on deep learning to rapidly and objectively assess coronary angiograms, highlight coronary vessels of interest, and quantify potential stenosis. We propose a 3-stage auto…
Shanghai Jiao Tong University（上海交通大学）；University of Electronic Science and Technology of China（电子科技大学）；SenseTime Research（商汤科技研究院）；Peking Union Medical College Hospital（北京协和医院）
The segmentation of coronary arteries in X-ray angiograms by convolutional neural networks (CNNs) is promising yet limited by the requirement of precisely annotating all pixels in a large number of training images, which is extremely labor-intensive especially for complex coronary trees. To alleviate the burden on the annotator, we propose a novel weakly supervised training framework that learns from noisy pseudo labels generated from automatic vessel enhancement, rather than accurate labels obtained by fully manual annotation. A typical self-paced learning scheme is used to make the training …
McMaster University（麦克马斯特大学）；Isfahan University of Technology（伊斯法罕理工大学）；University of Michigan（密歇根大学）
Coronary artery disease (CAD) is the leading causes of death around the world. One of the most common imaging methods for diagnosing this disease is X-ray angiography. Diagnosing using these images is usually challenging due to non-uniform illumination, low contrast, presence of other body tissues, presence of catheter etc. These challenges make the diagnoses task of cardiologists tougher and more prone to misdiagnosis. In this paper we propose a new automated framework for coronary arteries segmentation, catheter detection and center-line extraction in x-ray angiography images. Our proposed s…
Hyper Association Graph Matching with Uncertainty Quantification for Coronary Artery Semantic Labeling
Michigan Technological University（密歇根理工大学）；Medical University of South Carolina（南卡罗来纳医科大学）；The First Affiliated Hospital of Nanjing Medical University（南京医科大学第一附属医院）
Multivessel Coronary Artery Segmentation and Stenosis Localisation using Ensemble Learning
Birmingham City University（伯明翰城市大学）；University of the West of England (UWE)（西英格兰大学）；Institute of Accounting and Administration, University of Aveiro（阿威罗大学会计与行政学院）；NUS High School of Math and Science（新加坡国立大学数学与科学高中）；Qatar University（卡塔尔大学）；Information Technology University（信息技术大学）；Bristol Heart Institute, University of Bristol（布里斯托大学布里斯托心脏研究所）
Coronary Heart Disease (CHD) is a leading cause of death in the modern world. The development of modern analytical tools for diagnostics and treatment of CHD is receiving substantial attention from the scientific community. Deep learning-based algorithms, such as segmentation networks and detectors, play an important role in assisting medical professionals by providing timely analysis of a patient's angiograms. This paper focuses on X-Ray Coronary Angiography (XCA), which is considered to be a "gold standard" in the diagnosis and treatment of CHD. First, we describe publicly available datasets…
Coronary angiography is considered to be a safe tool for the evaluation of coronary artery disease and perform in approximately 12 million patients each year worldwide. [1] In most cases, angiograms are manually analyzed by a cardiologist. Actually, there are no clinical practice algorithms which could improve and automate this work. Neural networks show high efficiency in tasks of image analysis and they can be used for the analysis of angiograms and facilitate diagnostics. We have developed an algorithm based on Convolutional Neural Network and Neural Network U-Net [2] for vessels segmentati…
Zhengzhou University of Light Industry（郑州轻工业大学）；University of Southern Mississippi（南密西西比大学）；Michigan Technological University（密歇根理工大学）；New York Presbyterian Queens Hospital（纽约长老会皇后医院）；The First Affiliated Hospital of Nanjing Medical University（南京医科大学第一附属医院）
Automatic identification of proper image frames at the end-diastolic (ED) and end-systolic (ES) frames during the review of invasive coronary angiograms (ICA) is important to assess blood flow during a cardiac cycle, reconstruct the 3D arterial anatomy from bi-planar views, and generate the complementary fusion map with myocardial images. The current identification method primarily relies on visual interpretation, making it not only time-consuming but also less reproducible. In this paper, we propose a new method to automatically identify angiographic image frames associated with the ED and ES…
A Deep Learning Model for Coronary Artery Segmentation and Quantitative Stenosis Detection in Angiographic Images
School of Mathematical Sciences, Ocean University of China（中国海洋大学数学科学学院）；School of Haide, Ocean University of China（中国海洋大学海德学院）；School of Ocean and Atmosphere, Ocean University of China（中国海洋大学海洋与大气学院）；Qilu Hospital (Qingdao), Cheeloo College of Medicine, Shandong University（山东大学齐鲁医院（青岛））
