We present an automatic method to describe clinically useful information about scanning, and to guide image interpretation in ultrasound (US) videos of the fetal heart. Our method is able to jointly predict the visibility, viewing plane, location and orientation of the fetal heart at the frame level. The contributions of the paper are three-fold: (i) a convolutional neural network architecture is developed for a multi-task prediction, which is computed by sliding a 3x3 window spatially through convolutional maps. (ii) an anchor mechanism and Intersection over Union (IoU) loss are applied for improving localization accuracy. (iii) a recurrent architecture is designed to recursively compute regional convolutional features temporally over sequential frames, allowing each prediction to be conditioned on the whole video. This results in a spatial-temporal model that precisely describes detailed heart parameters in challenging US videos. We report results on a real-world clinical dataset, where our method achieves performance on par with expert annotations.
China University of Petroleum（中国石油大学）；Qingdao Women and Children’s Hospital（青岛市妇女儿童医院）
Echocardiography is a powerful prenatal examination tool for early diagnosis of fetal congenital heart diseases (CHDs). The four-chamber (FC) view is a crucial and easily accessible ultrasound (US) image among echocardiography images. Automatic analysis of FC views contributes significantly to the early diagnosis of CHDs. The first step to automatically analyze fetal FC views is locating the fetal four crucial chambers of heart in a US image. However, it is a greatly challenging task due to several key factors, such as numerous speckles in US images, the fetal cardiac chambers with small size …
Romanian Institute of Science and Technology（罗马尼亚科学技术研究所）；University of Medicine and Pharmacy of Craiova（克拉约瓦医药大学）
The present paper puts forward an incipient study that uses a traditional segmentation method based on Zernike moments for extracting significant features from frames of fetal echocardiograms from first trimester color Doppler examinations. A distance based approach is then used on the obtained indicators to classify frames of three given categories that should be present in a normal heart condition. The computational tool shows promise in supporting the obstetrician in a rapid recognition of heart views during screening.
Orientation-Robust Latent Motion Trajectory Learning for Annotation-free Cardiac Phase Detection in Fetal Echocardiography
Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford（生物医学工程研究所，工程科学系，牛津大学）；Nuffield Department of Women’s and Reproductive Health, University of Oxford（妇女与生殖健康纽菲尔德部门，牛津大学）
University of California, San Francisco（加州大学旧金山分校）
Prenatal diagnosis of tetralogy of Fallot (TOF) and hypoplastic left heart syndrome (HLHS), two serious congenital heart defects, improves outcomes and can in some cases facilitate in utero interventions. In practice, however, the fetal diagnosis rate for these lesions is only 30-50 percent in community settings. Improving fetal diagnosis of congenital heart disease is therefore critical. Deep learning is a cutting-edge machine learning technique for finding patterns in images but has not yet been applied to prenatal diagnosis of congenital heart disease. Using 685 retrospectively collected ec…
Latent Motion Profiling for Annotation-free Cardiac Phase Detection in Adult and Fetal Echocardiography Videos
Department of Engineering Science, University of Oxford（牛津大学工程科学系）；Hong Kong Centre for Cerebro-Cardiovascular Health Engineering（香港脑心血管健康工程中心）；Department of Maternal and Child Health and Urological Sciences, Sapienza University of Rome（罗马萨皮恩扎大学妇幼保健与泌尿科学系）；Nuffield Department of Women’s and Reproductive Health, University of Oxford（牛津大学努尔菲尔德妇女与生殖健康系）
DCRA-Net: Attention-Enabled Reconstruction Model for Dynamic Fetal Cardiac MRI
King’s College London（伦敦国王学院）；Evelina London Children’s Hospital（伊芙琳娜伦敦儿童医院）；Imperial College London（帝国理工学院）；Klinikum rechts der Isar, Technical University of Munich（慕尼黑工业大学右岸医院）
The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning
King’s College London（伦敦国王学院）；Technical University of Munich（慕尼黑工业大学）；Imperial College London（帝国理工学院）；Guy’s & St. Thomas’ NHS Foundation Trust（盖伊和圣托马斯国民保健服务基金会信托）；Evelina London Children’s Hospital（伊夫琳娜伦敦儿童医院）
Peng Cheng Laboratory（鹏城实验室）；Beihang University（北京航空航天大学）；Capital Medical University（首都医科大学）；Beijing Anzhen Hospital（北京安贞医院）；Beijing Advanced Innovation Center for Big Data-Based Precision Medicine（北京大数据精准医疗先进创新中心）
As an important scan plane, four chamber view is routinely performed in both second trimester perinatal screening and fetal echocardiographic examinations. The biometrics in this plane including cardio-thoracic ratio (CTR) and cardiac axis are usually measured by sonographers for diagnosing congenital heart disease. However, due to the commonly existing artifacts like acoustic shadowing, the traditional manual measurements not only suffer from the low efficiency, but also with the inconsistent results depending on the operators' skills. In this paper, we present an anchor-free ellipse detectio…
Imperial College London（伦敦帝国学院）；King’s College London（伦敦国王学院）；St Thomas’ Hospital（圣托马斯医院）
Prenatal screening with ultrasound can lower neonatal mortality significantly for selected cardiac abnormalities. However, the need for human expertise, coupled with the high volume of screening cases, limits the practically achievable detection rates. In this paper we discuss the potential for deep learning techniques to aid in the detection of congenital heart disease (CHD) in fetal ultrasound. We propose a pipeline for automated data curation and classification. During both training and inference, we exploit an auxiliary view classification task to bias features toward relevant cardiac stru…
Congenital heart disease is considered as one the most common groups of congenital malformations which affects $6-11$ per $1000$ newborns. In this work, an automated framework for detection of cardiac anomalies during ultrasound screening is proposed and evaluated on the example of Hypoplastic Left Heart Syndrome (HLHS), a sub-category of congenital heart disease. We propose an unsupervised approach that learns healthy anatomy exclusively from clinically confirmed normal control patients. We evaluate a number of known anomaly detection frameworks together with a model architecture based on the…
FUSEP: A Multi-Center Benchmark for Diverse Tasks in Early Pregnancy Fetal Ultrasound Screening
Hunan University（湖南大学）；The Hong Kong University of Science and Technology（香港科技大学）；Anhui University（安徽大学）；Shenzhen Maternity and Child Healthcare Hospital（深圳市妇幼保健院）；Sichuan Provincial Maternity and Child Health Care Hospital（四川省妇幼保健院）；National University of Singapore（新加坡国立大学）；Yunnan Maternal and Child Health Hospital（云南省妇幼保健院）；Zhejiang University（浙江大学）
Institute of Biomedical Engineering, University of Oxford（牛津大学生物医学工程研究所）
Fetal heart motion is an important diagnostic indicator for structural detection and functional assessment of congenital heart disease. We propose an approach towards integrating deep convolutional and recurrent architectures that utilize localized spatial and temporal features of different anatomical substructures within a global spatiotemporal context for interpretation of fetal echocardiography videos. We formulate our task as a cardiac structure localization problem with convolutional architectures for aggregating global spatial context and detecting anatomical structures on spatial region…
Cross-Modal Ultrasound-MRI Learning for Fetal Brain Ventricular Volumetry and Abnormality Screening
Harvard Medical School（哈佛医学院）；Shenzhen University（深圳大学）；Centre for Artificial Intelligence and Robotics, Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences（中国科学院香港创新研究院人工智能与机器人中心）；School of Artificial Intelligence, Shenzhen University（深圳大学人工智能学院）；School of Biomedical Engineering and Informatics, Nanjing Medical University（南京医科大学生物医学工程与信息学院）
Trusted Multi-View Deep Learning Classification of Fetal Congenital Heart Disease with Feature-level and Decision-level Fusion
School of Biomedical Engineering, Shanghai Jiao Tong University（生物医学工程学院，上海交通大学）；Shanghai Key Laboratory of Embryo Original Diseases（上海胚胎原发疾病重点实验室）；Shanghai Municipal Key Clinical Specialty（上海市级重点临床专科）
FPDANet: A Multi-Section Classification Model for Intelligent Screening of Fetal Ultrasound
Guangxi Key Laboratory of Machine Vision and Intelligent Control, Wuzhou University（广西机器视觉与智能控制重点实验室，梧州大学）；College of Computer Science and Electronic Engineering, Hunan University（湖南大学计算机科学与电子工程学院）；Department of Ultrasound, Shenzhen Maternal and Child Healthcare Hospital（深圳妇幼保健医院超声科）；Department of Ultrasound, Sichuan Provincial Maternity and Child Healthcare Hospital（四川省妇幼保健院超声科）；Faculty of Humanities and Arts, Macau University of Science and Technology（澳门科技大学人文艺术学院）
Imperial College London（帝国理工学院）；King’s College London（伦敦国王学院）；Guy’s and St Thomas’ NHS Foundation Trust（盖伊和圣托马斯国民保健服务基金会信托）；City, University of London（伦敦城市大学）；Technical University of Munich（慕尼黑工业大学）
Fetal ultrasound screening during pregnancy plays a vital role in the early detection of fetal malformations which have potential long-term health impacts. The level of skill required to diagnose such malformations from live ultrasound during examination is high and resources for screening are often limited. We present an interpretable, atlas-learning segmentation method for automatic diagnosis of Hypo-plastic Left Heart Syndrome (HLHS) from a single `4 Chamber Heart' view image. We propose to extend the recently introduced Image-and-Spatial Transformer Networks (Atlas-ISTN) into a framework t…
Imperial College London（帝国理工学院）；ETH Zurich（苏黎世联邦理工学院）；Guy’s and St Thomas’ NHS Foundation（盖伊和圣托马斯国民保健服务基金会）
Measurement of head biometrics from fetal ultrasonography images is of key importance in monitoring the healthy development of fetuses. However, the accurate measurement of relevant anatomical structures is subject to large inter-observer variability in the clinic. To address this issue, an automated method utilizing Fully Convolutional Networks (FCN) is proposed to determine measurements of fetal head circumference (HC) and biparietal diameter (BPD). An FCN was trained on approximately 2000 2D ultrasound images of the head with annotations provided by 45 different sonographers during routine …
TPA: Temporal Prompt Alignment for Fetal Congenital Heart Defect Classification
Department of Machine Learning Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) Abu Dhabi, UAE（机器学习系，Mohamed bin Zayed人工智能大学（MBZUAI），阿布扎比，阿联酋）；Department of Computer Vision Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) Abu Dhabi, UAE（计算机视觉系，Mohamed bin Zayed人工智能大学（MBZUAI），阿布扎比，阿联酋）
Translating Electrocardiograms to Cardiac Magnetic Resonance Imaging Useful for Cardiac Assessment and Disease Screening: A Multi-Center Study
College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）；Department of Vascular Surgery, The First Affiliated Hospital of Zhejiang University School of Medicine（浙江大学医学院附属第一医院血管外科）；Department of Cardiology, The First Affiliated Hospital, Zhejiang University School of Medicine（浙江大学医学院附属第一医院心内科）；Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine（浙江大学医学院附属第一医院放射科）；Department of Vascular Surgery, Quzhou People’s Hospital（衢州人民医院血管外科）；Department of Cardiology, The Second Affiliated Hospital of Zhejiang University School of Medicine（浙江大学医学院附属第二医院心内科）；China Ship Scientific Research Center（中国船舶科学研究院）；Guangdong Transtek Medical Electronics Co., Ltd.（广东 Transtek 医疗电子有限公司）
HeartVoice Medical Technology（心之声医疗科技）；HeartRhythm Medical（心律医疗）；Beijing Chao-Yang Hospital, Capital Medical University（首都医科大学附属北京朝阳医院）；University of Science and Technology of China（中国科学技术大学）；Anhui Medical University（安徽医科大学）
The artificial intelligence (AI) system has achieved expert-level performance in electrocardiogram (ECG) signal analysis. However, in underdeveloped countries or regions where the healthcare information system is imperfect, only paper ECGs can be provided. Analysis of real-world ECG images (photos or scans of paper ECGs) remains challenging due to complex environments or interference. In this study, we present an AI system developed to detect and screen cardiac abnormalities (CAs) from real-world ECG images. The system was evaluated on a large dataset of 52,357 patients from multiple regions a…
LGE-Guided Cross-Modality Contrastive Learning for Gadolinium-Free Cardiomyopathy Screening in Cine CMR
School of Biomedical Engineering（生物医学工程学院）；State Key Laboratory of Advanced Medical Materials and Devices（先进医疗材料与设备国家重点实验室）；ShanghaiTech University（上海科技大学）；United Imaging Intelligence（联合影像智能）；Shanghai Clinical Research and Trial Center（上海临床研究与试验中心）；Capital Medical University（首都医科大学）；The First Hospital of Lanzhou University（兰州大学第一医院）
Harbin Institute of Technology（哈尔滨工业大学）；University of Manchester（曼彻斯特大学）
Left ventricular (LV) volumes estimation is a critical procedure for cardiac disease diagnosis. The objective of this paper is to address direct LV volumes prediction task. Methods: In this paper, we propose a direct volumes prediction method based on the end-to-end deep convolutional neural networks (CNN). We study the end-to-end LV volumes prediction method in items of the data preprocessing, networks structure, and multi-views fusion strategy. The main contributions of this paper are the following aspects. First, we propose a new data preprocessing method on cardiac magnetic resonance (CMR)…
Artificial Intelligence-Based Opportunistic Coronary Calcium Screening in the Veterans Affairs National Healthcare System
Veterans Affairs Long Beach Healthcare System（退伍军人事务部长滩医疗系统）；University of California, Irvine（加州大学欧文分校）；Veterans Health Administration（退伍军人健康管理局）；University of Colorado School of Public Health（科罗拉多大学公共卫生学院）；Veterans Affairs Kansas City Healthcare System（退伍军人事务部堪萨斯城医疗系统）；Veterans Affairs San Diego Healthcare System（退伍军人事务部圣迭戈医疗系统）；University of California, San Diego（加州大学圣迭戈分校）；Mass General Brigham（麻省总医院布莱根医疗系统）；Harvard Medical School（哈佛医学院）；Brigham and Women's Hospital（布莱根妇女医院）；Dana-Farber Cancer Institute（丹娜-法伯癌症研究所）；Maastricht University（马斯特里赫特大学）
University Medical Center Utrecht and Utrecht University（乌得勒支大学医学中心与乌得勒支大学）
Cardiovascular disease (CVD) is the global leading cause of death. A strong risk factor for CVD events is the amount of coronary artery calcium (CAC). To meet demands of the increasing interest in quantification of CAC, i.e. coronary calcium scoring, especially as an unrequested finding for screening and research, automatic methods have been proposed. Current automatic calcium scoring methods are relatively computationally expensive and only provide scores for one type of CT. To address this, we propose a computationally efficient method that employs two ConvNets: the first performs registrati…
Image Sciences Institute, University Medical Center Utrecht, Utrecht University（乌得勒支大学医学中心影像科学研究所，乌得勒支大学）；Diagnostic Image Analysis Group at the Department of Radiology and Nuclear Medicine, Radboud University Medical Center（拉德堡德大学医学中心放射学与核医学系诊断影像分析组）；Fraunhofer MEVIS（弗劳恩霍夫医学图像计算研究所）；Department of Radiology, University Medical Center Utrecht, Utrecht University（乌得勒支大学医学中心放射科，乌得勒支大学）
Heavy smokers undergoing screening with low-dose chest CT are affected by cardiovascular disease as much as by lung cancer. Low-dose chest CT scans acquired in screening enable quantification of atherosclerotic calcifications and thus enable identification of subjects at increased cardiovascular risk. This paper presents a method for automatic detection of coronary artery, thoracic aorta and cardiac valve calcifications in low-dose chest CT using two consecutive convolutional neural networks. The first network identifies and labels potential calcifications according to their anatomical locatio…
Unlocking the diagnostic potential of electrocardiograms through information transfer from cardiac magnetic resonance imaging
School of Computation, Information and Technology, Technical University of Munich（慕尼黑工业大学计算、信息与技术学院）；University of Zurich（苏黎世大学）；School of Medicine, Klinikum Rechts der Isar, Technical University of Munich（慕尼黑工业大学雷赫特-伊萨尔医院医学院）；Imperial College London（伦敦帝国学院）；Munich Center for Machine Learning（慕尼黑机器学习中心）
BioMedIA, Imperial College London（帝国理工学院BioMedIA）；HeartFlow；Medical Informatics, University of Luebeck（吕贝克大学医学信息学）
We propose a novel attention gate (AG) model for medical image analysis that automatically learns to focus on target structures of varying shapes and sizes. Models trained with AGs implicitly learn to suppress irrelevant regions in an input image while highlighting salient features useful for a specific task. This enables us to eliminate the necessity of using explicit external tissue/organ localisation modules when using convolutional neural networks (CNNs). AGs can be easily integrated into standard CNN models such as VGG or U-Net architectures with minimal computational overhead while incre…
QCResUNet: Joint Subject-level and Voxel-level Segmentation Quality Prediction
Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO, USA；Department of Electrical；Systems Engineering, Washington University in St. Louis, St. Louis, MO, USA；Department of Biomedical Engineering, University of Cincinnati, Cincinnati, OH, USA；Institute for Informatics, Data Science \& Biostatistics, Washington University School of Medicine, St. Louis, MO, USA
