Orientation-Robust Latent Motion Trajectory Learning for Annotation-free Cardiac Phase Detection in Fetal Echocardiography
Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford（生物医学工程研究所，工程科学系，牛津大学）；Nuffield Department of Women’s and Reproductive Health, University of Oxford（妇女与生殖健康纽菲尔德部门，牛津大学）
Yingyu Yang, Qianye Yang, Can Peng, Elena D'Alberti, Olga Patey, Aris T. Papageorghiou, J. Alison Noble
备注：
Accepted for publication in Medical Image Analysis. This version incorporates revisions following peer review
Fetal echocardiography is essential for detecting congenital heart disease (CHD), facilitating pregnancy management, optimized delivery planning, and timely postnatal interventions. Among standard imaging planes, the four-chamber view (4CV) provides important information for CHD diagnosis, where clinicians carefully inspect the end-diastolic (ED) and end-systolic (ES) phases to evaluate cardiac structure and motion. Automated detection of these cardiac phases is thus a critical component towards fully automated CHD analysis. However, existing approaches typically rely on manual annotation of ED/ES frames, which is labour-intensive and time-consuming. We present ORBIT (Orientation-Robust Beat Inference from Trajectories), a self-supervised framework that identifies cardiac phases without manual annotations under various fetal heart orientation. ORBIT employs registration as self-supervision task and learns a latent motion trajectory of cardiac deformation, whose turning points capture transitions between cardiac relaxation and contraction, enabling accurate and orientation-robust localization of ED and ES frames across diverse fetal positions. Trained exclusively on normal fetal echocardiography videos, ORBIT achieves consistent performance on both normal (mean absolute error 1.9 frames for ED and 1.6 for ES) and CHD cases (mean absolute error 2.4 frames for ED and 2.1 for ES), outperforming existing annotation-free approaches constrained by fixed orientation assumptions. These results highlight the potential of ORBIT to facilitate robust cardiac phase detection directly from 4CV fetal echocardiography.
China University of Petroleum（中国石油大学）；Qingdao Women and Children’s Hospital（青岛市妇女儿童医院）
Echocardiography is a powerful prenatal examination tool for early diagnosis of fetal congenital heart diseases (CHDs). The four-chamber (FC) view is a crucial and easily accessible ultrasound (US) image among echocardiography images. Automatic analysis of FC views contributes significantly to the early diagnosis of CHDs. The first step to automatically analyze fetal FC views is locating the fetal four crucial chambers of heart in a US image. However, it is a greatly challenging task due to several key factors, such as numerous speckles in US images, the fetal cardiac chambers with small size …
Latent Motion Profiling for Annotation-free Cardiac Phase Detection in Adult and Fetal Echocardiography Videos
Department of Engineering Science, University of Oxford（牛津大学工程科学系）；Hong Kong Centre for Cerebro-Cardiovascular Health Engineering（香港脑心血管健康工程中心）；Department of Maternal and Child Health and Urological Sciences, Sapienza University of Rome（罗马萨皮恩扎大学妇幼保健与泌尿科学系）；Nuffield Department of Women’s and Reproductive Health, University of Oxford（牛津大学努尔菲尔德妇女与生殖健康系）
IBM Research – Almaden Research Center（IBM阿尔马登研究中心）；Eastern Virginia Medical School（东弗吉尼亚医学院）
Congenital heart disease (CHD) is the most common congenital abnormality associated with birth defects in the United States. Despite training efforts and substantial advancement in ultrasound technology over the past years, CHD remains an abnormality that is frequently missed during prenatal ultrasonography. Therefore, computer-aided detection of CHD can play a critical role in prenatal care by improving screening and diagnosis. Since many CHDs involve structural abnormalities, automatic segmentation of anatomical structures is an important step in the analysis of fetal echocardiograms. While …
Romanian Institute of Science and Technology（罗马尼亚科学技术研究所）；University of Medicine and Pharmacy of Craiova（克拉约瓦医药大学）
The present paper puts forward an incipient study that uses a traditional segmentation method based on Zernike moments for extracting significant features from frames of fetal echocardiograms from first trimester color Doppler examinations. A distance based approach is then used on the obtained indicators to classify frames of three given categories that should be present in a normal heart condition. The computational tool shows promise in supporting the obstetrician in a rapid recognition of heart views during screening.
Echocardiography to Cardiac MRI View Transformation for Real-Time Blind Restoration
Tampere University（坦佩雷大学）；Qatar University（卡塔尔大学）；VTT Technical Research Centre of Finland（芬兰国家技术研究中心）；Hamad Medical Corporation Hospital（哈马德医疗公司医院）；Hayatabad Medical Complex（海亚特阿巴德医疗中心）
Peng Cheng Laboratory（鹏城实验室）；Beihang University（北京航空航天大学）；Capital Medical University（首都医科大学）；Beijing Anzhen Hospital（北京安贞医院）；Beijing Advanced Innovation Center for Big Data-Based Precision Medicine（北京大数据精准医疗先进创新中心）
As an important scan plane, four chamber view is routinely performed in both second trimester perinatal screening and fetal echocardiographic examinations. The biometrics in this plane including cardio-thoracic ratio (CTR) and cardiac axis are usually measured by sonographers for diagnosing congenital heart disease. However, due to the commonly existing artifacts like acoustic shadowing, the traditional manual measurements not only suffer from the low efficiency, but also with the inconsistent results depending on the operators' skills. In this paper, we present an anchor-free ellipse detectio…
DCRA-Net: Attention-Enabled Reconstruction Model for Dynamic Fetal Cardiac MRI
King’s College London（伦敦国王学院）；Evelina London Children’s Hospital（伊芙琳娜伦敦儿童医院）；Imperial College London（帝国理工学院）；Klinikum rechts der Isar, Technical University of Munich（慕尼黑工业大学右岸医院）
The University of British Columbia（不列颠哥伦比亚大学）；Vancouver General Hospital（温哥华综合医院）
In echocardiography (echo), an electrocardiogram (ECG) is conventionally used to temporally align different cardiac views for assessing critical measurements. However, in emergencies or point-of-care situations, acquiring an ECG is often not an option, hence motivating the need for alternative temporal synchronization methods. Here, we propose Echo-SyncNet, a self-supervised learning framework to synchronize various cross-sectional 2D echo series without any external input. The proposed framework takes advantage of both intra-view and inter-view self supervisions. The former relies on spatiote…
King's College London（伦敦国王学院）；Guy’s and St Thomas' Hospital（盖伊和圣托马斯医院）；University Medical Center Utrecht（乌得勒支大学医学中心）；Royal Brompton Hospital (Guy’s and St Thomas' NHS Foundation Trust)（皇家布朗普顿医院（盖伊和圣托马斯NHS基金会信托））
Left ventricular (LV) function is an important factor in terms of patient management, outcome, and long-term survival of patients with heart disease. The most recently published clinical guidelines for heart failure recognise that over reliance on only one measure of cardiac function (LV ejection fraction) as a diagnostic and treatment stratification biomarker is suboptimal. Recent advances in AI-based echocardiography analysis have shown excellent results on automated estimation of LV volumes and LV ejection fraction. However, from time-varying 2-D echocardiography acquisition, a richer descr…
Cardiac valve event timing in echocardiography using deep learning and triplane recordings
GE Vingmed Ultrasound；Norwegian University of Science and Technology（挪威科技大学）；Oslo University Hospital, Rikshospitalet（奥斯陆大学医院（雷克沙医院））；University of Oslo（奥斯陆大学）；SINTEF Digital（SINTEF数字研究所）；St. Olavs hospital（圣奥拉夫斯医院）
The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning
King’s College London（伦敦国王学院）；Technical University of Munich（慕尼黑工业大学）；Imperial College London（帝国理工学院）；Guy’s & St. Thomas’ NHS Foundation Trust（盖伊和圣托马斯国民保健服务基金会信托）；Evelina London Children’s Hospital（伊夫琳娜伦敦儿童医院）
We present a novel multimodal deep learning framework for cardiac resynchronisation therapy (CRT) response prediction from 2D echocardiography and cardiac magnetic resonance (CMR) data. The proposed method first uses the `nnU-Net' segmentation model to extract segmentations of the heart over the full cardiac cycle from the two modalities. Next, a multimodal deep learning classifier is used for CRT response prediction, which combines the latent spaces of the segmentation models of the two modalities. At inference time, this framework can be used with 2D echocardiography data only, whilst taking…
A Novel Data Augmentation Tool for Enhancing Machine Learning Classification: A New Application of the Higher Order Dynamic Mode Decomposition for Improved Cardiac Disease Identification
Universidad Politécnica de Madrid（马德里理工大学）；ETSI Aeronáutica y del Espacio（航空航天高级技术工程学院）；ETSI Telecomunicación（电信高级技术工程学院）；Universidad Complutense de Madrid（马德里康普顿斯大学）；Centro Nacional de Investigaciones Cardiovasculares (CNIC)（国家心血管研究中心）；Center for Computational Simulation (CCS)（计算仿真中心）
Imperial College London（伦敦帝国学院）；King’s College London（伦敦国王学院）；St Thomas’ Hospital（圣托马斯医院）
Prenatal screening with ultrasound can lower neonatal mortality significantly for selected cardiac abnormalities. However, the need for human expertise, coupled with the high volume of screening cases, limits the practically achievable detection rates. In this paper we discuss the potential for deep learning techniques to aid in the detection of congenital heart disease (CHD) in fetal ultrasound. We propose a pipeline for automated data curation and classification. During both training and inference, we exploit an auxiliary view classification task to bias features toward relevant cardiac stru…
Automatic Cardiac Pathology Recognition in Echocardiography Images Using Higher Order Dynamic Mode Decomposition and a Vision Transformer for Small Datasets
Universidad Politécnica de Madrid（马德里理工大学）；Centro Nacional de Investigaciones Cardiovasculares (CNIC)（国家心血管研究中心）；Universidad Complutense de Madrid（马德里康普顿斯大学）；Center for Computational Simulation (CCS)（计算仿真中心）
University of Alberta（阿尔伯塔大学）；Mazankowski Alberta Heart Institute（马赞科夫斯基阿尔伯塔心脏研究所）
Purpose: Echocardiography is commonly used as a non-invasive imaging tool in clinical practice for the assessment of cardiac function. However, delineation of the left ventricle is challenging due to the inherent properties of ultrasound imaging, such as the presence of speckle noise and the low signal-to-noise ratio. Methods: We propose a semi-automated segmentation algorithm for the delineation of the left ventricle in temporal 3D echocardiography sequences. The method requires minimal user interaction and relies on a diffeomorphic registration approach. Advantages of the method include no d…
The University of Winnipeg（温尼伯大学）；Qatar University（卡塔尔大学）；Hamad Medical Corporation（哈马德医疗公司）
Cardiac imaging known as echocardiography is a non-invasive tool utilized to produce data including images and videos, which cardiologists use to diagnose cardiac abnormalities in general and myocardial infarction (MI) in particular. Echocardiography machines can deliver abundant amounts of data that need to be quickly analyzed by cardiologists to help them make a diagnosis and treat cardiac conditions. However, the acquired data quality varies depending on the acquisition conditions and the patient's responsiveness to the setup instructions. These constraints are challenging to doctors especi…
Continuous 3D Myocardial Motion Tracking via Echocardiography
School of Electronic Science and Engineering, Nanjing University（南京大学电子科学与工程学院）；Medical School, Nanjing University（南京大学医学院）；Zhongshan Hospital, Fudan University（复旦大学中山医院）；College of Optical Sciences, University of Arizona（亚利桑那大学光学科学学院）
University of Sherbrooke（舍布鲁克大学）；Univ Lyon（里昂大学）；Université Claude Bernard Lyon 1（里昂第一大学）；UJM-Saint Etienne（圣艾蒂安大学）；CNRS（法国国家科学研究中心）；Inserm（法国国家健康与医学研究院）；Institut Universitaire de France（法国大学研究院）
Convolutional neural networks (CNN) have demonstrated their ability to segment 2D cardiac ultrasound images. However, despite recent successes according to which the intra-observer variability on end-diastole and end-systole images has been reached, CNNs still struggle to leverage temporal information to provide accurate and temporally consistent segmentation maps across the whole cycle. Such consistency is required to accurately describe the cardiac function, a necessary step in diagnosing many cardiovascular diseases. In this paper, we propose a framework to learn the 2D+time apical long-axi…
Congenital heart disease is considered as one the most common groups of congenital malformations which affects $6-11$ per $1000$ newborns. In this work, an automated framework for detection of cardiac anomalies during ultrasound screening is proposed and evaluated on the example of Hypoplastic Left Heart Syndrome (HLHS), a sub-category of congenital heart disease. We propose an unsupervised approach that learns healthy anatomy exclusively from clinically confirmed normal control patients. We evaluate a number of known anomaly detection frameworks together with a model architecture based on the…
Echo-POSED: Geometric Self-Distillation for Echocardiography Guidance
Medical Technology \& E-Health, Akershus University Hospital, Norway\ Department of Technology Systems, University of Oslo, Norway K.G. Jebsen Center for Cardiac Biomarkers, University of Oslo, Norway Department of Cardiology, Akershus University Hospital, Norway The Intervention Centre, Oslo University Hospital, Norway Department of Informatics, University of Oslo, Norway Correspondence: Shared first authorship
Delineation of the cardiac structures from 2D echocardiographic images is a common clinical task to establish a diagnosis. Over the past decades, the automation of this task has been the subject of intense research. In this paper, we evaluate how far the state-of-the-art encoder-decoder deep convolutional neural network methods can go at assessing 2D echocardiographic images, i.e segmenting cardiac structures as well as estimating clinical indices, on a dataset especially designed to answer this objective. We therefore introduce the Cardiac Acquisitions for Multi-structure Ultrasound Segmentat…
University of British Columbia（不列颠哥伦比亚大学）；Vancouver General Hospital（温哥华综合医院）
Transthoracic echo is one of the most common means of cardiac studies in the clinical routines. During the echo exam, the sonographer captures a set of standard cross sections (echo views) of the heart. Each 2D echo view cuts through the 3D cardiac geometry via a unique plane. Consequently, different views share some limited information. In this work, we investigate the feasibility of generating a 2D echo view using another view based on adversarial generative models. The objective optimized to train the view-conversion model is based on the ideas introduced by LSGAN, PatchGAN and Conditional …
NVIDIA（英伟达）；Lenovo Research（联想研究院）；Piedmont Heart Institute（皮埃蒙特心脏研究所）；Tencent Medical AI Lab（腾讯医疗人工智能实验室）；University of California, Irvine（加州大学欧文分校）
Echocardiography has become routinely used in the diagnosis of cardiomyopathy and abnormal cardiac blood flow. However, manually measuring myocardial motion and cardiac blood flow from echocardiogram is time-consuming and error-prone. Computer algorithms that can automatically track and quantify myocardial motion and cardiac blood flow are highly sought after, but have not been very successful due to noise and high variability of echocardiography. In this work, we propose a neural multi-scale self-supervised registration (NMSR) method for automated myocardial and cardiac blood flow dense track…
GHOST-CAT: An Efficient and Practical Network for Mesh Generation from 3D Echocardiography
Auckland Bioengineering Institute, University of Auckland（奥克兰大学生物工程研究所）；Faculty of Informatics, Telkom University（印尼电信大学信息学院）；School of Biomedical Engineering and Imaging Sciences, King’s College London（伦敦国王学院生物医学工程与成像科学系）；Department of Engineering Science and Biomedical Engineering, University of Auckland（奥克兰大学生命科学工程系）
A Unified Approach for Comprehensive Analysis of Various Spectral and Tissue Doppler Echocardiography
Ontact Health（Ontact健康公司）；Yonsei University College of Medicine（延世大学医学院）；CONNECT-AI Research Center, Yonsei University College of Medicine（延世大学医学院CONNECT-AI研究中心）；Seoul National University Bundang Hospital（首尔国立大学盆唐医院）；Severance Cardiovascular Hospital, Yonsei University Health System（延世大学医疗系统世福兰斯心血管医院）
Focus, Align, and Diffuse: Time-Series-Aware Keyframe Diffusion for Cardiac Dynamic Synthesis from Sparse Observations
School of Engineering, University of Birmingham（伯明翰大学工程学院）；William Harvey Research Institute, Queen Mary University London（伦敦大学玛丽女王学院威廉·哈维研究所）；Division of Cardiology, Johns Hopkins University School of Medicine（约翰斯·霍普金斯大学医学院心脏病学系）
Phase Unwrapping of Color Doppler Echocardiography using Deep Learning
CREATIS（CREATIS实验室）；CNRS（法国国家科学研究中心）；INSERM（法国国家健康与医学研究院）；INSA Lyon（里昂国立应用科学学院）；University of Lyon 1（里昂第一大学）；Institut Universitaire de France（法兰西大学研究院）
Univ Lyon（里昂大学）；INSA-Lyon（里昂国立应用科学学院）；Université Claude Bernard Lyon 1（里昂第一大学克洛德·贝尔纳大学）；UJM-Saint Etienne（圣艾蒂安大学）；CNRS（法国国家科学研究中心）；Inserm（法国国家健康与医学研究院）；Norwegian University of Science and Technology（挪威科技大学）；Centre Hospitalier de Saint-Etienne（圣艾蒂安中心医院）；St. Olavs Hospital（圣奥拉夫医院）；University of Sherbrooke（舍布鲁克大学）
Segmentation of cardiac structures is one of the fundamental steps to estimate volumetric indices of the heart. This step is still performed semi-automatically in clinical routine, and is thus prone to inter- and intra-observer variability. Recent studies have shown that deep learning has the potential to perform fully automatic segmentation. However, the current best solutions still suffer from a lack of robustness. In this work, we introduce an end-to-end multi-task network designed to improve the overall accuracy of cardiac segmentation while enhancing the estimation of clinical indices and…
Universitat Pompeu Fabra（庞培法布拉大学）；Normandie Univ（诺曼底大学）；UNICAEN（卡昂大学）；CHU de Caen Normandie（卡昂诺曼底大学医院）；Inserm Comete（法国国家健康与医学研究院Comete实验室）；GIP Cyceron（Cyceron集团利益公共机构）；Philips Research（飞利浦研究院）；ICREA（加泰罗尼亚高等研究院）；IDIBAPS（巴塞罗那生物医学研究所）；KULeuven（鲁汶大学）
3D echocardiography is an increasingly popular tool for assessing cardiac remodelling in the right ventricle (RV). It allows quantification of the cardiac chambers without any geometric assumptions, which is the main weakness of 2D echocardiography. However, regional quantification of geometry and function is limited by the lower spatial and temporal resolution and the scarcity of identifiable anatomical landmarks. We developed a technique for regionally assessing the 3 relevant RV regions: apical, inlet and outflow. The method's inputs are end-diastolic (ED) and end-systolic (ES) segmented 3D…
Towards Robust Cardiac Segmentation using Graph Convolutional Networks
Norwegian University of Science and Technology（挪威科技大学）；University of Oslo（奥斯陆大学）；GE Research（GE研究中心）；St. Olavs hospital（圣奥拉夫斯医院）；Levanger hospital（莱旺厄尔医院）；SINTEF Health（辛特福健康研究院）
Myocardial Strain Drift Correction in Deep Learning Based Ultrasound Tracking
University of Sherbrooke（舍布鲁克大学）；INSA（法国国立应用科学学院）；Université Lyon 1（里昂第一大学）；CREATIS（CREATIS实验室）；Institut Universitaire de France (IUF)（法国大学研究院（IUF））；NTNU（挪威科技大学）；St. Olavs Hospital（圣奥拉夫医院）；SINTEF Digital（SINTEF数字研究所）；Levanger Hospital（莱旺厄尔医院）；Nord-Trøndelag Hospital Trust（北特伦德拉格医院信托）；Hôpital Croix-Rousse（克鲁瓦鲁斯医院）；Hospices Civils de Lyon（里昂民用医院集团）；Hôpital Lyon Sud（里昂南部医院）
Atrial Septal Defect Detection in Children Based on Ultrasound Video Using Multiple Instances Learning
Shanghai Children’s Medical Center, School of Medicine, Shanghai Jiaotong University（上海交通大学医学院附属上海儿童医学中心）；Minhang District Centers for Disease Control and Prevention（闵行区疾病预防控制中心）；Xi’an Jiaotong-Liverpool University（西交利物浦大学）；East China Normal University（华东师范大学）；University of Shanghai for Science and Technology（上海理工大学）
ETH Zürich（苏黎世联邦理工学院）；University Children’s Hospital Regensburg (KUNO)（雷根斯堡大学儿童医院（KUNO））
Pulmonary hypertension (PH) in newborns and infants is a complex condition associated with several pulmonary, cardiac, and systemic diseases contributing to morbidity and mortality. Therefore, accurate and early detection of PH is crucial for successful management. Using echocardiography, the primary diagnostic tool in pediatrics, human assessment is both time-consuming and expertise-demanding, raising the need for an automated approach. In this work, we present an interpretable multi-view video-based deep learning approach to predict PH for a cohort of 194 newborns using echocardiograms. We u…
IMC-PINN-FE: A Physics-Informed Neural Network for Patient-Specific Left Ventricular Finite Element Modeling with Image Motion Consistency and Biomechanical Parameter Estimation
Department of Bioengineering, Imperial College London（帝国理工学院生物工程系）
