Echo2ECG: Enhancing ECG Representations with Cardiac Morphology from Multi-View Echos
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital（人工智能在医疗与医学中的中心，慕尼黑技术大学（TUM）和慕尼黑大学医院）；Department of Cardiology, TUM University Hospital（心血管科，慕尼黑大学医院）；Department of Computing, Imperial College London（计算系，伦敦帝国理工学院）；Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心（MCML））
Michelle Espranita Liman, Özgün Turgut, Alexander Müller, Eimo Martens, Daniel Rueckert, Philip Müller
Electrocardiography (ECG) is a low-cost, widely used modality for diagnosing electrical abnormalities like atrial fibrillation by capturing the heart's electrical activity. However, it cannot directly measure cardiac morphological phenotypes, such as left ventricular ejection fraction (LVEF), which typically require echocardiography (Echo). Predicting these phenotypes from ECG would enable early, accessible health screening. Existing self-supervised methods suffer from a representational mismatch by aligning ECGs to single-view Echos, which only capture local, spatially restricted anatomical snapshots. To address this, we propose Echo2ECG, a multimodal self-supervised learning framework that enriches ECG representations with the heart's morphological structure captured in multi-view Echos. We evaluate Echo2ECG as an ECG feature extractor on two clinically relevant tasks that fundamentally require morphological information: (1) classification of structural cardiac phenotypes across three datasets, and (2) retrieval of Echo studies with similar morphological characteristics using ECG queries. Our extracted ECG representations consistently outperform those of state-of-the-art unimodal and multimodal baselines across both tasks, despite being 18x smaller than the largest baseline. These results demonstrate that Echo2ECG is a robust, powerful ECG feature extractor. Our code is accessible at https://github.com/michelleespranita/Echo2ECG.
TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care
Emory University（埃默里大学）；Massachusetts Institute of Technology（麻省理工学院）；University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校）；University of Rochester（罗切斯特大学）
LVCG: Learning ECG Representations in the Latent Vectorcardiogram Space
Griffith University, Australia（格里菲斯大学）；SingHealth Duke-NUS AI in Medicine Institute, Singapore（新加坡SingHealth Duke-NUS医学人工智能研究所）；Emory University, USA（埃默里大学）
ImputeECG: Deep Learning Reconstruction of Complete 12-Lead Electrocardiograms from Incomplete Recordings for Cardiac Assessment
National Institute of Health Data Science, Peking University（北京大学健康医疗大数据国家研究院）；School of Intelligence Science and Technology, Peking University（北京大学智能科学与技术学院）；Institute of Medical Technology, Peking University Health Science Center（北京大学医学部医学技术研究所）；University of the Chinese Academy of Sciences（中国科学院大学）；Department of Cardiology, Peking University People’s Hospital（北京大学人民医院心内科）；Department of Computer Science, Tianjin University of Technology（天津理工大学计算机科学与工程学院）
Learning Cardiac Features: ECG Biometrics Across Time and~Exercise
Aix-Marseille Univ（艾克斯-马赛大学）；CNRS（法国国家科学研究中心）；LIS（计算机与系统实验室）；Inserm-INRAE（法国国家健康与医学研究院-法国国家农业、食品与环境研究院）；C2VN（神经科学与心血管营养中心）；University Hospitals of Marseille（马赛大学医院）
Zhejiang University（浙江大学）；The First Affiliated Hospital of University of Science and Technology of China（中国科学技术大学附属第一医院）；HeartVoice Medical Technology（心声医疗科技）；University of Science and Technology of China（中国科学技术大学）；Peking University（北京大学）
With the development of deep learning-based methods, automated classification of electrocardiograms (ECGs) has recently gained much attention. Although the effectiveness of deep neural networks has been encouraging, the lack of information given by the outputs restricts clinicians' reexamination. If the uncertainty estimation comes along with the classification results, cardiologists can pay more attention to "uncertain" cases. Our study aims to classify ECGs with rejection based on data uncertainty and model uncertainty. We perform experiments on a real-world 12-lead ECG dataset. First, we es…
Versatile and Risk-Sensitive Cardiac Diagnosis via Graph-Based ECG Signal Representation
College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）；State Key Laboratory of Transvascular Implantation Devices of the Second Affiliated Hospital, Zhejiang University School of Medicine（浙江大学医学院第二附属医院国家心血管介入装置重点实验室）；Zhejiang Key Laboratory of Medical Imaging Artificial Intelligence（浙江省医学影像人工智能重点实验室）；Alibaba Group（阿里巴巴集团）；School of Computer and Computational Science, Hangzhou City University（杭州城市学院计算机与计算科学学院）；Information Hub, Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）信息中心）；Department of Computer Science and Engineering, University of Notre Dame（诺特大学计算机科学与工程系）；State Key Laboratory of Transvascular Implantation Devices of the Second Affiliated Hospital and School of Public Health, Zhejiang University School of Medicine（浙江大学医学院第二附属医院和公共卫生学院国家心血管介入装置重点实验室）
Global and Local Contrastive Learning for Joint Representations from Cardiac MRI and ECG
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany（人工智能在医疗与医学中的研究中心，技术大学慕尼黑（TUM）及慕尼黑技术大学医院）；School of Medicine, Klinikum rechts der Isar, TUM, Germany（医学院，右岸克里克医院，TUM，德国）；Department of Computing, Imperial College London, UK（计算学院，伦敦帝国学院，英国）；Munich Center for Machine Learning (MCML), Munich, Germany（慕尼黑机器学习中心（MCML），慕尼黑，德国）
Unlocking the diagnostic potential of electrocardiograms through information transfer from cardiac magnetic resonance imaging
School of Computation, Information and Technology, Technical University of Munich（慕尼黑工业大学计算、信息与技术学院）；University of Zurich（苏黎世大学）；School of Medicine, Klinikum Rechts der Isar, Technical University of Munich（慕尼黑工业大学雷赫特-伊萨尔医院医学院）；Imperial College London（伦敦帝国学院）；Munich Center for Machine Learning（慕尼黑机器学习中心）
ECG-MoE: Mixture-of-Expert Electrocardiogram Foundation Model
Department of Computer Science（计算机科学系）；Emory University（埃默里大学）；School of Computer Science（计算机科学学院）；University of Oklahoma（俄克拉荷马大学）；Center of Data Science（数据科学中心）
Translating Electrocardiograms to Cardiac Magnetic Resonance Imaging Useful for Cardiac Assessment and Disease Screening: A Multi-Center Study
College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）；Department of Vascular Surgery, The First Affiliated Hospital of Zhejiang University School of Medicine（浙江大学医学院附属第一医院血管外科）；Department of Cardiology, The First Affiliated Hospital, Zhejiang University School of Medicine（浙江大学医学院附属第一医院心内科）；Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine（浙江大学医学院附属第一医院放射科）；Department of Vascular Surgery, Quzhou People’s Hospital（衢州人民医院血管外科）；Department of Cardiology, The Second Affiliated Hospital of Zhejiang University School of Medicine（浙江大学医学院附属第二医院心内科）；China Ship Scientific Research Center（中国船舶科学研究院）；Guangdong Transtek Medical Electronics Co., Ltd.（广东 Transtek 医疗电子有限公司）
Zhejiang University（浙江大学）；RealDoctor AI Research Centre（RealDoctor人工智能研究中心）；Shanghai Polytechnic University（上海第二工业大学）；University of Notre Dame（圣母大学）
A large number of people suffer from life-threatening cardiac abnormalities, and electrocardiogram (ECG) analysis is beneficial to determining whether an individual is at risk of such abnormalities. Automatic ECG classification methods, especially the deep learning based ones, have been proposed to detect cardiac abnormalities using ECG records, showing good potential to improve clinical diagnosis and help early prevention of cardiovascular diseases. However, the predictions of the known neural networks still do not satisfactorily meet the needs of clinicians, and this phenomenon suggests that…
Reconstructing 12-Lead ECG from 3-Lead ECG using Variational Autoencoder to Improve Cardiac Disease Detection of Wearable ECG Devices
National Institute of Health Data Science, Peking University, Beijing, China（国家健康数据科学研究院，北京大学，北京，中国）；Institute for Artificial Intelligence, Peking University, Beijing, China（人工智能研究院，北京大学，北京，中国）；State Key Laboratory of General Artificial Intelligence, Beijing 100871, China（通用人工智能国家重点实验室，北京，中国）；School of Intelligence Science and Technology, Peking University, Beijing 100871, China（智能科学与技术学院，北京大学，北京，中国）；Department of Cardiology, Peking University People’s Hospital, Beijing 100044, China（北京大学人民医院心内科，北京，中国）；HeartVoice Medical Technology, Hefei 230088, China（HeartVoice医疗科技，合肥，中国）
EchoBridge: Long-Tail-Aware ECG-Echocardiography Text Alignment for Echocardiography-Derived Cardiac Findings
School of Intelligence Science and Technology, Peking University（北京大学智能科学与技术学院）；University of the Chinese Academy of Sciences（中国科学院大学）；State Key Laboratory of General Artificial Intelligence, Peking University（北京大学通用人工智能重点实验室）；National Institute of Health Data Science, Peking University（北京大学健康数据科学研究所）；Department of Cardiology, Peking University People’s Hospital（北京大学人民医院心内科）
Cross-Learning Between ECG and PCG: Exploring Common and Exclusive Characteristics of Bimodal Electromechanical Cardiac Waveforms
School of Medicine, Emory University（埃默里大学医学院）；Rollins School of Public Health, Department of Epidemiology, Emory University（埃默里大学罗林斯公共卫生学院流行病学系）；Department of Biomedical Engineering, Georgia Institute of Technology and Emory University（佐治亚理工学院生物医学工程系）
ETH Zürich（苏黎世联邦理工学院）；University of Bologna（博洛尼亚大学）；Huawei Technologies（华为技术有限公司）
Personalized ubiquitous healthcare solutions require energy-efficient wearable platforms that provide an accurate classification of bio-signals while consuming low average power for long-term battery-operated use. Single lead electrocardiogram (ECG) signals provide the ability to detect, classify, and even predict cardiac arrhythmia. In this paper, we propose a novel temporal convolutional network (TCN) that achieves high accuracy while still being feasible for wearable platform use. Experimental results on the ECG5000 dataset show that the TCN has a similar accuracy (94.2%) score as the state…
Carnegie Mellon University（卡内基梅隆大学）；Allegheny Health Network（阿勒格尼健康网络）；University of Colorado（科罗拉多大学）
In this paper, we focus on a new method of data augmentation to solve the data imbalance problem within imbalanced ECG datasets to improve the robustness and accuracy of heart disease detection. By using Optimal Transport, we augment the ECG disease data from normal ECG beats to balance the data among different categories. We build a Multi-Feature Transformer (MF-Transformer) as our classification model, where different features are extracted from both time and frequency domains to diagnose various heart conditions. Learning from 12-lead ECG signals, our model is able to distinguish five categ…
ECGFlowCMR: Pretraining with ECG-Generated Cine CMR Helps Cardiac Disease Classification and Phenotype Prediction
School of Intelligence Science and Technology, Peking University（北京大学智能科学与技术学院）；Polytechnic Institute of Zhejiang University, Zhejiang University（浙江大学 polytechnic 院）；Institute of Computing Technology, University of the Chinese Academy of Sciences（中国科学院计算技术研究所）；National Institute of Health Data Science, Peking University（北京大学健康数据科学国家研究院）；Institute of Microelectronics, University of the Chinese Academy of Sciences（中国科学院微电子研究所）；Department of Cardiology, Zhejiang University（浙江大学心内科部）
Leveraging Cardiac Imaging to Improve ECG-Based Detection of Chagas Disease in Resource-Constrained Settings
Amsterdam University Medical Center（阿姆斯特丹大学医学中心）；University of Amsterdam（阿姆斯特丹大学）；ETH Zurich（苏黎世联邦理工学院）；Amsterdam Cardiovascular Sciences（阿姆斯特丹心血管科学研究院）
Vib2ECG: A Paired Chest-Lead SCG-ECG Dataset and Benchmark for ECG Reconstruction
Leiden Institute of Advanced Computer Science (LIACS), Leiden University（莱顿先进计算机科学研究所（LIACS）、莱顿大学）；School of Computer Science and Technology, University of Science and Technology of China（中国科学技术大学计算机科学与技术学院）
AnyECG: Foundational Models for Multitask Cardiac Analysis in Real-World Settings
The College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Antai College of Economics and Management, Shanghai Jiao Tong University（上海交通大学安泰经济与管理学院）；Information Hub, Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）信息枢纽）；the School of Public Health and Second Affiliated Hospital, Zhejiang University School of Medicine（浙江大学医学院公共卫生学院及第二附属医院）
The University of Tennessee（田纳西大学）；University of Oklahoma Health Sciences Center（俄克拉荷马大学健康科学中心）
Cardiac disease is the leading cause of death in the US. Accurate heart disease detection is of critical importance for timely medical treatment to save patients' lives. Routine use of electrocardiogram (ECG) is the most common method for physicians to assess the electrical activities of the heart and detect possible abnormal cardiac conditions. Fully utilizing the ECG data for reliable heart disease detection depends on developing effective analytical models. In this paper, we propose a two-level hierarchical deep learning framework with Generative Adversarial Network (GAN) for automatic diag…
ECG-LLM: Foundation Model for ECG-Based Cardiac Reasoning
Technical University of Munich (TUM)（慕尼黑工业大学）；TUM University Hospital（慕尼黑工业大学附属医院）；Imperial College London（帝国理工学院）；Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）
National Tsing Hua University（国立清华大学）；Inventec Corporation（英业达公司）
Electrocardiogram(ECG) is commonly used to detect cardiac irregularities such as atrial fibrillation, bradycardia, and other irregular complexes. While previous studies have achieved great accomplishment classifying these irregularities with standard 12-lead ECGs, there existed limited evidence demonstrating the utility of reduced-lead ECGs in capturing a wide-range of diagnostic information. In addition, classification model's generalizability across multiple recording sources also remained uncovered. As part of the PhysioNet Computing in Cardiology Challenge 2021, our team HaoWan AIeC, propo…
Ufa State Aviation Technical University（乌法国立航空技术大学）；Bashkir State Pedagogical University（巴什基尔国立师范大学）；Ural Federal University（乌拉尔联邦大学）；Institute of Immunology and Physiology UrB RAS（俄罗斯科学院乌拉尔分院免疫学与生理学研究所）
Machine learning shows great performance in various problems of electrocardiography (ECG) signal analysis. However, collecting a dataset for biomedical engineering is a very difficult task. Any dataset for ECG processing contains from 100 to 10,000 times fewer cases than datasets for image or text analysis. This issue is especially important because of physiological phenomena that can significantly change the morphology of heartbeats in ECG signals. In this preliminary study, we analyze the effects of lead choice from the standard ECG recordings, variation of ECG during 24-hours, and the effec…
FoundationalECGNet: A Lightweight Foundational Model for ECG-based Multitask Cardiac Analysis
Department of Computer Science and Engineering, BRAC University（计算机科学与工程系，布拉克大学）；Department of Electrical and Electronic Engineering, BRAC University（电气与电子工程系，布拉克大学）；Department of Biomedical Engineering, Linköping University（生物医学工程系，林哈姆大学）
HeartVoice Medical Technology（心音医疗科技）；University of Science and Technology of China（中国科学技术大学）
Electrocardiogram (ECG) is one of the most convenient and non-invasive tools for monitoring peoples' heart condition, which can use for diagnosing a wide range of heart diseases, including Cardiac Arrhythmia, Acute Coronary Syndrome, et al. However, traditional ECG disease detection models show substantial rates of misdiagnosis due to the limitations of the abilities of extracted features. Recent deep learning methods have shown significant advantages, but they do not provide publicly available services for those who have no training data or computational resources. In this paper, we demonstra…
Texas A&M University（得克萨斯农工大学）；Dell Inc.（戴尔公司）；Heart Artery and Vein Center of Fresno（弗雷斯诺心脏动脉与静脉中心）
Recent introduction of wearable single-lead ECG devices of diverse configurations has caught the intrigue of the medical community. While these devices provide a highly affordable support tool for the caregivers for continuous monitoring and to detect acute conditions, such as arrhythmia, their utility for cardiac diagnostics remains limited. This is because clinical diagnosis of many cardiac pathologies is rooted in gleaning patterns from synchronous 12-lead ECG. If synchronous 12-lead signals of clinical quality can be synthesized from these single-lead devices, it can transform cardiac care…
Objectives: Atrial fibrillation (AF) is a common heart rhythm disorder associated with deadly and debilitating consequences including heart failure, stroke, poor mental health, reduced quality of life and death. Having an automatic system that diagnoses various types of cardiac arrhythmias would assist cardiologists to initiate appropriate preventive measures and to improve the analysis of cardiac disease. To this end, this paper introduces a new approach to detect and classify automatically cardiac arrhythmias in electrocardiograms (ECG) recordings. Methods: The proposed approach used a combi…
Swiss Center for Electronics and Microtechnology (CSEM)（瑞士电子与微技术中心）
Except for a few specific types, cardiac arrhythmias are not immediately life-threatening. However, if not treated appropriately, they can cause serious complications. In particular, atrial fibrillation, which is characterized by fast and irregular heart beats, increases the risk of stroke. We propose three neural network architectures to detect abnormal rhythms from single-lead ECG signals. These architectures combine convolutional layers to extract high-level features pertinent for arrhythmia detection from sliding windows and recurrent layers to aggregate these features over signals of vary…
Swiss Center for Electronics and Microtechnology (CSEM)（瑞士电子与微技术中心）
While most heart arrhythmias are not immediately harmful, they can lead to severe complications. In particular, atrial fibrillation, the most common arrhythmia, is characterized by fast and irregular heart beats and increases the risk of suffering a stroke. To detect such abnormal heart conditions, we propose a system composed of two main parts: a smart vest with two cooperative sensors to collect ECG data and a neural network architecture to classify heart rhythms. The smart vest uses two dry bi-electrodes to record a single lead ECG signal. The biopotential signal is then streamed via a gate…
Ingenuity Labs Research Institute（Ingenuity Labs 研究院）
Electrocardiogram (ECG) is the electrical measurement of cardiac activity, whereas Photoplethysmogram (PPG) is the optical measurement of volumetric changes in blood circulation. While both signals are used for heart rate monitoring, from a medical perspective, ECG is more useful as it carries additional cardiac information. Despite many attempts toward incorporating ECG sensing in smartwatches or similar wearable devices for continuous and reliable cardiac monitoring, PPG sensors are the main feasible sensing solution available. In order to tackle this problem, we propose CardioGAN, an advers…
Università della Svizzera italiana（瑞士意大利语区大学）；University of Pennsylvania（宾夕法尼亚大学）；Pontificia Universidad Católica de Chile（智利天主教大学）
We propose a method for identifying an ectopic activation in the heart non-invasively. Ectopic activity in the heart can trigger deadly arrhythmias. The localization of the ectopic foci or earliest activation sites (EASs) is therefore a critical information for cardiologists in deciding the optimal treatment. In this work, we formulate the identification problem as a global optimization problem, by minimizing the mismatch between the ECG predicted by a cardiac model, when paced at a given EAS, and the observed ECG during the ectopic activity. Our cardiac model amounts at solving an anisotropic…
Acceleration of machine learning research in healthcare is challenged by lack of large annotated and balanced datasets. Furthermore, dealing with measurement inaccuracies and exploiting unsupervised data are considered to be central to improving existing solutions. In particular, a primary objective in predictive modeling is to generalize well to both unseen variations within the observed classes, and unseen classes. In this work, we consider such a challenging problem in machine learning driven diagnosis: detecting a gamut of cardiovascular conditions (e.g. infarction, dysrhythmia etc.) from …
Peng Cheng Laboratory（鹏城实验室）；Beihang University（北京航空航天大学）；Capital Medical University（首都医科大学）；Beijing Anzhen Hospital（北京安贞医院）；Beijing Advanced Innovation Center for Big Data-Based Precision Medicine（北京大数据精准医疗先进创新中心）
As an important scan plane, four chamber view is routinely performed in both second trimester perinatal screening and fetal echocardiographic examinations. The biometrics in this plane including cardio-thoracic ratio (CTR) and cardiac axis are usually measured by sonographers for diagnosing congenital heart disease. However, due to the commonly existing artifacts like acoustic shadowing, the traditional manual measurements not only suffer from the low efficiency, but also with the inconsistent results depending on the operators' skills. In this paper, we present an anchor-free ellipse detectio…
Healthcare Technology and Innovation Center (HTIC), Indian Institute of Technology (IIT-M)（印度理工学院马德拉斯分校医疗技术与创新中心）；Indian Institute of Technology, Madras (IITM)（印度理工学院马德拉斯分校）
Cardiac arrhythmia is a prevalent and significant cause of morbidity and mortality among cardiac ailments. Early diagnosis is crucial in providing intervention for patients suffering from cardiac arrhythmia. Traditionally, diagnosis is performed by examination of the Electrocardiogram (ECG) by a cardiologist. This method of diagnosis is hampered by the lack of accessibility to expert cardiologists. For quite some time, signal processing methods had been used to automate arrhythmia diagnosis. However, these traditional methods require expert knowledge and are unable to model a wide range of arr…
