Due to the multiple imperfections during the signal acquisition, Electrocardiogram (ECG) datasets are typically contaminated with numerous types of noise, like salt and pepper and baseline drift. These datasets may contain different recordings with various types of noise [1] and thus, denoising may not be the easiest task. Furthermore, usually, the number of labeled bio-signals is very limited for a proper classification task.
Electrocardiogram (ECG) is the most crucial monitoring modality to diagnose cardiovascular events. Precise and automatic detection of abnormal ECG patterns is beneficial to both physicians and patients. In the automatic detection of abnormal ECG patterns, deep neural networks (DNNs) have shown significant achievements. However, DNNs require large amount of labeled data, which are often expensive to obtain. On the other hand, recent research have shown by randomly combining data augmentations can improve image classification accuracy. Thus, in this work we explore data augmentation suitable for…
Ingenuity Labs Research Institute（Ingenuity Labs研究院）
This paper systematically investigates the effectiveness of various augmentations for contrastive self-supervised learning of electrocardiogram (ECG) signals and identifies the best parameters. The baseline of our proposed self-supervised framework consists of two main parts: the contrastive learning and the downstream task. In the first stage, we train an encoder using a number of augmentations to extract generalizable ECG signal representations. We then freeze the encoder and finetune a few linear layers with different amounts of labelled data for downstream arrhythmia detection. We then exp…
Carnegie Mellon University（卡内基梅隆大学）；Allegheny Health Network（阿勒格尼健康网络）；University of Colorado（科罗拉多大学）
In this paper, we focus on a new method of data augmentation to solve the data imbalance problem within imbalanced ECG datasets to improve the robustness and accuracy of heart disease detection. By using Optimal Transport, we augment the ECG disease data from normal ECG beats to balance the data among different categories. We build a Multi-Feature Transformer (MF-Transformer) as our classification model, where different features are extracted from both time and frequency domains to diagnose various heart conditions. Learning from 12-lead ECG signals, our model is able to distinguish five categ…
Harvard Medical School（哈佛医学院）；Massachusetts Institute of Technology（麻省理工学院）
Medical datasets often face the problem of data scarcity, as ground truth labels must be generated by medical professionals. One mitigation strategy is to pretrain deep learning models on large, unlabelled datasets with self-supervised learning (SSL). Data augmentations are essential for improving the generalizability of SSL-trained models, but they are typically handcrafted and tuned manually. We use an adversarial model to generate masks as augmentations for 12-lead electrocardiogram (ECG) data, where masks learn to occlude diagnostically-relevant regions of the ECGs. Compared to random augm…
Fraunhofer Institute for Integrated Circuits IIS（弗劳恩霍夫集成电路研究所）；Friedrich-Alexander University Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；University of Leeds（利兹大学）
Cardiovascular diseases are the most common cause of mortality worldwide. Detection of atrial fibrillation (AF) in the asymptomatic stage can help prevent strokes. It also improves clinical decision making through the delivery of suitable treatment such as, anticoagulant therapy, in a timely manner. The clinical significance of such early detection of AF in electrocardiogram (ECG) signals has inspired numerous studies in recent years, of which many aim to solve this task by leveraging machine learning algorithms. ECG datasets containing AF samples, however, usually suffer from severe class imb…
Infomining, Co. Ltd.（Infomining有限公司）；KAIST College of business（韩国科学技术院商学院）
The performances of commonly used electrocardiogram (ECG) diagnosis models have recently improved with the introduction of deep learning (DL). However, the impact of various combinations of multiple DL components and/or the role of data augmentation techniques on the diagnosis have not been sufficiently investigated. This study proposes an ensemble-based multi-view learning approach with an ECG augmentation technique to achieve a higher performance than traditional automatic 12-lead ECG diagnosis methods. The data analysis results show that the proposed model reports an F1 score of 0.840, whic…
Carnegie Mellon University（卡内基梅隆大学）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；University of Colorado Denver - Anschutz Medical Campus（科罗拉多大学丹佛分校安舒茨医学校区）；Allegheny Health Network（阿勒格尼健康网络）
There has been an increased interest in applying deep neural networks to automatically interpret and analyze the 12-lead electrocardiogram (ECG). The current paradigms with machine learning methods are often limited by the amount of labeled data. This phenomenon is particularly problematic for clinically-relevant data, where labeling at scale can be time-consuming and costly in terms of the specialized expertise and human effort required. Moreover, deep learning classifiers may be vulnerable to adversarial examples and perturbations, which could have catastrophic consequences, for example, whe…
A Novel Data Augmentation Strategy for Robust Deep Learning Classification of Biomedical Time-Series Data: Application to ECG and EEG Analysis
Computer Science Department, College of Science, University of Zakho（扎赫大学科学学院计算机科学系）；Department of Computer Science and Information Technology, The American University of Kurdistan（库尔德斯坦美国大学计算机科学与信息技术系）；PRIME Lab, Scientific Research Center, University of Zakho（扎赫大学科学研究中心PRIME实验室）
Due to the data shortage problem, which is one of the major problems in the field of machine learning, the accuracy level of many applications remains well below the expected. It prevents researchers from producing new artificial intelligence-based systems with the available data. This problem can be solved by generating new synthetic data with augmentation methods. In this study, new ECG signals are produced using MIT-BIH Arrhythmia Database by using Generative Adversarial Neural Networks (GAN), which is a modern data augmentation method. These generated data are used for training a machine l…
Rice University（莱斯大学）；Prudence Medical Technologies Ltd（审慎医疗技术有限公司）
We train an enhanced deep convolutional neural network in order to identify eight cardiac abnormalities from the standard 12-lead electrocardiograms (ECGs) using the dataset of 14000 ECGs. Instead of straightforwardly applying an end-to-end deep learning approach, we find that deep convolutional neural networks enhanced with sophisticated hand crafted features show advantages in reducing generalization errors. Additionally, data preprocessing and augmentation are essential since the distribution of eight cardiac abnormalities are highly biased in the given dataset. Our approach achieves promis…
Swiss Center for Electronics and Microtechnology (CSEM)（瑞士电子与微技术中心）
We developed a convolutional recurrent neural network to classify 12-lead ECG signals for the challenge of PhysioNet/ Computing in Cardiology 2020 as team Pink Irish Hat. The model combines convolutional and recurrent layers, takes sliding windows of ECG signals as input and yields the probability of each class as output. The convolutional part extracts features from each sliding window. The bi-directional gated recurrent unit (GRU) layer and an attention layer aggregate these features from all windows into a single feature vector. Finally, a dense layer outputs class probabilities. The final …
University of Texas at San Antonio（德克萨斯大学圣安东尼奥分校）；Clemson University（克莱姆森大学）
ECG databases are usually highly imbalanced due to the abundance of Normal ECG and scarcity of abnormal cases. As such, deep learning classifiers trained on imbalanced datasets usually perform poorly, especially on minor classes. One solution is to generate realistic synthetic ECG signals using Generative Adversarial Networks (GAN) to augment imbalanced datasets. In this study, we combined conditional GAN with WGAN-GP and developed AC-WGAN-GP in 1D form for the first time to be applied on MIT-BIH Arrhythmia dataset. We investigated the impact of data augmentation on arrhythmia classification. …
School of Computer Science and Technology, Harbin Institute of Technology (HIT)（哈尔滨工业大学计算机科学与技术学院）；School of Physics and Astronomy, The University of Manchester（曼彻斯特大学物理与天文学院）；SPACEnter Space Science and Technology Institute（SPACEnter空间科学与技术研究院）；Northeastern University（东北大学）；Beijing Electric Power Hospital（北京电力医院）
Heart disease is one of the most common diseases causing morbidity and mortality. Electrocardiogram (ECG) has been widely used for diagnosing heart diseases for its simplicity and non-invasive property. Automatic ECG analyzing technologies are expected to reduce human working load and increase diagnostic efficacy. However, there are still some challenges to be addressed for achieving this goal. In this study, we develop an algorithm to identify multiple abnormalities from 12-lead ECG recordings. In the algorithm pipeline, several preprocessing methods are firstly applied on the ECG data for de…
Self-Alignment Learning to Improve Myocardial Infarction Detection from Single-Lead ECG
National Institute of Health Data Science, Peking University（北京大学国家健康数据科学研究院）；State Key Laboratory of General Artificial Intelligence, Peking University（北京大学通用人工智能国家重点实验室）；School of Intelligence Science and Technology, Peking University（北京大学智能科学与技术学院）；Data Science Institute, Imperial College London（伦敦帝国学院数据科学学院）
Universitat Pompeu Fabra（庞培法布拉大学）；Biomedical Research Networking Center in Bioengineering, Biomaterials and Nanomedicine (CIBER-BBN)（生物工程、生物材料与纳米医学生物医学研究网络中心（CIBER-BBN））；Aragón Institute of Engineering Research（阿拉贡工程研究所）；University of Zaragoza（萨拉戈萨大学）
Electrocardiogram (ECG) detection and delineation are key steps for numerous tasks in clinical practice, as ECG is the most performed non-invasive test for assessing cardiac condition. State-of-the-art algorithms employ digital signal processing (DSP), which require laborious rule adaptation to new morphologies. In contrast, deep learning (DL) algorithms, especially for classification, are gaining weight in academic and industrial settings. However, the lack of model explainability and small databases hinder their applicability. We demonstrate DL can be successfully applied to low interpretati…
FlowECG: Using Flow Matching to Create a More Efficient ECG Signal Generator
Cherkasy State Technological University（切爾卡西州立科技大學）；University of the National Education Commission（國家教育委員會大學）；State Scientific Research Institute of Armament and Military Equipment Testing and Certification（軍事裝備測試和認證州科學研究 institutes）
A Novel end-to-end Digital Health System Using Deep Learning-based ECG Analysis
KIOS Research and Innovation Center of Excellence (KIOS CoE)（KIOS研究与创新中心（KIOS CoE））；University of Cyprus（塞浦路斯大学）；MEDTL Medical Technologies Ltd.（MEDTL医疗技术有限公司）；Department of Computer Science, University of Cyprus（塞浦路斯大学计算机科学系）
Large-scale electrophysiological simulations to obtain electrocardiograms (ECG) carry the potential to produce extensive datasets for training of machine learning classifiers to, e.g., discriminate between different cardiac pathologies. The adoption of simulations for these purposes is limited due to a lack of ready-to-use models covering atrial anatomical variability. We built a bi-atrial statistical shape model (SSM) of the endocardial wall based on 47 segmented human CT and MRI datasets using Gaussian process morphable models. Generalization, specificity, and compactness metrics were evalua…
Atrial Fibrillation (AF) is an abnormal heart rhythm which can trigger cardiac arrest and sudden death. Nevertheless, its interpretation is mostly done by medical experts due to high error rates of computerized interpretation. One study found that only about 66% of AF were correctly recognized from noisy ECGs. This is in part due to insufficient training data, class skewness, as well as semantical ambiguities caused by noisy segments in an ECG record. In this paper, we propose a K-margin-based Residual-Convolution-Recurrent neural network (K-margin-based RCR-net) for AF detection from noisy EC…
Semi-Supervised Learning for Multi-Label Cardiovascular Diseases Prediction:A Multi-Dataset Study
City University of Hong Kong（香港城市大学）；Hong Kong Center for Cerebro-Cardiovascular Health Engineering（香港脑心血管健康工程中心）；University of Oxford（牛津大学）；Oxford-Suzhou Institute of Advanced Research（牛津苏州高等研究院）；Shenzhen University（深圳大学）；Micro sensing and imaging technologies limited（微传感与成像技术有限公司）；Wearable intelligent sensing technologies limited（可穿戴智能传感技术有限公司）
Physics-Informed Deep Learning for False Ventricular Tachycardia Alarm Reduction in the ICU
Baylor College of Medicine（贝勒医学院）；Jan and Dan Duncan Neurological Research Institute（简和丹·邓肯神经学研究所）；Texas Children’s Hospital（得克萨斯儿童医院）；Reed College（里德学院）
Panasonic AI Lab（松下人工智能实验室）；Panasonic Technology Division（松下技术部门）；AIoli Labs（AIoli实验室）
Recent contrastive methods show significant improvement in self-supervised learning in several domains. In particular, contrastive methods are most effective where data augmentation can be easily constructed e.g. in computer vision. However, they are less successful in domains without established data transformations such as time series data. In this paper, we propose a novel self-supervised learning framework that combines contrastive learning with neural processes. It relies on recent advances in neural processes to perform time series forecasting. This allows to generate augmented versions …
Intelligent upper-limb exoskeleton integrated with soft wearable bioelectronics and deep-learning for human intention-driven strength augmentation based on sensory feedback
Dongguk University（东国大学）；Georgia Institute of Technology（佐治亚理工学院）；Yonsei University（延世大学）；Emory University School of Medicine（埃默里大学医学院）
A generative adversarial network (GAN) based fully automatic electrocardiogram (ECG) arrhythmia classification system with high performance is presented in this paper. The generator (G) in our GAN is designed to generate various coupling matrix inputs conditioned on different arrhythmia classes for data augmentation. Our designed discriminator (D) is trained on both real and generated ECG coupling matrix inputs, and is extracted as an arrhythmia classifier upon completion of training for our GAN. After fine-tuning the D by including patient-specific normal beats estimated using an unsupervised…
We present CardiacGen, a Deep Learning framework for generating synthetic but physiologically plausible cardiac signals like ECG. Based on the physiology of cardiovascular system function, we propose a modular hierarchical generative model and impose explicit regularizing constraints for training each module using multi-objective loss functions. The model comprises 2 modules, an HRV module focused on producing realistic Heart-Rate-Variability characteristics and a Morphology module focused on generating realistic signal morphologies for different modalities. We empirically show that in additio…
Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California（明希斯电气与计算机工程系，南加州大学）；Alfred E. Mann Department of Biomedical Engineering, University of Southern California（阿尔弗雷德·E·曼生物医学工程系，南加州大学）；Thomas Lord Department of Computer Science, University of Southern California（托马斯·劳德计算机科学系，南加州大学）
Deep learning performs remarkably well on many time series analysis tasks recently. The superior performance of deep neural networks relies heavily on a large number of training data to avoid overfitting. However, the labeled data of many real-world time series applications may be limited such as classification in medical time series and anomaly detection in AIOps. As an effective way to enhance the size and quality of the training data, data augmentation is crucial to the successful application of deep learning models on time series data. In this paper, we systematically review different data…
On-device machine learning (ML) has brought about the accessibility to a tremendous amount of data from the users while keeping their local data private instead of storing it in a central entity. However, for privacy guarantee, it is inevitable at each device to compensate for the quality of data or learning performance, especially when it has a non-IID training dataset. In this paper, we propose a data augmentation framework using a generative model: multi-hop federated augmentation with sample compression (MultFAug). A multi-hop protocol speeds up the end-to-end over-the-air transmission of …
