The transformer based model (e.g., FusingTF) has been employed recently for Electrocardiogram (ECG) signal classification. However, the high-dimensional embedding obtained via 1-D convolution and positional encoding can lead to the loss of the signal's own temporal information and a large amount of training parameters. In this paper, we propose a new method for ECG classification, called low-dimensional denoising embedding transformer (LDTF), which contains two components, i.e., low-dimensional denoising embedding (LDE) and transformer learning. In the LDE component, a low-dimensional representation of the signal is obtained in the time-frequency domain while preserving its own temporal information. And with the low dimensional embedding, the transformer learning is then used to obtain a deeper and narrower structure with fewer training parameters than that of the FusingTF. Experiments conducted on the MIT-BIH dataset demonstrates the effectiveness and the superior performance of our proposed method, as compared with state-of-the-art methods.
Monitoring of electrocardiogram (ECG) provides vital information as well as any cardiovascular anomalies. Recent advances in the technology of wearable electronics have enabled compact devices to acquire personal physiological signals in the home setting; however, signals are usually contaminated with high level noise. Thus, an efficient ECG filtering scheme is a dire need. In this paper, a novel method using Ensemble Kalman Filter (EnKF) is developed for denoising ECG signals. We also intensively explore various filtering algorithms, including Savitzky-Golay (SG) filter, Ensemble Empirical mo…
Electrocardiogram (ECG) signal is an important physiological signal which contains cardiac information and is the basis to diagnosis cardiac related diseases. In this paper, several innovative and efficient methods based on adaptive filter and empirical mode decomposition (EMD) to denoise ECG signal contaminated by various kinds of noise, including baseline wander (BW), power line interference (PLI), electrode motion artifact (EM) and muscle artifact (MA), are proposed. We first present a novel method based on EMD and adaptive filter for the removal of BW and PLI in ECG signal. We then extend …
Generative Adversarial Networks (GAN) are known to produce synthetic data that are difficult to discern from real ones by humans. In this paper we present an approach to use GAN to produce realistically looking ECG signals. We utilize them to train and evaluate a denoising autoencoder that achieves state-of-the-art filtering quality for ECG signals. It is demonstrated that generated data improves the model performance compared to the model trained on real data only. We also investigate an effect of transfer learning by reusing trained discriminator network for denoising model.
We propose a novel deep learning based denoising filter selection algorithm for noisy Electrocardiograph (ECG) signal preprocessing. ECG signals measured under clinical conditions, such as those acquired using skin contact devices in hospitals, often contain baseline signal disturbances and unwanted artefacts; indeed for signals obtained outside of a clinical environment, such as heart rate signatures recorded using non-contact radar systems, the measurements contain greater levels of noise than those acquired under clinical conditions. In this paper, we focus on heart rate signals acquired us…
SSEMG-Net: A Spectrogram-Based Mamba Network for Surface Electromyography Denoising
National Taiwan University（国立台湾大学）；Academia Sinica（中央研究院）；Stevens Institute of Technology（史蒂文斯理工学院）；Columbia University Irving Medical Center（哥伦比亚大学欧文医学中心）
School of Electrical and Electronics Engineering（电气与电子工程学院）；University of Manchester（曼彻斯特大学）
Effective and powerful methods for denoising real electrocardiogram (ECG) signals are important for wearable sensors and devices. Deep Learning (DL) models have been used extensively in image processing and other domains with great success but only very recently have been used in processing ECG signals. This paper presents several DL models namely Convolutional Neural Networks (CNNs), Long Short-Term Memory (LSTM), Restricted Boltzmann Machine (RBM) together with the more conventional filtering methods (low pass filtering, high pass filtering, Notch filtering) and the standard wavelet-based te…
Electrocardiographic signal is a subject to multiple noises, caused by various factors. It is therefore a standard practice to denoise such signal before further analysis. With advances of new branch of machine learning, called deep learning, new methods are available that promises state-of-the-art performance for this task. We present a novel approach to denoise electrocardiographic signals with deep recurrent denoising neural networks. We utilize a transfer learning technique by pretraining the network using synthetic data, generated by a dynamic ECG model, and fine-tuning it with a real dat…
Philips Research North America（飞利浦北美研究院）；University of Arizona Banner Health（亚利桑那大学班纳健康）
We present our entry to the 2021 PhysioNet/CinC challenge - a waveform transformer model to detect cardiac abnormalities from ECG recordings. We compare the performance of the waveform transformer model on different ECG-lead subsets using approximately 88,000 ECG recordings from six datasets. In the official rankings, team prna ranked between 9 and 15 on 12, 6, 4, 3 and 2-lead sets respectively. Our waveform transformer model achieved an average challenge metric of 0.47 on the held-out test set across all ECG-lead subsets. Our combined performance across all leads placed us at rank 11 out of 3…
Electrocardiogram (ECG) has been widely used for emotion recognition. This paper presents a deep neural network based on convolutional layers and a transformer mechanism to detect stress using ECG signals. We perform leave-one-subject-out experiments on two publicly available datasets, WESAD and SWELL-KW, to evaluate our method. Our experiments show that the proposed model achieves strong results, comparable or better than the state-of-the-art models for ECG-based stress detection on these two datasets. Moreover, our method is end-to-end, does not require handcrafted features, and can learn ro…
Healthcare Technology Innovation Centre Indian Institute of Technology Madras（印度理工学院马德拉斯分校医疗技术创新中心）；Department of Electrical Engineering Indian Institute of Technology Madras（印度理工学院马德拉斯分校电气工程系）
Continuous monitoring of cardiac health under free living condition is crucial to provide effective care for patients undergoing post operative recovery and individuals with high cardiac risk like the elderly. Capacitive Electrocardiogram (cECG) is one such technology which allows comfortable and long term monitoring through its ability to measure biopotential in conditions without having skin contact. cECG monitoring can be done using many household objects like chairs, beds and even car seats allowing for seamless monitoring of individuals. This method is unfortunately highly susceptible to …
MECG-E: Mamba-based ECG Enhancer for Baseline Wander Removal
National Taiwan University（台湾大学）；University of Massachusetts Amherst（马萨诸塞大学阿默斯特分校）；National Institute of Information and Communications Technology（信息通信研究机构）
There have been several attempts to quantify the diagnostic distortion caused by algorithms that perform low-dimensional electrocardiogram (ECG) representation. However, there is no universally accepted quantitative measure that allows the diagnostic distortion arising from denoising, compression, and ECG beat representation algorithms to be determined. Hence, the main objective of this work was to develop a framework to enable biomedical engineers to efficiently and reliably assess diagnostic distortion resulting from ECG processing algorithms. We propose a semiautomatic framework for quantif…
MSW-Transformer: Multi-Scale Shifted Windows Transformer Networks for 12-Lead ECG Classification
Shantou University（汕头大学）；Sun Yet-sun University（中山大学）；The First Affiliated Hospital of Shantou University（汕头大学第一附属医院）；Shantou Institute of Ultrasonic Instruments Co., Ltd.（汕头超声仪器研究所有限公司）
National Taiwan University（国立台湾大学）；Academia Sinica（中央研究院）；National Taiwan University of Science and Technology（国立台湾科技大学）
Electrocardiogram (ECG) artifact contamination often occurs in surface electromyography (sEMG) applications when the measured muscles are in proximity to the heart. Previous studies have developed and proposed various methods, such as high-pass filtering, template subtraction and so forth. However, these methods remain limited by the requirement of reference signals and distortion of original sEMG. This study proposed a novel denoising method to eliminate ECG artifacts from the single-channel sEMG signals using fully convolutional networks (FCN). The proposed method adopts a denoise autoencode…
MSEMG: Surface Electromyography Denoising with a Mamba-based Efficient Network
National Yang Ming Chiao Tung University（国立阳明交通大学）；National Taiwan University（国立台湾大学）；University of Palermo（巴勒莫大学）；Academic Sinica（中央研究院）；Research Center for Information Technology Innovation（资讯科技创新研究中心）
Electrocardiography (ECG), an electrical measurement which captures cardiac activities, is the gold standard for diagnosing cardiovascular disease (CVD). However, ECG is infeasible for continuous cardiac monitoring due to its requirement for user participation. By contrast, photoplethysmography (PPG) provides easy-to-collect data, but its limited accuracy constrains its clinical usage. To combine the advantages of both signals, recent studies incorporate various deep learning techniques for the reconstruction of PPG signals to ECG; however, the lack of contextual information as well as the lim…
Due to the multiple imperfections during the signal acquisition, Electrocardiogram (ECG) datasets are typically contaminated with numerous types of noise, like salt and pepper and baseline drift. These datasets may contain different recordings with various types of noise [1] and thus, denoising may not be the easiest task. Furthermore, usually, the number of labeled bio-signals is very limited for a proper classification task.
Masked Transformer for Electrocardiogram Classification
Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences and Peking Union Medical College（中国医学科学院北京协和医学院国家心血管病中心阜外医院）
本文提出 MTECG 方法，将掩码自编码器应用于 ECG 时间序列的自监督表示学习，并在多个数据集上显著提升了分类的宏 F1 分数。
SDEMG: Score-based Diffusion Model for Surface Electromyographic Signal Denoising
National Yang Ming Chiao Tung University（国立阳明交通大学）；National Taiwan University（国立台湾大学）；National Taipei University of Technology（国立台北科技大学）；National Taiwan University of Science and Technology（国立台湾科技大学）；Academia Sinica（中央研究院）
Consciousness-ECG Transformer for Conscious State Estimation System with Real-Time Monitoring
Department of Brain and Cognitive Engineering, Korea University（韩国大学脑科学与认知工程系）；Department of Artificial Intelligence, Korea University（韩国大学人工智能系）；Department of Biomedical Informatics Medicine, Jeju National University（济州国立大学生物医学信息学医学系）
Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data
University of Illinois at Urbana Champaign（伊利诺伊大学厄巴纳-香槟分校）；Beckman Institute for Advanced Science and Technology（贝克曼高级科学技术研究院）；Worcester Polytechnic Institute（伍斯特理工学院）
Beyond Single-Channel: Multichannel Signal Imaging for PPG-to-ECG Reconstruction with Vision Transformers
Department of Computer Science, University of Toronto（多伦多大学计算机科学系）；Data Science Research Center, Duke Kunshan University（杜克昆山大学数据科学研究中心）；Data Science Lab, Fields Institute for Research in Mathematical Sciences（数学科学研究院数据科学实验室）；Department of Mathematics and Statistics, York University（约克大学数学与统计学系）
本文提出融合原始 PPG、一阶及二阶差分与曲线下面积的四通道信号图像表示，并以 ViT 建模心搏间和心搏内依赖，显著提升 PPG 到 ECG 的重建精度。
Deciphering Heartbeat Signatures: A Vision Transformer Approach to Explainable Atrial Fibrillation Detection from ECG Signals
Walkky（沃基公司）；Chobanian & Avedisian School of Medicine, Boston University（波士顿大学乔巴尼亚与阿夫迪西安医学院）；Clemson University（克莱姆森大学）；Northwell Health Physician Partners（诺斯韦尔健康医师伙伴）；Lenox Hill Hospital（莱诺克斯山医院）
Continuous long-term monitoring of electrocardiography (ECG) signals is crucial for the early detection of cardiac abnormalities such as arrhythmia. Non-clinical ECG recordings acquired by Holter and wearable ECG sensors often suffer from severe artifacts such as baseline wander, signal cuts, motion artifacts, variations on QRS amplitude, noise, and other interferences. Usually, a set of such artifacts occur on the same ECG signal with varying severity and duration, and this makes an accurate diagnosis by machines or medical doctors extremely difficult. Despite numerous studies that have attem…
Swiss Center for Electronics and Microtechnology (CSEM SA)（瑞士电子与微技术中心）
ECG heartbeat classification plays a vital role in diagnosis of cardiac arrhythmia. The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings in order to aid doctors in the diagnoses of different heart conditions. Transformers have had great success in the field of natural language processing in the past years. Our team, CinCSEM, proposes to draw the parallel between text and periodic time series signals by viewing the repeated period as words and the whole signal as a sequence of such words. In this way, the atten…
In order to exploit representations of time-series signals, such as physiological signals, it is essential that these representations capture relevant information from the whole signal. In this work, we propose to use a Transformer-based model to process electrocardiograms (ECG) for emotion recognition. Attention mechanisms of the Transformer can be used to build contextualized representations for a signal, giving more importance to relevant parts. These representations may then be processed with a fully-connected network to predict emotions. To overcome the relatively small size of datasets w…
The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院查尔斯·布朗夫曼个性化医学研究所）；Mount Sinai Clinical Intelligence Center, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院西奈山临床智能中心）；Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院遗传学与基因组科学系）；The Hasso Plattner Institute for Digital Health at Mount Sinai（西奈山哈索·普拉特纳数字健康研究所）；Department of Medicine, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院医学系）；Mount Sinai Heart, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院西奈山心脏中心）；Department of Cardiology, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院心脏病学系）；Department of Medicine, NYU Langone Health（纽约大学朗格尼健康中心医学系）；The Pamela Sklar Division of Psychiatric Genomics, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院帕梅拉·斯克拉精神病基因组学部门）；Department of Psychiatry, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院精神病学系）；Department of Biomedical Engineering, Tel Aviv University（特拉维夫大学生物医学工程系）；Division of Nephrology, Department of Medicine, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院医学系肾脏病科）
The electrocardiogram (ECG) is a ubiquitous diagnostic modality. Convolutional neural networks (CNNs) applied towards ECG analysis require large sample sizes, and transfer learning approaches result in suboptimal performance when pre-training is done on natural images. We leveraged masked image modeling to create the first vision-based transformer model, HeartBEiT, for electrocardiogram waveform analysis. We pre-trained this model on 8.5 million ECGs and then compared performance vs. standard CNN architectures for diagnosis of hypertrophic cardiomyopathy, low left ventricular ejection fraction…
