Electrocardiogram (ECG) has been widely used for emotion recognition. This paper presents a deep neural network based on convolutional layers and a transformer mechanism to detect stress using ECG signals. We perform leave-one-subject-out experiments on two publicly available datasets, WESAD and SWELL-KW, to evaluate our method. Our experiments show that the proposed model achieves strong results, comparable or better than the state-of-the-art models for ECG-based stress detection on these two datasets. Moreover, our method is end-to-end, does not require handcrafted features, and can learn robust representations with only a few convolutional blocks and the transformer component.
MSW-Transformer: Multi-Scale Shifted Windows Transformer Networks for 12-Lead ECG Classification
Shantou University（汕头大学）；Sun Yet-sun University（中山大学）；The First Affiliated Hospital of Shantou University（汕头大学第一附属医院）；Shantou Institute of Ultrasonic Instruments Co., Ltd.（汕头超声仪器研究所有限公司）
Beyond Single-Channel: Multichannel Signal Imaging for PPG-to-ECG Reconstruction with Vision Transformers
Department of Computer Science, University of Toronto（多伦多大学计算机科学系）；Data Science Research Center, Duke Kunshan University（杜克昆山大学数据科学研究中心）；Data Science Lab, Fields Institute for Research in Mathematical Sciences（数学科学研究院数据科学实验室）；Department of Mathematics and Statistics, York University（约克大学数学与统计学系）
本文提出融合原始 PPG、一阶及二阶差分与曲线下面积的四通道信号图像表示，并以 ViT 建模心搏间和心搏内依赖，显著提升 PPG 到 ECG 的重建精度。
Swiss Center for Electronics and Microtechnology (CSEM SA)（瑞士电子与微技术中心）
ECG heartbeat classification plays a vital role in diagnosis of cardiac arrhythmia. The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings in order to aid doctors in the diagnoses of different heart conditions. Transformers have had great success in the field of natural language processing in the past years. Our team, CinCSEM, proposes to draw the parallel between text and periodic time series signals by viewing the repeated period as words and the whole signal as a sequence of such words. In this way, the atten…
ECGMamba: Towards Efficient ECG Classification with BiSSM
School of Automation Science and Engineering, South China University of Technology（华南理工大学自动化科学与工程学院）；Key Laboratory of Digital Medical Engineering of Hebei Province, College of Electronic and Information Engineering, Hebei University（河北大学电子与信息工程学院）；Zhujiang Hospital of Southern Medical University（南方医科大学珠江医院）；General Hospital of Southern Command（南部战区总医院）
University of Toronto（多伦多大学）；Stanford Cardiovascular Institute（斯坦福心血管研究所）
Deep learning provides an excellent avenue for optimizing diagnosis and patient monitoring for clinical-based applications, which can critically enhance the response time to the onset of various conditions. For cardiovascular disease, one such condition where the rising number of patients increasingly outweighs the availability of medical resources in different parts of the world, a core challenge is the automated classification of various cardiac abnormalities. Existing deep learning approaches have largely been limited to detecting the existence of an irregularity, as in binary classificatio…
Philips Research North America（飞利浦北美研究院）；University of Arizona Banner Health（亚利桑那大学班纳健康）
We present our entry to the 2021 PhysioNet/CinC challenge - a waveform transformer model to detect cardiac abnormalities from ECG recordings. We compare the performance of the waveform transformer model on different ECG-lead subsets using approximately 88,000 ECG recordings from six datasets. In the official rankings, team prna ranked between 9 and 15 on 12, 6, 4, 3 and 2-lead sets respectively. Our waveform transformer model achieved an average challenge metric of 0.47 on the held-out test set across all ECG-lead subsets. Our combined performance across all leads placed us at rank 11 out of 3…
ECG is an attractive option to assess stress in serious Virtual Reality (VR) applications due to its non-invasive nature. However, the existing Machine Learning (ML) models perform poorly. Moreover, existing studies only perform a binary stress assessment, while to develop a more engaging biofeedback-based application, multi-level assessment is necessary. Existing studies annotate and classify a single experience (e.g. watching a VR video) to a single stress level, which again prevents design of dynamic experiences where real-time in-game stress assessment can be utilized. In this paper, we re…
TransfoRhythm: A Transformer Architecture Conductive to Blood Pressure Estimation via Solo PPG Signal Capturing
Faculty of Computer Science（计算机科学学院）；Concordia Institute for Information Systems Engineering（康考迪亚信息系统工程学院）；University of New Brunswick（新不伦瑞克大学）；Concordia University（康考迪亚大学）
Bridging Performance Gaps for ECG Foundation Models: A Post-Training Strategy
Department of Information Center, Fuwai Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College（信息中心部门，阜外医院，中国医学科学院和北京协和医学院）；Function Test Center, Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences and Peking Union Medical College（功能测试中心，阜外医院，国家心血管疾病中心，中国医学科学院和北京协和医学院）；Cardiac Arrhythmia Center, Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences and Peking Union Medical College（心律失常中心，阜外医院，国家心血管疾病中心，中国医学科学院和北京协和医学院）；Center for Health Statistics and Information, National Health Commission People’s Republic of China（健康统计与信息中心，中华人民共和国国家卫生健康委员会）
The transformer based model (e.g., FusingTF) has been employed recently for Electrocardiogram (ECG) signal classification. However, the high-dimensional embedding obtained via 1-D convolution and positional encoding can lead to the loss of the signal's own temporal information and a large amount of training parameters. In this paper, we propose a new method for ECG classification, called low-dimensional denoising embedding transformer (LDTF), which contains two components, i.e., low-dimensional denoising embedding (LDE) and transformer learning. In the LDE component, a low-dimensional represen…
Electrocardiography (ECG), an electrical measurement which captures cardiac activities, is the gold standard for diagnosing cardiovascular disease (CVD). However, ECG is infeasible for continuous cardiac monitoring due to its requirement for user participation. By contrast, photoplethysmography (PPG) provides easy-to-collect data, but its limited accuracy constrains its clinical usage. To combine the advantages of both signals, recent studies incorporate various deep learning techniques for the reconstruction of PPG signals to ECG; however, the lack of contextual information as well as the lim…
School of Electrical Engineering and Robotics, Queensland University of Technology（昆士兰科技大学电气工程与机器人学院）；Centre for Accident Research & Road Safety Queensland, Queensland University of Technology（昆士兰科技大学昆士兰事故研究与道路安全中心）；School of Information Technology, Deakin University（迪肯大学信息技术学院）
Stress and driving are a dangerous combination which can lead to crashes, as evidenced by the large number of road traffic crashes that involve stress. Motivated by the need to address the significant costs of driver stress, it is essential to build a practical system that can classify driver stress level with high accuracy. However, the performance of an accurate driving stress levels classification system depends on hyperparameter optimization choices such as data segmentation (windowing hyperparameters). The configuration setting of hyperparameters, which has an enormous impact on the syste…
Masked Transformer for Electrocardiogram Classification
Fuwai Hospital, National Center for Cardiovascular Diseases, Chinese Academy of Medical Sciences and Peking Union Medical College（中国医学科学院北京协和医学院国家心血管病中心阜外医院）
本文提出 MTECG 方法，将掩码自编码器应用于 ECG 时间序列的自监督表示学习，并在多个数据集上显著提升了分类的宏 F1 分数。
Consciousness-ECG Transformer for Conscious State Estimation System with Real-Time Monitoring
Department of Brain and Cognitive Engineering, Korea University（韩国大学脑科学与认知工程系）；Department of Artificial Intelligence, Korea University（韩国大学人工智能系）；Department of Biomedical Informatics Medicine, Jeju National University（济州国立大学生物医学信息学医学系）
Cardiovascular diseases are the leading cause of death worldwide, accounting for 17.3 million deaths per year. The electrocardiogram (ECG) is a non-invasive technique widely used for the detection of cardiac diseases. To increase diagnostic sensitivity, ECG is acquired during exercise stress tests or in an ambulatory way. Under these acquisition conditions, the ECG is strongly affected by some types of noise, mainly by baseline wander (BLW). In this work were implemented nine methods widely used for the elimination of BLW, which are: interpolation using cubic splines, FIR filter, IIR filter, l…
In the pregnant mother and her fetus, chronic prenatal stress results in entrainment of the fetal heartbeat by the maternal heartbeat, quantified by the fetal stress index (FSI). Deep learning (DL) is capable of pattern detection in complex medical data with high accuracy in noisy real-life environments, but little is known about DL's utility in non-invasive biometric monitoring during pregnancy. A recently established self-supervised learning (SSL) approach to DL provides emotional recognition from electrocardiogram (ECG). We hypothesized that SSL will identify chronically stressed mother-fet…
Deciphering Heartbeat Signatures: A Vision Transformer Approach to Explainable Atrial Fibrillation Detection from ECG Signals
Walkky（沃基公司）；Chobanian & Avedisian School of Medicine, Boston University（波士顿大学乔巴尼亚与阿夫迪西安医学院）；Clemson University（克莱姆森大学）；Northwell Health Physician Partners（诺斯韦尔健康医师伙伴）；Lenox Hill Hospital（莱诺克斯山医院）
The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院查尔斯·布朗夫曼个性化医学研究所）；Mount Sinai Clinical Intelligence Center, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院西奈山临床智能中心）；Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院遗传学与基因组科学系）；The Hasso Plattner Institute for Digital Health at Mount Sinai（西奈山哈索·普拉特纳数字健康研究所）；Department of Medicine, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院医学系）；Mount Sinai Heart, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院西奈山心脏中心）；Department of Cardiology, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院心脏病学系）；Department of Medicine, NYU Langone Health（纽约大学朗格尼健康中心医学系）；The Pamela Sklar Division of Psychiatric Genomics, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院帕梅拉·斯克拉精神病基因组学部门）；Department of Psychiatry, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院精神病学系）；Department of Biomedical Engineering, Tel Aviv University（特拉维夫大学生物医学工程系）；Division of Nephrology, Department of Medicine, Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院医学系肾脏病科）
The electrocardiogram (ECG) is a ubiquitous diagnostic modality. Convolutional neural networks (CNNs) applied towards ECG analysis require large sample sizes, and transfer learning approaches result in suboptimal performance when pre-training is done on natural images. We leveraged masked image modeling to create the first vision-based transformer model, HeartBEiT, for electrocardiogram waveform analysis. We pre-trained this model on 8.5 million ECGs and then compared performance vs. standard CNN architectures for diagnosis of hypertrophic cardiomyopathy, low left ventricular ejection fraction…
In order to exploit representations of time-series signals, such as physiological signals, it is essential that these representations capture relevant information from the whole signal. In this work, we propose to use a Transformer-based model to process electrocardiograms (ECG) for emotion recognition. Attention mechanisms of the Transformer can be used to build contextualized representations for a signal, giving more importance to relevant parts. These representations may then be processed with a fully-connected network to predict emotions. To overcome the relatively small size of datasets w…
Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data
University of Illinois at Urbana Champaign（伊利诺伊大学厄巴纳-香槟分校）；Beckman Institute for Advanced Science and Technology（贝克曼高级科学技术研究院）；Worcester Polytechnic Institute（伍斯特理工学院）
According to the World Health Organization, around 36% of the annual deaths are associated with cardiovascular diseases and 90% of heart attacks are preventable. Electrocardiogram signal analysis in ambulatory electrocardiography, during an exercise stress test, and in resting conditions allows cardiovascular disease diagnosis. However, during the acquisition, there is a variety of noises that may damage the signal quality thereby compromising their diagnostic potential. The baseline wander is one of the most undesirable noises. In this work, we propose a novel algorithm for BLW noise filterin…
MEETI: A Multimodal ECG Dataset from MIMIC-IV-ECG with Signals, Images, Features and Interpretations
HeartVoice Medical Technology（HeartVoice医疗科技）；Saw Swee Hock School of Public Health and Institute of Data Science（Saw Swee Hock公共卫生学院和数据科学研究所）；National University of Singapore（新加坡国立大学）；Department of Cardiology, Peking University People’s Hospital（北京大学人民医院心内科）；College of Integrative Chinese and Western Medicine, Anhui University of Chinese Medicine（安徽中医药大学整合中西医学学院）；National Institute of Health Data Science, Peking University（北京大学国家健康数据科学研究院）；Institute for Artificial Intelligence, Peking University（北京大学人工智能研究院）
Multimodal wearable physiological data in daily life have been used to estimate self-reported stress labels. However, missing data modalities in data collection makes it challenging to leverage all the collected samples. Besides, heterogeneous sensor data and labels among individuals add challenges in building robust stress detection models. In this paper, we proposed a modality fusion network (MFN) to train models and infer self-reported binary stress labels under both complete and incomplete modality conditions. In addition, we applied personalized attention (PA) strategy to leverage persona…
Electromechanical Dynamics of the Heart: A Study of Cardiac Hysteresis During Physical Stress Test
School of Medicine, Emory University（埃默里大学医学院）；Department of Biomedical Engineering, Georgia Institute of Technology and Emory University（佐治亚理工学院与埃默里大学生物医学工程系）
