Sleep is crucial for human health, and EEG signals play a significant role in sleep research. Due to the high-dimensional nature of EEG signal data sequences, data visualization and clustering of different sleep stages have been challenges. To address these issues, we propose a two-stage hierarchical and explainable feature selection framework by incorporating a feature selection algorithm to improve the performance of dimensionality reduction. Inspired by topological data analysis, which can analyze the structure of high-dimensional data, we extract topological features from the EEG signals to compensate for the structural information loss that happens in traditional spectro-temporal data analysis. Supported by the topological visualization of the data from different sleep stages and the classification results, the proposed features are proven to be effective supplements to traditional features. Finally, we compare the performances of three dimensionality reduction algorithms: Principal Component Analysis (PCA), t-Distributed Stochastic Neighbor Embedding (t-SNE), and Uniform Manifold Approximation and Projection (UMAP). Among them, t-SNE achieved the highest accuracy of 79.8%, but considering the overall performance in terms of computational resources and metrics, UMAP is the optimal choice.
University of Moratuwa（莫拉图瓦大学）；Harvard University（哈佛大学）；Aarhus University（奥胡斯大学）；Florida International University（佛罗里达国际大学）
Sleep plays a crucial role in the well-being of human lives. Traditional sleep studies using Polysomnography are associated with discomfort and often lower sleep quality caused by the acquisition setup. Previous works have focused on developing less obtrusive methods to conduct high-quality sleep studies, and ear-EEG is among popular alternatives. However, the performance of sleep staging based on ear-EEG is still inferior to scalp-EEG based sleep staging. In order to address the performance gap between scalp-EEG and ear-EEG based sleep staging, we propose a cross-modal knowledge distillation …
Modern deep learning holds a great potential to transform clinical practice on human sleep. Teaching a machine to carry out routine tasks would be a tremendous reduction in workload for clinicians. Sleep staging, a fundamental step in sleep practice, is a suitable task for this and will be the focus in this article. Recently, automatic sleep staging systems have been trained to mimic manual scoring, leading to similar performance to human sleep experts, at least on scoring of healthy subjects. Despite tremendous progress, we have not seen automatic sleep scoring adopted widely in clinical envi…
Technion-Israel Institute of Technology（以色列理工学院）；University of Cambridge（剑桥大学）；University of London（伦敦大学）；Mines ParisTech - PSL University（巴黎国立高等矿业学校-巴黎文理研究大学）
Introduction: Sleep staging is an essential component in the diagnosis of sleep disorders and management of sleep health. It is traditionally measured in a clinical setting and requires a labor-intensive labeling process. We hypothesize that it is possible to perform robust 4-class sleep staging using the raw photoplethysmography (PPG) time series and modern advances in deep learning (DL). Methods: We used two publicly available sleep databases that included raw PPG recordings, totalling 2,374 patients and 23,055 hours. We developed SleepPPG-Net, a DL model for 4-class sleep staging from the r…
Georgia Institute of Technology（佐治亚理工学院）；IQVIA（艾昆纬）；Massachusetts General Hospital（马萨诸塞州综合医院）
Sleep staging is a crucial task for diagnosing sleep disorders. It is tedious and complex as it can take a trained expert several hours to annotate just one patient's polysomnogram (PSG) from a single night. Although deep learning models have demonstrated state-of-the-art performance in automating sleep staging, interpretability which defines other desiderata, has largely remained unexplored. In this study, we propose Sleep staging via Prototypes from Expert Rules (SLEEPER), which combines deep learning models with expert defined rules using a prototype learning framework to generate simple in…
Sleep staging is fundamental for sleep assessment and disease diagnosis. Although previous attempts to classify sleep stages have achieved high classification performance, several challenges remain open: 1) How to effectively extract salient waves in multimodal sleep data; 2) How to capture the multi-scale transition rules among sleep stages; 3) How to adaptively seize the key role of specific modality for sleep staging. To address these challenges, we propose SalientSleepNet, a multimodal salient wave detection network for sleep staging. Specifically, SalientSleepNet is a temporal fully convo…
Sleep staging based on electroencephalogram (EEG) plays an important role in the clinical diagnosis and treatment of sleep disorders. In order to emancipate human experts from heavy labeling work, deep neural networks have been employed to formulate automated sleep staging systems recently. However, EEG signals lose considerable detailed information in network propagation, which affects the representation of deep features. To address this problem, we propose a new framework, called MRNet, for data-driven sleep staging by integrating a multi-scale feature fusion model and a Markov-based sequent…
An electroencephalogram (EEG) signal is currently accepted as a standard for automatic sleep staging. Lately, Near-human accuracy in automated sleep staging has been achievable by Deep Learning (DL) based approaches, enabling multi-fold progress in this area. However, An extensive and expensive clinical setup is required for EEG based sleep staging. Additionally, the EEG setup being obtrusive in nature and requiring an expert for setup adds to the inconvenience of the subject under study, making it adverse in the point of care setting. An unobtrusive and more suitable alternative to EEG is Ele…
SleepPPG-Net2: Deep learning generalization for sleep staging from photoplethysmography
The Faculty of Data and Decision Sciences, Technion, Israel Institute of Technology（以色列理工学院数据与决策科学学院）；Faculty of Biomedical Engineering, Technion, Israel Institute of Technology（以色列理工学院生物医学工程学院）
North China University of Technology（北方工业大学）；Kailuan General Hospital（开滦总医院）；Sun Yat-sen University（中山大学）
Sleep staging plays an important role on the diagnosis of sleep disorders. In general, experts classify sleep stages manually based on polysomnography (PSG), which is quite time-consuming. Meanwhile, the acquisition process of multiple signals is much complex, which can affect the subject's sleep. Therefore, the use of single-channel electroencephalogram (EEG) for automatic sleep staging has become a popular research topic. In the literature, a large number of sleep staging methods based on single-channel EEG have been proposed with promising results and achieve the preliminary automation of s…
Bangladesh University of Engineering and Technology（孟加拉国工程技术大学）
Humans approximately spend a third of their life sleeping, which makes monitoring sleep an integral part of well-being. In this paper, a 34-layer deep residual ConvNet architecture for end-to-end sleep staging is proposed. The network takes raw single channel electroencephalogram (Fpz-Cz) signal as input and yields hypnogram annotations for each 30s segments as output. Experiments are carried out for two different scoring standards (5 and 6 stage classification) on the expanded PhysioNet Sleep-EDF dataset, which contains multi-source data from hospital and household polysomnography setups. The…
We present the first real-time sleep staging system that uses deep learning without the need for servers in a smartphone application for a wearable EEG. We employ real-time adaptation of a single channel Electroencephalography (EEG) to infer from a Time-Distributed 1-D Deep Convolutional Neural Network. Polysomnography (PSG)-the gold standard for sleep staging, requires a human scorer and is both complex and resource-intensive. Our work demonstrates an end-to-end on-smartphone pipeline that can infer sleep stages in just single 30-second epochs, with an overall accuracy of 83.5% on 20-fold cro…
University of Minnesota（明尼苏达大学）；Nanyang Technological University（南洋理工大学）；Fairview Health（费尔维尤医疗）
Sleep plays a vital role in human health, both mental and physical. Sleep disorders like sleep apnea are increasing in prevalence, with the rapid increase in factors like obesity. Sleep apnea is most commonly treated with Continuous Positive Air Pressure (CPAP) therapy. Presently, however, there is no mechanism to monitor a patient's progress with CPAP. Accurate detection of sleep stages from CPAP flow signal is crucial for such a mechanism. We propose, for the first time, an automated sleep staging model based only on the flow signal. Deep neural networks have recently shown high accuracy on …
Queen Mary University of London（伦敦玛丽女王大学）；Singapore Institute of Technology（新加坡理工学院）；University of Oxford（牛津大学）；Peking University（北京大学）；University of Lübeck（吕贝克大学）；KU Leuven（鲁汶大学）
Background: Despite recent significant progress in the development of automatic sleep staging methods, building a good model still remains a big challenge for sleep studies with a small cohort due to the data-variability and data-inefficiency issues. This work presents a deep transfer learning approach to overcome these issues and enable transferring knowledge from a large dataset to a small cohort for automatic sleep staging. Methods: We start from a generic end-to-end deep learning framework for sequence-to-sequence sleep staging and derive two networks as the means for transfer learning. Th…
Sleep staging is essential for sleep assessment and plays a vital role as a health indicator. Many recent studies have devised various machine learning as well as deep learning architectures for sleep staging. However, two key challenges hinder the practical use of these architectures: effectively capturing salient waveforms in sleep signals and correctly classifying confusing stages in transitioning epochs. In this study, we propose a novel deep neural network structure, TransSleep, that captures distinctive local temporal patterns and distinguishes confusing stages using two auxiliary tasks.…
The rapidly-advancing technology of deep learning (DL) into the world of the Internet of Things (IoT) has not fully entered in the fields of m-Health yet. Among the main reasons are the high computational demands of DL algorithms and the inherent resource-limitation of wearable devices. In this paper, we present initial results for two deep learning architectures used to diagnose and analyze sleep patterns, and we compare them with a previously presented hand-crafted algorithm. The algorithms are designed to be reliable for consumer healthcare applications and to be integrated into low-power w…
Queen Mary University of London（伦敦玛丽女王大学）；University of Oxford（牛津大学）；University of Lübeck（吕贝克大学）；KU Leuven（鲁汶大学）
Automating sleep staging is vital to scale up sleep assessment and diagnosis to serve millions experiencing sleep deprivation and disorders and enable longitudinal sleep monitoring in home environments. Learning from raw polysomnography signals and their derived time-frequency image representations has been prevalent. However, learning from multi-view inputs (e.g., both the raw signals and the time-frequency images) for sleep staging is difficult and not well understood. This work proposes a sequence-to-sequence sleep staging model, XSleepNet, that is capable of learning a joint representation…
In this paper, we propose a novel method and a practical approach to predicting early onsets of sleep syndromes, including restless leg syndrome, insomnia, based on an algorithm that is comprised of two modules. A Fast Fourier Transform is applied to 30 seconds long epochs of EEG recordings to provide localized time-frequency information, and a deep convolutional LSTM neural network is trained for sleep stage classification. Automating sleep stages detection from EEG data offers great potential to tackling sleep irregularities on a daily basis. Thereby, a novel approach for sleep stage classif…
Queen Mary University of London（伦敦玛丽女王大学）；Alan Turing Institute（艾伦·图灵研究所）；University of Lübeck（吕贝克大学）；German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心）；University of Adelaide（阿德莱德大学）
Background: Despite the tremendous progress recently made towards automatic sleep staging in adults, it is currently unknown if the most advanced algorithms generalize to the pediatric population, which displays distinctive characteristics in overnight polysomnography (PSG). Methods: To answer the question, in this work, we conduct a large-scale comparative study on the state-of-the-art deep learning methods for pediatric automatic sleep staging. Six different deep neural networks with diverging features are adopted to evaluate a sample of more than 1,200 children across a wide spectrum of obs…
The accuracy of recent deep learning based clinical decision support systems is promising. However, lack of model interpretability remains an obstacle to widespread adoption of artificial intelligence in healthcare. Using sleep as a case study, we propose a generalizable method to combine clinical interpretability with high accuracy derived from black-box deep learning. Clinician-determined sleep stages from polysomnogram (PSG) remain the gold standard for evaluating sleep quality. However, PSG manual annotation by experts is expensive and time-prohibitive. We propose SERF, interpretable Sleep…
Sharif University of Technology（谢里夫理工大学）；Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）；Georgia Institute of Technology（佐治亚理工学院）；Emory School of Medicine（埃默里大学医学院）
The classification of sleep stages plays a crucial role in understanding and diagnosing sleep pathophysiology. Sleep stage scoring relies heavily on visual inspection by an expert that is time consuming and subjective procedure. Recently, deep learning neural network approaches have been leveraged to develop a generalized automated sleep staging and account for shifts in distributions that may be caused by inherent inter/intra-subject variability, heterogeneity across datasets, and different recording environments. However, these networks ignore the connections among brain regions, and disrega…
Queen Mary University of London（伦敦玛丽女王大学）；Alan Turing Institute（艾伦·图灵研究所）；Aarhus University（奥胡斯大学）；University of Bristol（布里斯托大学）；University of Lübeck（吕贝克大学）；German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心（DFKI））；KU Leuven（鲁汶大学）
Background: Black-box skepticism is one of the main hindrances impeding deep-learning-based automatic sleep scoring from being used in clinical environments. Methods: Towards interpretability, this work proposes a sequence-to-sequence sleep-staging model, namely SleepTransformer. It is based on the transformer backbone and offers interpretability of the model's decisions at both the epoch and sequence level. We further propose a simple yet efficient method to quantify uncertainty in the model's decisions. The method, which is based on entropy, can serve as a metric for deferring low-confidence…
Georgia Institute of Technology（佐治亚理工学院）；Nanyang Technological University（南洋理工大学）；Massachusetts General Hospital（麻省总医院）
Sleep disorders, such as sleep apnea, parasomnias, and hypersomnia, affect 50-70 million adults in the United States (Hillman et al., 2006). Overnight polysomnography (PSG), including brain monitoring using electroencephalography (EEG), is a central component of the diagnostic evaluation for sleep disorders. While PSG is conventionally performed by trained technologists, the recent rise of powerful neural network learning algorithms combined with large physiological datasets offers the possibility of automation, potentially making expert-level sleep analysis more widely available. We propose S…
From Sleep Staging to Spindle Detection: A Case Study on End-to-End Automated Sleep Analysis
Department of Medical Engineering and Technomathematics, FH Aachen University of Applied Sciences（医学工程与技术数学系，亚琛应用科学大学）；Department of Information and Computing Sciences, Utrecht University（信息与计算科学系，乌得勒支大学）；Institute for Data-Driven Technologies, FH Aachen University of Applied Sciences（数据驱动技术研究所，亚琛应用科学大学）；Department of Psychiatry and Psychotherapy, University Hospital Carl Gustav Carus, Technische Universität Dresden（精神病学与心理治疗系，卡尔·古斯塔夫·卡尔斯大学医院，德累斯顿技术大学）
Sleep Staging from Airflow Signals Using Fourier Approximations of Persistence Curves
Khoury College of Computer Sciences, Northeastern University（东北大学Khoury计算机科学学院）；Courant Institute of Mathematical Sciences, New York University（纽约大学柯朗数学科学研究所）；Bouvé College of Health Sciences, Northeastern University（东北大学Bouvé健康科学学院）
Sleep disorder diagnosis relies on the analysis of polysomnography (PSG) records. As a preliminary step of this examination, sleep stages are systematically determined. In practice, sleep stage classification relies on the visual inspection of 30-second epochs of polysomnography signals. Numerous automatic approaches have been developed to replace this tedious and expensive task. Although these methods demonstrated better performance than human sleep experts on specific datasets, they remain largely unused in sleep clinics. The main reason is that each sleep clinic uses a specific PSG montage …
Recent advances in deep learning have led to the development of models approaching the human level of accuracy. However, healthcare remains an area lacking in widespread adoption. The safety-critical nature of healthcare results in a natural reticence to put these black-box deep learning models into practice. This paper explores interpretable methods for a clinical decision support system called sleep staging, an essential step in diagnosing sleep disorders. Clinical sleep staging is an arduous process requiring manual annotation for each 30s of sleep using physiological signals such as electr…
Beijing Jiaotong University（北京交通大学）；Beijing Key Laboratory of Traffic Data Analysis and Mining（交通数据分析与挖掘北京市重点实验室）
The objective of this paper is to learn semantic representations for sleep stage classification from raw physiological time series. Although supervised methods have gained remarkable performance, they are limited in clinical situations due to the requirement of fully labeled data. Self-supervised learning (SSL) based on contrasting semantically similar (positive) and dissimilar (negative) pairs of samples have achieved promising success. However, existing SSL methods suffer the problem that many semantically similar positives are still uncovered and even treated as negatives. In this paper, we…
L-SeqSleepNet: Whole-cycle Long Sequence Modelling for Automatic Sleep Staging
Amazon Alexa（亚马逊Alexa）；Aarhus University（奥胡斯大学）；KU Leuven（荷语鲁汶大学）；Lausanne University Hospital (CHUV)（洛桑大学医院）；University of Lausanne（洛桑大学）；University of Oxford（牛津大学）；University of Lübeck（吕贝克大学）；German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心）；The University of Adelaide（阿德莱德大学）；Queen Mary University of London（伦敦玛丽女王大学）；Alan Turing Institute（艾伦·图灵研究所）
Osaka University（大阪大学）；Nara Institute of Science and Technology（奈良先端科学技术大学院大学）；Fudan University（复旦大学）；Waseda University（早稻田大学）
This paper proposes a novel framework for automatically capturing the time-frequency nature of electroencephalogram (EEG) signals of human sleep based on the authoritative sleep medicine guidance. The framework consists of two parts: the first part extracts informative features by partitioning the input EEG spectrograms into a sequence of time-frequency patches. The second part is constituted by an attention-based architecture to efficiently search for the correlation between partitioned time-frequency patches and defining factors of sleep stages in parallel. The proposed pipeline is validated…
Zhejiang University（浙江大学）；Affiliated Mental Health Center & Hangzhou Seventh People’s Hospital, Zhejiang University School of Medicine（浙江大学医学院附属精神卫生中心&杭州市第七人民医院）；The First Affiliated Hospital, College of Medicine, Zhejiang University（浙江大学医学院附属第一医院）
Attentive Dilated Convolution for Automatic Sleep Staging using Force-directed Layout
Department of Electrical and Electronic Engineering, BRAC University（BRAC大学电气与电子工程系）；Department of Biomedical Engineering, Linköping University（林雪平大学生物医学工程系）；Department of Electrical and Computer Engineering, Texas A&M University（德克萨斯农工大学电气与计算机工程系）
Rethinking Random Transformers as Adaptive Sequence Smoothers for Sleep Staging
School of Biological Science and Medical Engineering（生物科学与医学工程学院）；Southeast University（东南大学）；University of Bath（巴斯大学）；Donders Institute for Brain, Cognition and Behaviour（脑、认知与行为研究所）；Radboud University Medical Center（拉德堡德大学医学中心）；School of Computer Science & Software Engineering（计算机科学与软件工程学院）
University of Oxford（牛津大学）；Oxford University Hospitals（牛津大学医院）
Evidence suggests Rapid-Eye-Movement (REM) Sleep Behaviour Disorder (RBD) is an early predictor of Parkinson's disease. This study proposes a fully-automated framework for RBD detection consisting of automated sleep staging followed by RBD identification. Analysis was assessed using a limited polysomnography montage from 53 participants with RBD and 53 age-matched healthy controls. Sleep stage classification was achieved using a Random Forest (RF) classifier and 156 features extracted from electroencephalogram (EEG), electrooculogram (EOG) and electromyogram (EMG) channels. For RBD detection, …
A Context-Aware Temporal Modeling through Unified Multi-Scale Temporal Encoding and Hierarchical Sequence Learning for Single-Channel EEG Sleep Staging
Dreem（Dreem公司）；Stanford University（斯坦福大学）；French Armed Forces Biomedical Research Institute (IRBA)（法国武装部队生物医学研究所（IRBA））；Paris Descartes University（巴黎笛卡尔大学）
Sleep stage classification constitutes an important element of sleep disorder diagnosis. It relies on the visual inspection of polysomnography records by trained sleep technologists. Automated approaches have been designed to alleviate this resource-intensive task. However, such approaches are usually compared to a single human scorer annotation despite an inter-rater agreement of about 85 % only. The present study introduces two publicly-available datasets, DOD-H including 25 healthy volunteers and DOD-O including 55 patients suffering from obstructive sleep apnea (OSA). Both datasets have be…
A Deep Generative Model for Five-Class Sleep Staging with Arbitrary Sensor Input
Eindhoven University of Technology（埃因霍温理工大学）；Philips Sleep and Respiratory Care（飞利浦睡眠与呼吸护理部门）；Sleep Medicine Centre Kempenhaeghe（基姆彭海格睡眠医学中心）；Ulm University（乌尔姆大学）
In this work we describe a new deep learning approach for automatic sleep staging, and carry out its validation by addressing its generalization capabilities on a wide range of sleep staging databases. Prediction capabilities are evaluated in the context of independent local and external generalization scenarios. Effectively, by comparing both procedures it is possible to better extrapolate the expected performance of the method on the general reference task of sleep staging, regardless of data from a specific database. In addition, we examine the suitability of a novel approach based on the u…
SleepBand: Single-Source Domain Generalization for Sleep Staging via Physiologically Structured Spectral Modeling
Laboratory of Intelligent Collaborative Computing, University of Electronic Science and Technology of China（电子科技大学智能协同计算实验室）；School of Information Science and Technology, University of Science and Technology of China（中国科学技术大学信息科学学院）；School of Cyber Science and Technology, University of Science and Technology of China（中国科学技术大学网络科学与技术学院）
ST-USleepNet: A Spatial-Temporal Coupling Prominence Network for Multi-Channel Sleep Staging
Saw Swee Hock School of Public Health, National University of Singapore（新加坡国立大学公共健康学院）；Institute of Data Science, National University of Singapore（新加坡国立大学数据科学研究所）；Beijing Key Laboratory of Brainnetome and Brain-Computer Interface, Institute of Automation, Chinese Academy of Sciences（北京脑网膜与脑机接口重点实验室，中国科学院自动化研究所）；Brainnetome Center, Institute of Automation, Chinese Academy of Sciences（脑网膜中心，中国科学院自动化研究所）
Queen Mary University of London（伦敦玛丽女王大学）；Aarhus University（奥胡斯大学）；University of Oxford（牛津大学）；University of Lübeck（吕贝克大学）；KU Leuven（鲁汶大学）
Brain waves vary between people. An obvious way to improve automatic sleep staging for longitudinal sleep monitoring is personalization of algorithms based on individual characteristics extracted from the first night of data. As a single night is a very small amount of data to train a sleep staging model, we propose a Kullback-Leibler (KL) divergence regularized transfer learning approach to address this problem. We employ the pretrained SeqSleepNet (i.e. the subject independent model) as a starting point and finetune it with the single-night personalization data to derive the personalized mod…
SleepGMUformer: A gated multimodal temporal neural network for sleep staging
College of Computer Science and Technology, Qingdao University（青岛大学计算机科学与技术学院）；School of Information Science and Engineering, University of Jinan（济南大学信息科学与工程学院）；School of Computing and Mathematical Sciences, University of Leicester（莱斯特大学计算与数学科学学院）
University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Relativity（Relativity公司）；Harvard Medical School（哈佛医学院）；Beth Israel Deaconess Medical Center（贝斯以色列女执事医疗中心）
Background: Deep learning models have shown great success in automating tasks in sleep medicine by learning from carefully annotated Electroencephalogram (EEG) data. However, effectively utilizing a large amount of raw EEG remains a challenge. Objective: In this paper, we aim to learn robust vector representations from massive unlabeled EEG signals, such that the learned vectorized features (1) are expressive enough to replace the raw signals in the sleep staging task; and (2) provide better predictive performance than supervised models in scenarios of fewer labels and noisy samples. Methods: …
