Data-Efficient Sleep Staging with Synthetic Time Series Pretraining
Department of Medical Engineering and Technomathematics, FH Aachen University of Applied Sciences(弗劳恩霍夫亚琛应用科学大学医学工程与技术数学系);Department of Information and Computing Sciences, Utrecht University(乌得勒支大学信息与计算科学系);Institute for Data-Driven Technologies, FH Aachen University of Applied Sciences(弗劳恩霍夫亚琛应用科学大学数据驱动技术研究所)
Niklas Grieger, Siamak Mehrkanoon, Stephan Bialonski
备注:
15 pages, 4 figures, 1 table
发表信息:
Grieger, N., Mehrkanoon, S., Bialonski, S. (2025). Data-Efficient Sleep Staging with Synthetic Time Series Pretraining. Algorithms, 18(9), 580
Analyzing electroencephalographic (EEG) time series can be challenging, especially with deep neural networks, due to the large variability among human subjects and often small datasets. To address these challenges, various strategies, such as self-supervised learning, have been suggested, but they typically rely on extensive empirical datasets. Inspired by recent advances in computer vision, we propose a pretraining task termed "frequency pretraining" to pretrain a neural network for sleep staging by predicting the frequency content of randomly generated synthetic time series. Our experiments demonstrate that our method surpasses fully supervised learning in scenarios with limited data and few subjects, and matches its performance in regimes with many subjects. Furthermore, our results underline the relevance of frequency information for sleep stage scoring, while also demonstrating that deep neural networks utilize information beyond frequencies to enhance sleep staging performance, which is consistent with previous research. We anticipate that our approach will be advantageous across a broad spectrum of applications where EEG data is limited or derived from a small number of subjects, including the domain of brain-computer interfaces.
Self-supervised Contrastive Learning for EEG-based Sleep Staging
Wuhan University(武汉大学)
EEG信号通常很容易获得,但标记起来很昂贵。虽然监督学习在脑电信号分析领域得到了广泛的应用,但其泛化性能受到标注数据量的限制。自监督学习(Self-supervised learning,SSL)作为计算机视觉(Computer Vision,CV)和自然语言处理(Natural Language Processing,NLP)领域的一种流行的学习范式,可以利用未标记的数据来弥补监督学习的数据不足。在本文中,我们提出了一个自我监督的对比学习方法的脑电信号的睡眠阶段分类。在训练过程中,我们为网络设置了一个任务,以匹配从脑电信号中产生的正确的变换对。通过这种方式,网络通过学习脑电信号的一般特征来提高表示能力。网络的鲁棒性也在处理不同的数据时得到了提高,即从变化的数据中提取恒定的特征。具体而言,网络的性能取决于转换的选择和自监督学习训练过程中使用的未标记数据量。在Sleep-edf数据集上的实验结果表明,该方法在睡眠分期上具有较好的性能(88.16%的准确率和81.96%的F1分数),并验证了SSL策略在有限标记数据制度下对EEG信号分析的有效性。所有代码都在网上公开提供。
Self-supervised EEG Representation Learning for Automatic Sleep Staging
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Relativity(Relativity公司);Harvard Medical School(哈佛医学院);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心)
Stanford Sleep Bench: Evaluating Polysomnography Pre-training Methods for Sleep Foundation Models
Stanford University(斯坦福大学);Technical University of Denmark(技术大学);Danish Center for Sleep Medicine(丹麦睡眠医学中心);University of Copenhagen(哥本哈根大学);Harvard Medical School(哈佛医学院)
Omni-Sleep: A Sleep Foundation Model via Hierarchical Contrastive Learning of CNS-ANS Dynamics
Department of Biomedical Engineering, Southern University of Science and Technology(南方科技大学生物医学工程系);Omni-Intelligence(全知智能);Shenzhen Loop Area Institute(深圳河套学院)
Sleep Staging from Airflow Signals Using Fourier Approximations of Persistence Curves
Khoury College of Computer Sciences, Northeastern University(东北大学Khoury计算机科学学院);Courant Institute of Mathematical Sciences, New York University(纽约大学柯朗数学科学研究所);Bouvé College of Health Sciences, Northeastern University(东北大学Bouvé健康科学学院)
Fully-automated sleep staging: multicenter validation of a generalizable deep neural network for Parkinson's disease and isolated REM sleep behavior disorder
Aarhus University(奥胡斯大学);Aarhus University Hospital(奥胡斯大学医院);Lundbeck Foundation Parkinson’s Disease Research Center (PACE)(伦德贝克基金会帕金森病研究中心(PACE));University of Cologne(科隆大学);University Hospital Cologne(科隆大学医院);Institute for Biomedical Informatics, Faculty of Medicine and University Hospital Cologne(科隆大学医学院暨科隆大学医院生物医学信息学研究所);Center for Molecular Medicine Cologne (CMMC), Faculty of Medicine and University Hospital Cologne(科隆大学医学院暨科隆大学医院科隆分子医学中心(CMMC));Research Center Juelich(于利希研究中心);University of Bonn(波恩大学);University Hospital Bonn(波恩大学医院);German Center for Neurodegenerative Diseases (DZNE)(德国神经退行性疾病中心(DZNE));Glostrup University Hospital(格洛斯楚普大学医院);Danish Center for Sleep Medicine(丹麦睡眠医学中心)
PSG-MAE: Robust Multitask Sleep Event Monitoring using Multichannel PSG Reconstruction and Inter-channel Contrastive Learning
School of Future Technology, South China University of Technology(华南理工大学未来技术学院);Guangzhou First People’s Hospital(广州市第一人民医院);School of Medicine, South China University of Technology(华南理工大学医学院)
A Context-Aware Temporal Modeling through Unified Multi-Scale Temporal Encoding and Hierarchical Sequence Learning for Single-Channel EEG Sleep Staging
SleepPPG-Net: a deep learning algorithm for robust sleep staging from continuous photoplethysmography
Technion-Israel Institute of Technology(以色列理工学院);University of Cambridge(剑桥大学);University of London(伦敦大学);Mines ParisTech - PSL University(巴黎国立高等矿业学校-巴黎文理研究大学)
Zhejiang University(浙江大学);Affiliated Mental Health Center & Hangzhou Seventh People’s Hospital, Zhejiang University School of Medicine(浙江大学医学院附属精神卫生中心&杭州市第七人民医院);The First Affiliated Hospital, College of Medicine, Zhejiang University(浙江大学医学院附属第一医院)
SleepPPG-Net2: Deep learning generalization for sleep staging from photoplethysmography
The Faculty of Data and Decision Sciences, Technion, Israel Institute of Technology(以色列理工学院数据与决策科学学院);Faculty of Biomedical Engineering, Technion, Israel Institute of Technology(以色列理工学院生物医学工程学院)
Rethinking Random Transformers as Adaptive Sequence Smoothers for Sleep Staging
School of Biological Science and Medical Engineering(生物科学与医学工程学院);Southeast University(东南大学);University of Bath(巴斯大学);Donders Institute for Brain, Cognition and Behaviour(脑、认知与行为研究所);Radboud University Medical Center(拉德堡德大学医学中心);School of Computer Science & Software Engineering(计算机科学与软件工程学院)
Dreem Open Datasets: Multi-Scored Sleep Datasets to compare Human and Automated sleep staging
Dreem(Dreem公司);Stanford University(斯坦福大学);French Armed Forces Biomedical Research Institute (IRBA)(法国武装部队生物医学研究所(IRBA));Paris Descartes University(巴黎笛卡尔大学)
Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning
Queen Mary University of London(伦敦玛丽女王大学);Singapore Institute of Technology(新加坡理工学院);University of Oxford(牛津大学);Peking University(北京大学);University of Lübeck(吕贝克大学);KU Leuven(鲁汶大学)
SleepBand: Single-Source Domain Generalization for Sleep Staging via Physiologically Structured Spectral Modeling
Laboratory of Intelligent Collaborative Computing, University of Electronic Science and Technology of China(电子科技大学智能协同计算实验室);School of Information Science and Technology, University of Science and Technology of China(中国科学技术大学信息科学学院);School of Cyber Science and Technology, University of Science and Technology of China(中国科学技术大学网络科学与技术学院)
ST-USleepNet: A Spatial-Temporal Coupling Prominence Network for Multi-Channel Sleep Staging
Saw Swee Hock School of Public Health, National University of Singapore(新加坡国立大学公共健康学院);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究所);Beijing Key Laboratory of Brainnetome and Brain-Computer Interface, Institute of Automation, Chinese Academy of Sciences(北京脑网膜与脑机接口重点实验室,中国科学院自动化研究所);Brainnetome Center, Institute of Automation, Chinese Academy of Sciences(脑网膜中心,中国科学院自动化研究所)
SleepGMUformer: A gated multimodal temporal neural network for sleep staging
College of Computer Science and Technology, Qingdao University(青岛大学计算机科学与技术学院);School of Information Science and Engineering, University of Jinan(济南大学信息科学与工程学院);School of Computing and Mathematical Sciences, University of Leicester(莱斯特大学计算与数学科学学院)
From Sleep Staging to Spindle Detection: A Case Study on End-to-End Automated Sleep Analysis
Department of Medical Engineering and Technomathematics, FH Aachen University of Applied Sciences(医学工程与技术数学系,亚琛应用科学大学);Department of Information and Computing Sciences, Utrecht University(信息与计算科学系,乌得勒支大学);Institute for Data-Driven Technologies, FH Aachen University of Applied Sciences(数据驱动技术研究所,亚琛应用科学大学);Department of Psychiatry and Psychotherapy, University Hospital Carl Gustav Carus, Technische Universität Dresden(精神病学与心理治疗系,卡尔·古斯塔夫·卡尔斯大学医院,德累斯顿技术大学)
University of Eastern Finland(东芬兰大学);Kuopio University Hospital(库奥皮奥大学医院);The University of Queensland(昆士兰大学);Reykjavik University(雷克雅未克大学);Landspitali–The National University Hospital of Iceland(冰岛国立大学医院);Princess Alexandra Hospital(亚历山德拉公主医院)