Self-supervised approaches for electroencephalography (EEG) representation learning face three specific challenges inherent to EEG data: (1) The low signal-to-noise ratio which challenges the quality of the representation learned, (2) The wide range of amplitudes from very small to relatively large due to factors such as the inter-subject variability, risks the models to be dominated by higher amplitude ranges, and (3) The absence of explicit segmentation in the continuous-valued sequences which can result in less informative representations. To address these challenges, we introduce \textit{EEG2Rep}, a self-prediction approach for self-supervised representation learning from EEG. Two core novel components of EEG2Rep are as follows: 1) Instead of learning to predict the masked input from raw EEG, EEG2Rep learns to predict masked input in latent representation space, and 2) Instead of conventional masking methods, EEG2Rep uses a new semantic subsequence preserving (SSP) method which provides informative masked inputs to guide EEG2Rep to generate rich semantic representations. In experiments on 6 diverse EEG tasks with subject variability, EEG2Rep significantly outperforms state-of-the-art methods. We show that our semantic subsequence preserving improves the existing masking methods in self-prediction literature and find that preserving 50\% of EEG recordings will result in the most accurate results on all 6 tasks on average. Finally, we show that EEG2Rep is robust to noise addressing a significant challenge that exists in EEG data. Models and code are available at:\url{https://github.com/Navidfoumani/EEG2Rep}
Self-supervised EEG Representation Learning for Automatic Sleep Staging
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Relativity(Relativity公司);Harvard Medical School(哈佛医学院);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心)
EEG Foundation Models: A Critical Review of Current Progress and Future Directions
Department of Computer Science & Engineering, University of Minnesota Twin Cities(计算机科学与工程系,明尼苏达大学双城分校);Department of Bioengineering, University of Illinois at Urbana-Champaign(生物工程系,伊利诺伊大学厄巴纳-香槟分校);Department of Neurology, Mayo Clinic(神经病学系,梅奥诊所);Department of Neurology, University of Minnesota Twin Cities(神经病学系,明尼苏达大学双城分校)
Parameter-Efficient Self-Supervised Adaptation for EEG-FM under Fixed Computational Budgets
University of Tübingen(蒂宾根大学);Hertie Institute for AI in Brain Health (Hertie AI)(赫蒂脑健康人工智能研究所);University Clinic Tübingen(蒂宾根大学医院);Hertie Institute for Clinical Brain Research(赫蒂临床脑研究所)
EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEG
Department of Artificial Intelligence in Healthcare, International Academia of Biomedical Innovation Technology(人工智能医疗系,国际生物医学创新技术学院);National Taiwan University(台湾大学);Neuro Industry Research, Neuro Industry, Inc.(神经产业研究,神经产业公司);Department of Biomedical Engineering, University of Southern California(生物医学工程系,南加州大学);Taiwan Artificial Intelligence Association(台湾人工智能协会)
NeuroNet: A Novel Hybrid Self-Supervised Learning Framework for Sleep Stage Classification Using Single-Channel EEG
Korea University(高丽大学);University of Cambridge(剑桥大学);Stanford University School of Medicine(斯坦福大学医学院);VA Palo Alto Health Care System(帕洛阿尔托退伍军人事务医疗系统);Korea University College of Medicine(高丽大学医学院)
Masked Autoencoders that Feel the Heart: Unveiling Simplicity Bias for ECG Analyses
State Key Laboratory of Digital Medical Engineering, Southeast University(数字医疗工程国家重点实验室,东南大学);School of Instrument Science and Engineering, Southeast University(仪器科学与工程学院,东南大学);School of Computer Science and Engineering, Southeast University(计算机科学与工程学院,东南大学)
EEG-JEPA: Structured Latent Prediction for EEG Foundation Models
Tsinghua Laboratory of Brain and Intelligence, Tsinghua University(清华大学脑与智能实验室);School of Basic Medical Sciences, Tsinghua Medicine, Tsinghua University(清华大学清华医学基础医学院);School of Biomedical Engineering, Tsinghua Medicine, Tsinghua University(清华大学清华医学生物医学工程学院);Academy for Advanced Interdisciplinary Studies, Peking University(北京大学前沿交叉学科研究院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California(明希斯电气与计算机工程系,南加州大学);Alfred E. Mann Department of Biomedical Engineering, University of Southern California(阿尔弗雷德·E·曼生物医学工程系,南加州大学);Thomas Lord Department of Computer Science, University of Southern California(托马斯·劳德计算机科学系,南加州大学)
A Proof-of-Concept Study of Weakly Supervised Labeling of Fine-Grained EEG Components for Artifact Attenuation
Institute for Applied Computer Science, University of the Bundeswehr Munich(慕尼黑联邦国防军大学应用计算机科学研究所);brainboost GmbH(brainboost 有限公司);Graduate School of Engineering Science, The University of Osaka(大阪大学工学研究科);Graduate School of Frontier Sciences, The University of Tokyo(东京大学新领域创成科学研究科)