Electroencephalography (EEG) foundation models aim to learn generalizable representations from large-scale brain recordings. However, the role of temporal feature extractors and whether pretrained time-series foundation models (TSFMs) can be effectively transferred to this setting remains underexplored. We conduct a controlled comparison of three temporal feature extraction strategies, including a linear baseline, a convolutional encoder, and a frozen pretrained TSFM (MOMENT), within a unified EEG foundation model. We evaluate their impact on representation quality using two downstream tasks: motor imagery and emotion recognition. Results reveal different trends across the evaluated benchmarks. On the motor imagery dataset, simple temporal representations perform competitively, whereas the emotion dataset benefits from richer temporal modeling. Although not specifically adapted to EEG, the pretrained TSFM serves as an effective temporal feature extractor, suggesting that general-purpose time-series representations can be transferred as frozen temporal feature extractors within EEG foundation models.
Are foundation models useful feature extractors for electroencephalography analysis?
Chair for AI in Healthcare and Medicine, Technical University of Munich(人工智能在医疗与健康中的研究所,慕尼黑技术大学);Department of Neurology, Technical University of Munich(神经病学系,慕尼黑技术大学);Center for Interdisciplinary Pain Medicine, Technical University of Munich(跨学科疼痛医学中心,慕尼黑技术大学);Munich Center for Machine Learning, Munich, Germany(慕尼黑机器学习中心,德国慕尼黑);Department of Computing, Imperial College London(计算系,伦敦帝国学院)
Fusing Pretrained ViTs with TCNet for Enhanced EEG Regression
University of Illinois at Urbana Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California, Santa Cruz(加州大学圣克鲁兹分校);Saint Francis Preparatory High School(圣弗朗西斯预备高中);Palo Alto High School(帕洛阿尔托高中)
Foundation Model Guided Dual-Branch Co-Adaptation for Source-Free EEG Decoding
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);College of Artifical Intelligence and Automation, Hohai University(河海大学人工智能与自动化学院);College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics(南京航空航天大学人工智能学院);Brainnetcome Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所脑网络中心);Information Systems Technology and Design, Singapore University of Technology and Design(新加坡科技设计大学信息系统技术与设计)
A Deep Generative Model for Resting-State EEG Synthesis and Transferable Representation Learning
Institute of Psychology, Eötvös Loránd University(埃斯特哈兹·洛朗大学心理学研究所);Doctoral School of Psychology, Eötvös Loránd University(埃斯特哈兹·洛朗大学心理学博士学院);Department of Behavioural and Cognitive Sciences, University of Luxembourg(卢森堡大学行为与认知科学系)
Parameter-Efficient Self-Supervised Adaptation for EEG-FM under Fixed Computational Budgets
University of Tübingen(蒂宾根大学);Hertie Institute for AI in Brain Health (Hertie AI)(赫蒂脑健康人工智能研究所);University Clinic Tübingen(蒂宾根大学医院);Hertie Institute for Clinical Brain Research(赫蒂临床脑研究所)
Pretrained Reversible Generation as Unsupervised Visual Representation Learning
Xi’an Jiaotong University(西安交通大学);Shanghai AI Laboratory(上海人工智能实验室);SenseTime(商汤科技);The Chinese University of Hong Kong(香港中文大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学)
NeuroStrata: An Electroencephalographic Connectivity-Aware Deep Representation Learning Framework for Dynamic Brain Network Analysis of Mental Stress
Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University(迪肯大学智能系统研究与创新研究所);Centre for Health Research, University of Southern Queensland(南昆士兰大学健康研究中心);School of Science, Engineering and Digital Technologies, University of Southern Queensland(南昆士兰大学科学、工程与数字技术学院)