arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.03269q-bio.NC
收藏

基于脑网络表示的自监督基础模型系统综述:使用脑电图

Systematic review of self-supervised foundation models for brain network representation using electroencephalography

Translational Research Center, University Hospital of Psychiatry and Psychotherapy, University of Bern(伯尔尼大学精神病学与心理治疗大学医院转化研究中心)

Hannah Portmann, Yosuke Morishima

AI总结:

本文综述了基于脑电图的自监督基础模型,探讨了其预训练方法、模型架构及下游任务应用,指出需更多多样化数据和标准化评估以提升模型通用性。

摘要:

近年来,自动分析脑电图(EEG)经历了一次范式转变。变压器架构和自监督预训练(SSL)的引入导致了EEG基础模型的发展。这些模型在大量未标记数据上进行预训练,可以适应各种下游任务。本系统综述总结了最近通过多通道EEG学习全脑表示的SSL训练EEG基础模型,而不是从单个通道导出的表示。我们通过2025年7月21日搜索了PubMed、IEEE Xplore、Scopus和arXiv。十九篇预印本和同行评审文章符合纳入标准。我们提取了有关预训练数据集、模型架构、预训练SSL目标和下游任务应用的信息。尽管预训练数据严重依赖Temple University EEG数据集,但各研究在模型架构和训练目标上存在显著异质性。变压器架构被识别为最主要的预训练架构,状态空间模型如MAMBA和S4作为新兴替代方案。关于SSL目标,掩码自动编码最为常见,其他研究采用对比学习。下游任务差异很大,实施了多样的微调策略,这使得直接比较具有挑战性。此外,大多数研究使用单任务微调,通用的EEG基础模型仍然缺乏。总之,该领域发展迅速,但仍受到数据集多样性和缺乏标准化基准的限制。进步可能依赖于更大更多样化的预训练数据集、标准化评估协议和多任务验证。发展将使EEG基础模型朝着稳健且通用的相关于基础和临床应用的方向前进。

英文摘要:

Automated analysis of electroencephalography (EEG) has recently undergone a paradigm shift. The introduction of transformer architectures and self-supervised pretraining (SSL) has led to the development of EEG foundation models. These models are pretrained on large amounts of unlabeled data and can be adapted to a range of downstream tasks. This systematic review summarizes recent SSL-trained EEG foundation models that learn whole-brain representations from multichannel EEG rather than representations derived from a single channel. We searched PubMed, IEEE Xplore, Scopus, and arXiv through July 21, 2025. Nineteen preprints and peer-reviewed articles met inclusion criteria. We extracted information regarding pretraining datasets, model architectures, pretraining SSL objectives, and downstream task applications. While pretraining data heavily relied on the Temple University EEG corpus, there was significant heterogeneity in model architecture and training objectives across studies. Transformer architectures were identified as the predominant pretraining architecture with state-space models such as MAMBA and S4 as emerging alternatives. Concerning SSL objectives, masked auto-encoding was most common, and other studies incorporate contrastive learning. Downstream tasks varied widely and implemented diverse fine-tuning strategies, which made direct comparison challenging. Furthermore, most studies used single-task fine-tuning, and a generalizable EEG foundation model remains lacking. In conclusion, the field is advancing rapidly but still limited by limited dataset diversity and the absence of standardized benchmarks. Progress will likely depend on larger and more diverse pretraining datasets, standardized evaluation protocols, and multi-task validation. The development will advance EEG foundation models towards robust and general-purpose relevant to both basic and clinical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑