arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.17772eess.SPcs.LG
收藏

EEG2Rep:通过有信息量的掩码输入增强自监督 EEG 表征

EEG2Rep: Enhancing Self-supervised EEG Representation Through Informative Masked Inputs

Monash University(莫纳什大学);Emotiv Research(Emotiv研究机构)

Navid Mohammadi Foumani, Geoffrey Mackellar, Soheila Ghane, Saad Irtza, Nam Nguyen, Mahsa Salehi

AI总结:

本文提出 EEG2Rep 自监督 EEG 表征框架,通过潜在空间掩码预测与语义子序列保持掩码,在 6 个任务上显著超越现有方法并具备噪声鲁棒性。

摘要:

用于脑电图(EEG)表征学习的自监督方法面临 EEG 数据固有的三个具体挑战:(1)低信噪比,这会影响所学表征的质量;(2)由受试者间差异等因素导致的、从非常小到相对较大的广泛幅值范围,可能使模型受到较高幅值范围的主导;(3)连续值序列中缺少显式分段,这可能导致表征信息量较低。为应对这些挑战,我们提出 EEG2Rep,这是一种用于从 EEG 中进行自监督表征学习的自预测方法。EEG2Rep 的两个核心新颖组成部分如下:1)EEG2Rep 并非学习从原始 EEG 预测被掩码的输入,而是学习在潜在表征空间中预测被掩码的输入;2)不同于传统掩码方法,EEG2Rep 使用一种新的语义子序列保持(SSP)方法,该方法提供有信息量的掩码输入,以引导 EEG2Rep 生成丰富的语义表征。在涉及受试者差异的 6 个不同 EEG 任务上的实验中,EEG2Rep 显著优于最先进方法。我们表明,我们的语义子序列保持方法改进了自预测文献中的现有掩码方法,并发现平均而言,保留 50% 的 EEG 记录会在全部 6 个任务上产生最准确的结果。最后,我们表明 EEG2Rep 对噪声具有鲁棒性,从而解决了 EEG 数据中存在的一项重大挑战。模型和代码可在 https://github.com/Navidfoumani/EEG2Rep 获取。

英文摘要:

Self-supervised approaches for electroencephalography (EEG) representation learning face three specific challenges inherent to EEG data: (1) The low signal-to-noise ratio which challenges the quality of the representation learned, (2) The wide range of amplitudes from very small to relatively large due to factors such as the inter-subject variability, risks the models to be dominated by higher amplitude ranges, and (3) The absence of explicit segmentation in the continuous-valued sequences which can result in less informative representations. To address these challenges, we introduce \textit{EEG2Rep}, a self-prediction approach for self-supervised representation learning from EEG. Two core novel components of EEG2Rep are as follows: 1) Instead of learning to predict the masked input from raw EEG, EEG2Rep learns to predict masked input in latent representation space, and 2) Instead of conventional masking methods, EEG2Rep uses a new semantic subsequence preserving (SSP) method which provides informative masked inputs to guide EEG2Rep to generate rich semantic representations. In experiments on 6 diverse EEG tasks with subject variability, EEG2Rep significantly outperforms state-of-the-art methods. We show that our semantic subsequence preserving improves the existing masking methods in self-prediction literature and find that preserving 50\% of EEG recordings will result in the most accurate results on all 6 tasks on average. Finally, we show that EEG2Rep is robust to noise addressing a significant challenge that exists in EEG data. Models and code are available at:\url{https://github.com/Navidfoumani/EEG2Rep}

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑