arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.14213q-bio.NCcs.LGeess.SP
收藏

面向自然神经科学的跨个体共享时空EEG表征对比学习

Contrastive Learning of Shared Spatiotemporal EEG Representations Across Individuals for Naturalistic Neuroscience

Tsinghua University(清华大学);Southern University of Science and Technology(南方科技大学)

Xinke Shen, Lingyi Tao, Xuyang Chen, Sen Song, Quanying Liu, Dan Zhang

AI总结:

本研究提出跨个体共享时空EEG表征对比学习框架CL-SSTER,通过时空卷积结合对比学习提取跨个体共享神经模式,在三类EEG数据集上取得最优被试间相关性,为自然神经科学研究提供可解释、可扩展的分析工具。

摘要:

自然刺激诱发的神经表征为理解人类在日常生活中对刺激的反应机制提供了思路。解析自然刺激处理背后的神经机制,关键在于精准识别并提取跨个体稳定存在的共享神经模式。本研究针对具备丰富时空信息的脑电图(EEG)技术,提出了跨个体共享时空EEG表征对比学习框架(CL-SSTER)。CL-SSTER利用对比学习,最大化相同刺激下不同个体EEG表征的相似度,同时与不同刺激对应的表征形成对比。该网络采用空间卷积和时间卷积,同步学习EEG中固有的空间模式与时间模式。研究在三个EEG数据集上验证了CL-SSTER的通用性,包括一个合成数据集、一个自然语音理解EEG数据集以及一个情绪视频观看EEG数据集。与现有最优的被试间相关性(ISC)方法相比,CL-SSTER取得了最高的ISC值。CL-SSTER生成的潜在表征呈现出可靠的时空EEG模式,可通过自然刺激的属性进行解释。CL-SSTER为自然神经科学领域中识别跨被试共享神经表征提供了一个兼具可解释性与可扩展性的框架。

英文摘要:

Neural representations induced by naturalistic stimuli offer insights into how humans respond to stimuli in daily life. Understanding neural mechanisms underlying naturalistic stimuli processing hinges on the precise identification and extraction of the shared neural patterns that are consistently present across individuals. Targeting the Electroencephalogram (EEG) technique, known for its rich spatial and temporal information, this study presents a framework for Contrastive Learning of Shared SpatioTemporal EEG Representations across individuals (CL-SSTER). CL-SSTER utilizes contrastive learning to maximize the similarity of EEG representations across individuals for identical stimuli, contrasting with those for varied stimuli. The network employed spatial and temporal convolutions to simultaneously learn the spatial and temporal patterns inherent in EEG. The versatility of CL-SSTER was demonstrated on three EEG datasets, including a synthetic dataset, a natural speech comprehension EEG dataset, and an emotional video watching EEG dataset. CL-SSTER attained the highest inter-subject correlation (ISC) values compared to the state-of-the-art ISC methods. The latent representations generated by CL-SSTER exhibited reliable spatiotemporal EEG patterns, which can be explained by properties of the naturalistic stimuli. CL-SSTER serves as an interpretable and scalable framework for the identification of inter-subject shared neural representations in naturalistic neuroscience.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑