arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.00033q-bio.NCcs.AI
收藏

基于掩码自编码器fMRI重建的迁移学习揭示认知任务分类学

Uncovering cognitive taskonomy through transfer learning in masked autoencoder-based fMRI reconstruction

Southern University of Science and Technology(南方科技大学);Perelman School of Medicine, The University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院);University of Macau(澳门大学)

Youzhi Qu, Junfeng Xia, Xinyao Jian, Wendu Li, Kaining Peng, Zhichao Liang, Haiyan Wu, Quanying Liu

AI总结:

本文利用掩码自编码器重建fMRI数据,并通过迁移学习构建认知任务分类学矩阵,揭示任务间关系并为神经解码的源任务选择提供依据。

摘要:

数据重建是一种广泛使用的预训练任务,用于为许多下游任务学习通用特征。尽管重建任务已被应用于神经信号补全和去噪,但神经信号重建的研究相对较少。在此,我们采用掩码自编码器(MAE)模型来重建功能性磁共振成像(fMRI)数据,并利用迁移学习框架获得认知任务分类学(cognitive taskonomy),即一个用于量化认知任务之间相似性的矩阵。我们的实验结果表明,MAE模型能够有效捕捉脑区内的时间动态模式和交互作用,从而实现稳健的跨被试fMRI信号重建。从迁移学习框架中得到的认知任务分类学揭示了认知任务之间的关系,突出了运动任务内部的子任务相关性,以及情绪、社交和赌博任务之间的相似性。我们的研究表明,基于MAE模型的fMRI重建能够揭示潜在表征,所获得的任务分类学可为神经解码任务中的源任务选择提供指导,从而提高目标任务上的解码性能。

英文摘要:

Data reconstruction is a widely used pre-training task to learn the generalized features for many downstream tasks. Although reconstruction tasks have been applied to neural signal completion and denoising, neural signal reconstruction is less studied. Here, we employ the masked autoencoder (MAE) model to reconstruct functional magnetic resonance imaging (fMRI) data, and utilize a transfer learning framework to obtain the cognitive taskonomy, a matrix to quantify the similarity between cognitive tasks. Our experimental results demonstrate that the MAE model effectively captures the temporal dynamics patterns and interactions within the brain regions, enabling robust cross-subject fMRI signal reconstruction. The cognitive taskonomy derived from the transfer learning framework reveals the relationships among cognitive tasks, highlighting subtask correlations within motor tasks and similarities between emotion, social, and gambling tasks. Our study suggests that the fMRI reconstruction with MAE model can uncover the latent representation and the obtained taskonomy offers guidance for selecting source tasks in neural decoding tasks for improving the decoding performance on target tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑