arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.18253cs.LG
收藏

从MEG到MEG的迁移学习与跨任务语音/沉默检测(数据有限)

MEG-to-MEG Transfer Learning and Cross-Task Speech/Silence Detection with Limited Data

HiTZ Center, University of the Basque Country -- UPV/EHU, Spain(比斯开国家大学HiTZ中心);Basque Center on Cognition, Brain and Language -- BCBL, Spain(巴斯克认知、大脑与语言中心);Ikerbasque, Basque Foundation for Science, Spain(巴斯克科学基金会Ikerbasque);Laboratory of Functional Anatomy, Faculty of Human Motor Sciences, Université libre de Bruxelles (ULB), Belgium(布鲁塞尔自由大学人体运动科学系功能解剖实验室);Laboratoire de Neuroanatomie et Neuroimagerie translationnelles (LN2T), ULB Neuroscience Institute, Université libre de Bruxelles (ULB), Belgium(布鲁塞尔自由大学神经解剖与神经影像翻译实验室);WEL Research Institute, Belgium(比利时WEL研究机构)

Xabier de Zuazo, Vincenzo Verbeni, Eva Navas, Ibon Saratxaga, Mathieu Bourguignon, Nicola Molinaro

AI总结:

本文提出通过迁移学习提升MEG数据下的语音与沉默检测性能,展示预训练模型在跨任务解码中的优势。

摘要:

数据高效的神经解码是语音脑机接口中的核心挑战。我们首次展示了基于MEG的语音模型在感知和生产方面的迁移学习和跨任务解码。我们先在50小时的单人听力数据上预训练一个基于Conformer的模型,然后在18名参与者每人5分钟的数据上进行微调。迁移学习带来了持续的改进,任务内准确率提高了1-4%,跨任务准确率提高了5-6%。不仅预训练提高了每个任务的性能,而且它还使感知和生产之间的跨任务解码变得可靠。关键的是,训练于语音生产模型能够对被动听力进行解码,超过随机水平,证实了学习的表示反映了共享的神经过程,而不是任务特定的运动活动。

英文摘要:

Data-efficient neural decoding is a central challenge for speech brain-computer interfaces. We present the first demonstration of transfer learning and cross-task decoding for MEG-based speech models spanning perception and production. We pre-train a Conformer-based model on 50 hours of single-subject listening data and fine-tune on just 5 minutes per subject across 18 participants. Transfer learning yields consistent improvements, with in-task accuracy gains of 1-4% and larger cross-task gains of up to 5-6%. Not only does pre-training improve performance within each task, but it also enables reliable cross-task decoding between perception and production. Critically, models trained on speech production decode passive listening above chance, confirming that learned representations reflect shared neural processes rather than task-specific motor activity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑