arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.07595q-bio.NCcs.HCcs.SDeess.AS
收藏

神经数据中的缩放定律:基于175小时EEG数据的非侵入式语音解码

Scaling Law in Neural Data: Non-Invasive Speech Decoding with 175 Hours of EEG Data

Araya Inc.(Araya公司)

Motoshige Sato, Kenichi Tomeoka, Ilya Horiguchi, Kai Arulkumaran, Ryota Kanai, Shuntaro Sasai

AI总结:

本研究通过采集175小时单被试EEG数据,验证了开放词汇语音解码中数据规模与准确率的缩放定律,为非侵入式语音脑机接口的实用化提供了关键依据。

摘要:

脑机接口(BCIs)在辅助言语障碍人群方面具有巨大潜力。利用脑电图(EEG)解码语音因其非侵入性特性而极具前景。然而,EEG记录通常时长较短,且数据的高变异性使得研究者们大多聚焦于仅包含几十个类别的分类任务。为评估其在语音神经假体中的实际适用性,我们研究了开放词汇场景下EEG数据规模与解码准确率之间的关系。我们从单名受试者处收集了175小时的大量EEG数据,并采用自监督表示学习方法进行零样本语音片段分类。在完整数据集上训练的模型实现了48%的top-1准确率和76%的top-10准确率,同时缓解了肌电伪迹的影响。与之相对,当数据量限制为实际研究中常用的约10小时时,top-1准确率降至2.5%,体现出显著的缩放效应。此外,随着训练数据量增加,EEG的潜在表征逐渐呈现出更清晰的口语短语时间结构。这表明解码器无需显式的词汇识别测量,就能以数据驱动的方式识别语音片段。本研究是迈向基于EEG的语音脑机接口实际应用的重要一步。

英文摘要:

Brain-computer interfaces (BCIs) hold great potential for aiding individuals with speech impairments. Utilizing electroencephalography (EEG) to decode speech is particularly promising due to its non-invasive nature. However, recordings are typically short, and the high variability in EEG data has led researchers to focus on classification tasks with a few dozen classes. To assess its practical applicability for speech neuroprostheses, we investigate the relationship between the size of EEG data and decoding accuracy in the open vocabulary setting. We collected extensive EEG data from a single participant (175 hours) and conducted zero-shot speech segment classification using self-supervised representation learning. The model trained on the entire dataset achieved a top-1 accuracy of 48\% and a top-10 accuracy of 76\%, while mitigating the effects of myopotential artifacts. Conversely, when the data was limited to the typical amount used in practice ($\sim$10 hours), the top-1 accuracy dropped to 2.5\%, revealing a significant scaling effect. Additionally, as the amount of training data increased, the EEG latent representation progressively exhibited clearer temporal structures of spoken phrases. This indicates that the decoder can recognize speech segments in a data-driven manner without explicit measurements of word recognition. This research marks a significant step towards the practical realization of EEG-based speech BCIs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑