arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2008.12490eess.SP
收藏

基于注意驱动卷积神经网络的EEG信号目标视觉识别解码

Decoding Visual Recognition of Objects from EEG Signals based on Attention-Driven Convolutional Neural Network

Jenifer Kalafatovich, Minji Lee, Seong-Whan Lee

摘要:

感知和识别物体的能力是与外部环境互动的基础。由于直观的脑机接口(BMI)的可能应用,研究它们及其与大脑活动变化的关系的研究一直在增加。此外,当呈现不同的视觉刺激,使数据区分足以被分类的独特模式进行了研究。然而,报告的分类准确度仍然很低,或者用于获得大脑信号的技术在真实环境中使用是不切实际的。在这项研究中,我们的目标是解码脑电图(EEG)信号取决于所提供的视觉刺激。受试者提出了72张照片属于6个不同的语义类别。根据脑电信号的视觉刺激,我们将其分为6类72个样本。为了实现高的分类精度,我们提出了一个注意力驱动的卷积神经网络,并将我们的结果与传统的方法用于分类EEG信号。我们报告了6类和72类的准确率分别为50.37%和26.75%。这些结果在统计上优于其他传统方法。这是可能的,因为注意力网络的应用使用人类的视觉通路。我们的研究结果表明,EEG信号是可能的,以区分当受试者呈现不同的语义类别的视觉刺激,并在一个样本的水平具有较高的分类精度,这表明它的可行性,将其应用于现实世界的BMI。

英文摘要:

The ability to perceive and recognize objects is fundamental for the interaction with the external environment. Studies that investigate them and their relationship with brain activity changes have been increasing due to the possible application in an intuitive brain-machine interface (BMI). In addition, the distinctive patterns when presenting different visual stimuli that make data differentiable enough to be classified have been studied. However, reported classification accuracy still low or employed techniques for obtaining brain signals are impractical to use in real environments. In this study, we aim to decode electroencephalography (EEG) signals depending on the provided visual stimulus. Subjects were presented with 72 photographs belonging to 6 different semantic categories. We classified 6 categories and 72 exemplars according to visual stimuli using EEG signals. In order to achieve a high classification accuracy, we proposed an attention driven convolutional neural network and compared our results with conventional methods used for classifying EEG signals. We reported an accuracy of 50.37% and 26.75% for 6-class and 72-class, respectively. These results statistically outperformed other conventional methods. This was possible because of the application of the attention network using human visual pathways. Our findings showed that EEG signals are possible to differentiate when subjects are presented with visual stimulus of different semantic categories and at an exemplar-level with a high classification accuracy; this demonstrates its viability to be applied it in a real-world BMI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑