A brain-computer interface (BCI) based on electroencephalography (EEG) is a promising technology for enhancing virtual reality (VR) applications-in particular, for gaming. We focus on the so-called P300-BCI, a stable and accurate BCI paradigm relying on the recognition of a positive event-related potential (ERP) occurring in the EEG about 300 ms post-stimulation. We implemented a basic version of such a BCI displayed on an ordinary and affordable smartphone-based head-mounted VR device: that is, a mobile and passive VR system (with no electronic components beyond the smartphone). The mobile phone performed the stimuli presentation, EEG synchronization (tagging) and feedback display. We compared the ERPs and the accuracy of the BCI on the VR device with a traditional BCI running on a personal computer (PC). We also evaluated the impact of subjective factors on the accuracy. The study was within-subjects, with 21 participants and one session in each modality. No significant difference in BCI accuracy was found between the PC and VR systems, although the P200 ERP was significantly wider and larger in the VR system as compared to the PC system.
Integrating Language-Image Prior into EEG Decoding for Cross-Task Zero-Calibration RSVP-BCI
Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所脑认知与脑智能技术重点实验室);School of Future Technology, University of Chinese Academy of Sciences (UCAS)(中国科学院大学未来技术学院);Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, the School of Artificial Intelligence, Xidian University(西安电子科技大学人工智能学院教育部智能感知与图像理解重点实验室)
Tsinghua University(清华大学);Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院 北京协和医学院);Institute of Semiconductors, Chinese Academy of Sciences(中国科学院半导体研究所)
Dataset of an EEG-based BCI experiment in Virtual Reality and on a Personal Computer
我们描述了一个数据集的实验过程,我们已经在https://doi.org/10.5281/zenodo.2605204上以mat(Mathworks,Natick,USA)和CSV格式公开提供。该数据集包含21名受试者在PC(个人计算机)和VR(虚拟现实)上进行视觉P300实验的脑电图记录。视觉P300是由视觉刺激引起的事件相关电位,在刺激开始后240-600 ms达到峰值。该实验的目的是为了比较使用基于P300的脑机接口在PC上,并与虚拟现实耳机,有关的生理,主观和性能方面。脑机接口是基于脑电图(EEG)的。脑电图记录感谢16个电极。该虚拟现实头戴式设备由无源盔装显示器组成,即,除了智能手机之外不包括任何电子设备的盔装显示器。该实验于2018年在GIPSA实验室(格勒诺布尔阿尔卑斯大学,CNRS,Grenoble-INP)进行,并由IHMTEK公司(Interaction Homme-Machine Technologie)推广。该研究得到了格勒诺布尔-阿尔卑斯大学伦理委员会(Comit{é} d 'Escherque pour la Recherche Non-Interventionnelle)的批准。用于操作数据的Python代码可在https://github.com/plcrodrigues/py.VR.EEG.2018-GIPSA上获得。该数据集的ID为VR.EEG.…