Objective: We used deep convolutional neural networks (DCNNs) to classify electroencephalography (EEG) signals in a steady-state visually evoked potentials (SSVEP) based single-channel brain-computer interface (BCI), which does not require calibration on the user.
Methods: EEG signals were converted to spectrograms and served as input to train DCNNs using the transfer learning technique. We also modified and applied a data augmentation method, SpecAugment, generally employed for speech recognition. Furthermore, for comparison purposes, we classified the SSVEP dataset using Support-vector machines (SVMs) and Filter Bank canonical correlation analysis (FBCCA).
Results: Excluding the evaluated user's data from the fine-tuning process, we reached 82.2% mean test accuracy and 0.825 mean F1-Score on 35 subjects from an open dataset, using a small data length (0.5 s), only one electrode (Oz) and the DCNN with transfer learning, window slicing (WS) and SpecAugment's time masks.
Conclusion: The DCNN results surpassed SVM and FBCCA performances, using a single electrode and a small data length. Transfer learning provided minimal accuracy change, but made training faster. SpecAugment created a small performance improvement and was successfully combined with WS, yielding higher accuracies.
Significance: We present a new methodology to solve the problem of SSVEP classification using DCNNs. We also modified a speech recognition data augmentation technique and applied it to the context of BCIs. The presented methodology surpassed performances obtained with FBCCA and SVMs (more traditional SSVEP classification methods) in BCIs with small data lengths and one electrode. This type of BCI can be used to develop small and fast systems.
iFuzzyTL: Interpretable Fuzzy Transfer Learning for SSVEP BCI System
University of Technology Sydney(悉尼科技大学);Australian AI Institute(澳大利亚人工智能研究院);School of Computer Science, Faculty of Engineering and Information Technology(工程与信息技术学院计算机科学学院)
Source-Free Domain Adaptation for SSVEP-based Brain-Computer Interfaces
Department of Electrical and Computer Engineering, Boston University, Boston, MA, USA(电气与计算机工程系,波士顿大学);Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany(人类认知与脑科学Max Planck研究所,莱比锡,德国);Faculty of Engineering and Natural Sciences, Sabanci University, Istanbul, Turkey(工程与自然科学学院,萨班奇大学,伊斯坦布尔,土耳其)
Rethinking Self-Training Based Cross-Subject Domain Adaptation for SSVEP Classification
School of Artificial Intelligence, Beijing University of Posts and Telecommunications(人工智能学院,北京邮电大学);School of Computer Science and Technology, Beihang University(计算机科学与技术学院,北航)