arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1811.10280cs.RO
收藏

利用可变自然环境脑机接口刺激实现人形机器人实时的导航

Using Variable Natural Environment Brain-Computer Interface Stimuli for Real-time Humanoid Robot Navigation

Durham University(杜伦大学)

Nik Khadijah Nik Aznan, Jason D. Connolly, Noura Al Moubayed, Toby P. Breckon

摘要:

本文研究了在自然环境下通过脑机接口实现人形机器人遥操作的问题。我们利用基于深度卷积神经网络(CNN)的图像和信号理解来促进实时的【形】对象检测和基于干脑电图(EEG)的人类皮层脑生物信号解码。我们采用干EEG技术的最新进展来流式传输和收集受试者的皮层波形,同时他们专注于直接从机器人导航的环境中产生的可变稳态视觉诱发电位(SSVEP)刺激。为此,我们建议使用新的可变BCI刺激,通过利用实时的【形】视频流通过板载机器人摄像机作为视觉输入SSVEP,其中CNN检测到的自然场景对象被改变和闪烁不同的频率(10 Hz,12 Hz和15 Hz)。这些刺激与传统刺激不同,因为闪烁区域的尺寸及其在屏幕上的位置都取决于检测到的场景对象。经由这种支持干EEG的SSVEP方法的屏幕上对象选择有助于经由专门的次级CNN将人类皮层脑信号直接在线解码为远程操作机器人命令(接近对象,在特定方向上移动:右、左或后)。该SSVEP解码模型通过先验离线实验数据进行训练,其中所有受试者都存在非常相似的视觉输入。由此产生的分类表现出高性能的平均准确率为85%的实时的【形】机器人导航实验在多个测试科目。

英文摘要:

This paper addresses the challenge of humanoid robot teleoperation in a natural indoor environment via a Brain-Computer Interface (BCI). We leverage deep Convolutional Neural Network (CNN) based image and signal understanding to facilitate both real-time bject detection and dry-Electroencephalography (EEG) based human cortical brain bio-signals decoding. We employ recent advances in dry-EEG technology to stream and collect the cortical waveforms from subjects while they fixate on variable Steady State Visual Evoked Potential (SSVEP) stimuli generated directly from the environment the robot is navigating. To these ends, we propose the use of novel variable BCI stimuli by utilising the real-time video streamed via the on-board robot camera as visual input for SSVEP, where the CNN detected natural scene objects are altered and flickered with differing frequencies (10Hz, 12Hz and 15Hz). These stimuli are not akin to traditional stimuli - as both the dimensions of the flicker regions and their on-screen position changes depending on the scene objects detected. On-screen object selection via such a dry-EEG enabled SSVEP methodology, facilitates the on-line decoding of human cortical brain signals, via a specialised secondary CNN, directly into teleoperation robot commands (approach object, move in a specific direction: right, left or back). This SSVEP decoding model is trained via a priori offline experimental data in which very similar visual input is present for all subjects. The resulting classification demonstrates high performance with mean accuracy of 85% for the real-time robot navigation experiment across multiple test subjects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑