The aim of this paper is to design and construct an electroencephalograph (EEG) based brain-controlled wheelchair to provide a communication bridge from the nervous system to the external technical device for people of determination or individuals suffering from partial or complete paralysis. EEG is a technique that reads the activity of the brain by capturing brain signals non-invasively using a special EEG headset. The signals acquired go through pre-processing, feature extraction and classification. This technique allows human thoughts alone to be converted to control the wheelchair. The commands used are moving to the right, left, forward, and backward and stop. The brain signals are acquired using the Emotiv Epoc headset. Discrete Wavelet Transform is used for feature extraction and Support Vector Machine (SVM) is used for classification.
EEG-based AI-BCI Wheelchair Advancement: Transformer-Based Learning with Motor Imagery for Brain Computer Interface
Department of Computer Science and Engineering, Kathmandu University（加德满都大学计算机科学与工程系）；Department of Electronics and Communication Engineering, Nepal Engineering College, Pokhara University（博卡拉大学尼泊尔工程学院电子与通信工程系）；Department of Applied Sciences and Chemical Engineering, Institute of Engineering, Pulchowk Campus, Tribhuvan University（特里布万大学工程学院普尔乔克校区应用科学与化学工程系）
National Institute of Technology Karnataka（卡纳塔克国家理工学院）
Spinal cord injuries can often lead to quadriplegia in patients limiting their mobility. Wheelchairs could be a good proposition for patients, but most of them operate either manually or with the help of electric motors operated with a joystick. This, however, requires the use of hands, making it unsuitable for quadriplegic patients. Controlling eye movement, on the other hand, is retained even by people who undergo brain injury. Monitoring the movements in the eye can be a helpful tool in generating control signals for the wheelchair. This paper is an approach to converting obtained signals f…
School of Engineering, University of Maryland（马里兰大学工程学院）；College of Engineering, Qatar University（卡塔尔大学工程学院）；University of Dhaka（达卡大学）
In the 34 developed and 156 developing countries, there are about 132 million disabled people who need a wheelchair constituting 1.86% of the world population. Moreover, there are millions of people suffering from diseases related to motor disabilities, which cause inability to produce controlled movement in any of the limbs or even head.The paper proposes a system to aid people with motor disabilities by restoring their ability to move effectively and effortlessly without having to rely on others utilizing an eye-controlled electric wheelchair. The system input was images of the users eye tha…
EEG-BCIs have been well studied in the past decades and implemented into several famous applications, like P300 speller and wheelchair controller. However, these interfaces are indirect due to low spatial resolution of EEG. Recently, direct ECoG-BCIs attract intensive attention because ECoG provides a higher spatial resolution and signal quality. This makes possible localization of the source of neural signals with respect to certain brain functions. In this article, we present a realization of ECoG-BCIs for finger flexion prediction provided by BCI competition IV. Methods for finger flexion p…
University of New South Wales（新南威尔士大学）；Macquarie University（麦考瑞大学）；RMIT University（皇家墨尔本理工大学）
An electroencephalography (EEG) based Brain Computer Interface (BCI) enables people to communicate with the outside world by interpreting the EEG signals of their brains to interact with devices such as wheelchairs and intelligent robots. More specifically, motor imagery EEG (MI-EEG), which reflects a subjects active intent, is attracting increasing attention for a variety of BCI applications. Accurate classification of MI-EEG signals while essential for effective operation of BCI systems, is challenging due to the significant noise inherent in the signals and the lack of informative correlati…
This article examined brain signals of people with disabilities using various signal processing methods to achieve the desired accuracy for utilizing brain-computer interfaces (BCI). EEG signals resulted from 5 mental tasks of word association (WORD), Mental subtraction (SUB), spatial navigation (NAV), right-hand motor imagery (HAND), and feet motor imagery (FEET) of 9 people with central nervous system (CNS) tissue damage were used as input. In processing this data, Butterworth band-pass filter (8-30 Hz) was used in the preprocessing, and CSP, TRCSP, FBCSP methods were used in feature extract…
One of the greatest goals of neuroscience in recent decades has been to rehabilitate individuals who no longer have a functional relationship between their mind and their body. Although neuroscience has produced technologies which allow the brains of paralyzed patients to accomplish tasks such as spell words or control a motorized wheelchair, these technologies utilize parts of the brain which may not be optimal for simultaneous use. For example, if you needed to look at flashing lights to spell words for communication, it would be difficult to simultaneously look at where you are moving. To i…
A Brain Computer Interface (BCI) is a communication system that receives neurological signals from the brain and translates them into control commands for electrical (e.g., computer mouse) and electromechanical (e.g., Wheelchair) devices. The development of such systems was intended originally to aid individuals with a condition called locked-in syndrome. Individuals with this condition have lost all their voluntary muscle control but remain cognitively intact (i.e., mentally aware of their surroundings- can feel emotions, recognize objects/people but are unable to move). This means that they …
Brain-computer interface allows people who have lost their motor skills to control robot limbs based on electroencephalography. Most BCIs are guided only by visual feedback and do not have somatosensory feedback, which is an important component of normal motor behavior. The sense of touch is a very crucial sensory modality, especially in object recognition and manipulation. When manipulating an object, the brain uses empirical information about the tactile properties of the object. In addition, the primary somatosensory cortex is not only involved in processing the sense of touch in our body b…
Several changes occur in the brain in response to voluntary and involuntary activities performed by a person. The ability to retrieve data from the brain within a time space provides a basis for in-depth analyses that offer insight on what changes occur in the brain during its decision-making processes. In this work, we present the technical description and software implementation of an electroencephalographic (EEG) based communication system. We read EEG data in real-time with which we compute the likelihood that a voluntary eye blink has been made by a person and use the decision to trigger …
Every people has their own voice, likewise, brain signals dis-play distinct neural representations for each individual. Al-though recent studies have revealed the robustness of speech-related paradigms for efficient brain-computer interface, the dis-tinction on their cognitive representations with practical usabil-ity still remains to be discovered. Herein, we investigate the dis-tinct brain patterns from electroencephalography (EEG) duringimagined speech, overt speech, and speech perception in termsof subject variations with its practical use of speaker identifica-tion from single channel EEG…
Hunan University（湖南大学）；University of Warwick（华威大学）；University at Buffalo（纽约州立大学布法罗分校）；IBM Research AI（IBM研究院人工智能实验室）
The "mind-controlling" capability has always been in mankind's fantasy. With the recent advancements of electroencephalograph (EEG) techniques, brain-computer interface (BCI) researchers have explored various solutions to allow individuals to perform various tasks using their minds. However, the commercial off-the-shelf devices to run accurate EGG signal collection are usually expensive and the comparably cheaper devices can only present coarse results, which prevents the practical application of these devices in domestic services. To tackle this challenge, we propose and develop an end-to-end…
In this paper, we propose a novel Convolutional Neural Network (CNN) approach for the classification of raw dry-EEG signals without any data pre-processing. To illustrate the effectiveness of our approach, we utilise the Steady State Visual Evoked Potential (SSVEP) paradigm as our use case. SSVEP can be utilised to allow people with severe physical disabilities such as Complete Locked-In Syndrome or Amyotrophic Lateral Sclerosis to be aided via BCI applications, as it requires only the subject to fixate upon the sensory stimuli of interest. Here we utilise SSVEP flicker frequencies between 10 …
University of Tasmania, Australia（塔斯马尼亚大学）；Macquarie University, Australia（麦考瑞大学）；University of Electronic Science and Technology of China, China（电子科技大学）；Huazhong University of Science and Technology, China（华中科技大学）；University of California, San Diego, USA（加利福尼亚大学圣地亚哥分校）；University of Technology Sydney, Australia（悉尼科技大学）
Brain-Computer Interface (BCI) is a powerful communication tool between users and systems, which enhances the capability of the human brain in communicating and interacting with the environment directly. Advances in neuroscience and computer science in the past decades have led to exciting developments in BCI, thereby making BCI a top interdisciplinary research area in computational neuroscience and intelligence. Recent technological advances such as wearable sensing devices, real-time data streaming, machine learning, and deep learning approaches have increased interest in electroencephalogra…
Khulna University of Engineering & Technology（库尔纳工程技术大学）
People undergoing neuromuscular dysfunctions and amputated limbs require automatic prosthetic appliances. In developing such prostheses, the precise detection of brain motor actions is imperative for the Grasp-and-Lift (GAL) tasks. Because of the low-cost and non-invasive essence of Electroencephalography (EEG), it is widely preferred for detecting motor actions during the controls of prosthetic tools. This article has automated the hand movement activity viz GAL detection method from the 32-channel EEG signals. The proposed pipeline essentially combines preprocessing and end-to-end detection …
Recent advances in electroencephalography (EEG) and electromyography (EMG) enable communication for people with severe disabilities. In this paper we present a system that enables the use of regular computers using an off-the-shelf EEG/EMG headset, providing a pointing device and virtual keyboard that can be used to operate any Windows based system, minimizing the user effort required for interacting with a personal computer. Effectiveness of the proposed system is evaluated by a usability study, indicating decreasing learning curve for completing various tasks. The proposed system is availabl…
What happen in the brain when human beings play games with computers? Here a simple zero-sum game was conducted to investigate how people make decision via their brain even they know that their opponent is a computer. There are two choices (a low or high number) for people and also two strategies for the computer (red color or green color). When the number selected by the human subject meet the red color, the person loses the score which is equal to the number. On the contrary, the person gains the number of score if the computer chooses a green color for the number selected by the human being…
University of California, Irvine（加州大学尔湾分校）；Long Beach Veterans Affairs Medical Center（长滩退伍军人事务医疗中心）
Reliance on wheelchairs after spinal cord injury (SCI) leads to many medical co-morbidities. Treatment of these conditions contributes to the majority of SCI health care costs. Restoring able-body-like ambulation after SCI may reduce the incidence of these conditions, and increase independence and quality of life. However, no biomedical solution exists that can reverse this lost neurological function, and hence novel methods are needed. Brain-computer interface (BCI) controlled lower extremity prosthesis may constitute one such novel approach. One subject with able-body and one with paraplegia…
With the increasing demands of emotion comprehension and regulation in our daily life, a customized music-based emotion regulation system is introduced by employing current EEG information and song features, which predicts users' emotion variation in the valence-arousal model before recommending music. The work shows that: (1) a novel music-based emotion regulation system with a commercial EEG device is designed without employing deterministic emotion recognition models for daily usage; (2) the system considers users' variant emotions towards the same song, and by which calculate user's emotio…
Institute of Alparslan Defence Sciences, National Defence University（阿尔帕尔斯兰国防科学研究所，国防大学）；İskenderun Technical University（伊斯肯德伦技术大学）
This paper aims to develop brain-computer interface system based on electroencephalography that can aid disabled people in daily life. The system relies on one of the most effective event-related potential wave, P300, which can be elicited by oddball paradigm. Developed application has a basic interaction tool that enables disabled people to convey their needs to other people selecting related objects. These objects pseudo-randomly flash in a visual interface on computer screen. The user must focus on related object to convey desired needs. The system can convey desired needs correctly by dete…
DataNova；U.S. Army Research Laboratory（美国陆军研究实验室）；University of Texas at San Antonio（德克萨斯大学圣安东尼奥分校）
Electroencephalography (EEG) headsets are the most commonly used sensing devices for Brain-Computer Interface. In real-world applications, there are advantages to extrapolating data from one user session to another. However, these advantages are limited if the data arise from different hardware systems, which often vary between application spaces. Currently, this creates a need to recalibrate classifiers, which negatively affects people's interest in using such systems. In this paper, we employ active weighted adaptation regularization (AwAR), which integrates weighted adaptation regularizatio…
Humans constantly interact with digital devices that disregard their feelings. However, the synergy between human and technology can be strengthened if the technology is able to distinguish and react to human emotions. Models that rely on unconscious indications of human emotions, such as (neuro)physiological signals, hold promise in personalization of feedback and adaptation of the interaction. The current study elaborated on adopting a predictive approach in studying human emotional processing based on brain activity. More specifically, we investigated the proposition of predicting self-repo…
How are the people in the photos judged? Analysis of brain activity when assessing levels of trust and attractiveness
Maria Curie-Sklodowska University（玛丽亚·居里-斯克沃多夫斯卡大学）；Neurocognitive Research Center（神经认知研究中心）；SWPS University of Social Sciences and Humanities（SWPS社会科学与人文大学）
