Brain-computer interface allows people who have lost their motor skills to control robot limbs based on electroencephalography. Most BCIs are guided only by visual feedback and do not have somatosensory feedback, which is an important component of normal motor behavior. The sense of touch is a very crucial sensory modality, especially in object recognition and manipulation. When manipulating an object, the brain uses empirical information about the tactile properties of the object. In addition, the primary somatosensory cortex is not only involved in processing the sense of touch in our body but also responds to visible contact with other people or inanimate objects. Based on these findings, we conducted a preliminary experiment to confirm the possibility of a novel paradigm called touch imagery. A haptic imagery experiment was conducted on four objects, and through neurophysiological analysis, a comparison analysis was performed with the brain waves of the actual tactile sense. Also, high classification performance was confirmed through the basic machine learning algorithm.
Touch is the first sense among human senses. Not only that, but it is also one of the most important senses that are indispensable. However, compared to sight and hearing, it is often neglected. In particular, since humans use the tactile sense of the skin to recognize and manipulate objects, without tactile sensation, it is very difficult to recognize or skillfully manipulate objects. In addition, the importance and interest of haptic technology related to touch are increasing with the development of technologies such as VR and AR in recent years. So far, the focus is only on haptic technolog…
Northeastern University（东北大学）；Graz University of Technology（格拉茨工业大学）；University of Pittsburgh（匹兹堡大学）
During daily activities, humans use their hands to grasp surrounding objects and perceive sensory information which are also employed for perceptual and motor goals. Multiple cortical brain regions are known to be responsible for sensory recognition, perception and motor execution during sensorimotor processing. While various research studies particularly focus on the domain of human sensorimotor control, the relation and processing between motor execution and sensory processing is not yet fully understood. Main goal of our work is to discriminate textured surfaces varying in their roughness l…
Playing back vibrotactile signals through actuators is commonly used to simulate tactile feelings of virtual textured surfaces. However, there is often a small mismatch between the simulated tactile feelings and intended tactile feelings by tactile designers. Thus, a method of modulating the vibrotactile perception is required. We focus on fine roughness perception and we propose a method using a pseudo-haptic effect to modulate fine roughness perception of vibrotactile texture. Specifically, we visually modify the pointer's position on the screen slightly, which indicates the touch position o…
Tactile displays based on friction modulation offer wide-bandwidth forces rendered directly on the fingertip. However, due to a number of touch conditions (e.g., normal force, skin hydration) that result in variations in the friction force and the strength of modulation effect, the precision of the force rendering remains limited. In this paper we demonstrate a closed-loop electroadhesion method for precise playback of friction force profiles on a human finger and we apply this method to the tactile rendering of several textiles encountered in everyday life.
The objective of the system presented in this paper is to give users tactile feedback while walking in a virtual world through an anthropomorphic finger motion interface. We determined that the synchrony between the first person perspective and proprioceptive information together with the motor activity of the user's fingers are able to induce an illusionary feeling that is equivalent to the sense of ownership of the invisible avatar's legs. Under this condition, the perception of the ground under the virtual avatar's foot is felt through the user's fingertip. The experiments indicated that us…
University of Engineering and Technology, Taxila（塔克西拉工程技术大学）；University of Central Florida（中佛罗里达大学）
Tactile enhanced multimedia is generated by synchronizing traditional multimedia clips, to generate hot and cold air effect, with an electric heater and a fan. This objective is to give viewers a more realistic and immersing feel of the multimedia content. The response to this enhanced multimedia content (mulsemedia) is evaluated in terms of the appreciation/emotion by using human brain signals. We observe and record electroencephalography (EEG) data using a commercially available four channel MUSE headband. A total of 21 participants voluntarily participated in this study for EEG recordings. …
Realistic display of tactile textures on touch screens is a big step forward for haptic technology to reach a wide range of consumers utilizing electronic devices on a daily basis. Since the texture topography cannot be rendered explicitly by electrovibration on touch screens, it is important to understand how we perceive the virtual textures displayed by friction modulation via electrovibration. We investigated the roughness perception of real gratings made of plexiglass and virtual gratings displayed by electrovibration through a touch screen for comparison. In particular, we conducted two p…
It is human to want to touch artworks, to feel their surface curvature and texture, their shapes and structures, and to feel the hand of the artist. Museum guards need to be constantly vigilant to protect art objects from adoring and exploring touches by visitors. This paper introduces a novel technique for capturing where and how art objects are touched. In this method, the users' touch either adds, or subtracts, microscopic fluorescent particles from a three-dimensional art object. Viewing the object under ultraviolet light reveals their touch traces and gestures. We present human touch beha…
Noninvasive brain-computer interface (BCI) is widely used to recognize users' intentions. Especially, BCI related to tactile and sensation decoding could provide various effects on many industrial fields such as manufacturing advanced touch displays, controlling robotic devices, and more immersive virtual reality or augmented reality. In this paper, we introduce haptic and sensory perception-based BCI systems called neurohaptics. It is a preliminary study for a variety of scenarios using actual touch and touch imagery paradigms. We designed a novel experimental environment and a device that co…
