We present a glasses type wearable device to detect emotions from a human face in an unobtrusive manner. The device is designed to gather multi channel responses from the user face naturally and continuously while the user is wearing it. The multi channel responses include physiological responses of the facial muscles and organs based on electrodermal activity (EDA) and photoplethysmogram. We conducted experiments to determine the optimal positions of EDA sensors on the wearable device because EDA signal quality is very sensitive to the sensing position. In addition to the physiological data, the device can capture the image region representing local facial expressions around the left eye via a built in camera. In this study, we developed and validated an algorithm to recognize emotions using multi channel responses obtained from the device. The results show that the emotion recognition algorithm using only local facial expressions has an accuracy of 78 percent at classifying emotions. Using multi channel data, this accuracy was increased by 10.1 percent. This unobtrusive wearable system with facial multi channel responses is very useful for monitoring a user emotions in daily life, which has a huge potential for use in the healthcare industry.
CRAFT: Exploring Wearable Creative AI on Smart Glasses for Fiction Writing in Real-World Contexts
National University of Singapore(新加坡国立大学);City University of Hong Kong(香港城市大学);The Hong Kong University of Science and Technology(香港科技大学);The Chinese University of Hong Kong(香港中文大学)
Active noise cancellation on open-ear smart glasses
Department of Electrical and Computer Engineering, Carnegie Mellon University(卡内基梅隆大学电气与计算机工程系);Department of Medical Physics and Acoustics, Carl von Ossietzky Universität Oldenburg(奥尔登堡大学医学物理与声学系);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
Reimagining Wearable AR Gesture Design: Physical Therapy Reasoning in Everyday Contexts
Ghost Lab, Northeastern University(东北大学幽灵实验室);Bouvé College of Health Sciences, Northeastern University(东北大学布维健康科学学院);Fine Art Department, Zhengzhou University(郑州大学美术学院);College of Arts, Media and Design, Northeastern University(东北大学艺术、媒体与设计学院)
Towards Emotion Recognition with 3D Pointclouds Obtained from Facial Expression Images
Universitat Politècnica de Catalunya(加泰罗尼亚理工大学);University of Antwerp(安特卫普大学);imec;i2CAT Foundation(i2CAT基金会);University of Zagreb(萨格勒布大学);NEC Labs Europe GmbH(NEC欧洲实验室有限公司);ICREA
Emotion Recognition in Older Adults with Quantum Machine Learning and Wearable Sensors
Department of Electrical Engineering and Computer Science(电气工程与计算机科学系);University of Tennessee, Knoxville, TN, USA(田纳西大学,诺克斯维尔分校);Quantum Science Center, Oak Ridge National Laboratory, Oak Ridge, TN, USA(橡树岭国家实验室量子科学中心)
Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation
Computer Science Department, Carnegie Mellon University(卡内基梅隆大学计算机科学系);Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所);Neuroscience Institute, Carnegie Mellon University(卡内基梅隆大学神经科学研究所);Department of Psychology, The University of Texas at Austin(德克萨斯大学奥斯汀分校心理学系);Center for Perceptual Systems, The University of Texas at Austin(德克萨斯大学奥斯汀分校感知系统中心)