In the recent past, psychological stress has been increasingly observed in humans, and early detection is crucial to prevent health risks. Stress detection using on-device deep learning algorithms has been on the rise owing to advancements in pervasive computing. However, an important challenge that needs to be addressed is handling unlabeled data in real-time via suitable ground truthing techniques (like Active Learning), which should help establish affective states (labels) while also selecting only the most informative data points to query from an oracle. In this paper, we propose a framework with capabilities to represent model uncertainties through approximations in Bayesian Neural Networks using Monte-Carlo (MC) Dropout. This is combined with suitable acquisition functions for active learning. Empirical results on a popular stress and affect detection dataset experimented on a Raspberry Pi 2 indicate that our proposed framework achieves a considerable efficiency boost during inference, with a substantially low number of acquired pool points during active learning across various acquisition functions. Variation Ratios achieves an accuracy of 90.38% which is comparable to the maximum test accuracy achieved while training on about 40% lesser data.
Dublin City University（都柏林城市大学）；VNU-HCM, University of Science（越南胡志明市国家大学科学大学）
Stress is a complex issue with wide-ranging physical and psychological impacts on human daily performance. Specifically, acute stress detection is becoming a valuable application in contextual human understanding. Two common approaches to training a stress detection model are subject-dependent and subject-independent training methods. Although subject-dependent training methods have proven to be the most accurate approach to build stress detection models, subject-independent models are a more practical and cost-efficient method, as they allow for the deployment of stress level detection and ma…
A Wearable Device Dataset for Mental Health Assessment Using Laser Doppler Flowmetry and Fluorescence Spectroscopy Sensors
Aston University（阿斯顿大学）；University of Toronto（多伦多大学）；University Health Network（大学健康网络）；Florida Institute of Technology（佛罗里达理工学院）；Hai Duong Central College of Pharmacy（海洞中央药学院）；Stanford University（斯坦福大学）；Industrial University of Ho Chi Minh City（胡志明市工业大学）；The University of Alabama at Birmingham（伯明翰大学）；Pukyong National University（浦项国立大学）
Universitat Politècnica de Catalunya（加泰罗尼亚理工大学）；Eurecat, Centre Tecnològic de Catalunya（加泰罗尼亚技术中心（Eurecat））；Universitat Oberta de Catalunya（加泰罗尼亚开放大学）
We present MDEAW, a multimodal database consisting of Electrodermal Activity (EDA) and Photoplethysmography (PPG) signals recorded during the exams for the course taught by the teacher at Eurecat Academy, Sabadell, Barcelona in order to elicit the emotional reactions to the students in a classroom scenario. Signals from 10 students were recorded along with the students' self-assessment of their affective state after each stimulus, in terms of 6 basic emotion states. All the signals were captured using portable, wearable, wireless, low-cost, and off-the-shelf equipment that has the potential to…
Dublin City University（都柏林城市大学）；VNU-HCM, University of Science（越南胡志明市国家大学科学大学）
Identifying stress levels can provide valuable data for mental health analytics as well as labels for annotation systems. Although much research has been conducted into stress detection models using heart rate variability at a higher cost of data collection, there is a lack of research on the potential of using low-resolution Electrodermal Activity (EDA) signals from consumer-grade wearable devices to identify stress patterns. In this paper, we concentrate on performing statistical analyses on the stress detection capability of two popular approaches of training stress detection models with st…
Physiological and behavioral data collected from wearable or mobile sensors have been used to estimate self-reported stress levels. Since the stress annotation usually relies on self-reports during the study, a limited amount of labeled data can be an obstacle in developing accurate and generalized stress predicting models. On the other hand, the sensors can continuously capture signals without annotations. This work investigates leveraging unlabeled wearable sensor data for stress detection in the wild. We first applied data augmentation techniques on the physiological and behavioral data to …
With the development of wearable technologies, a new kind of healthcare data has become valuable as medical information. These data provide meaningful information regarding an individual's physiological and psychological states, such as activity level, mood, stress, and cognitive health. These biomarkers are named digital since they are collected from digital devices integrated with various sensors. In this study, we explore digital biomarkers related to stress modality by examining data collected from mobile phones and smartwatches. We utilize machine learning techniques on the Tesserae datas…
Khoury College of Computer Sciences, Northeastern University（东北大学计算机科学学院）；Bouvé College of Health Sciences, Northeastern University（东北大学健康科学学院）；Department of Biostatistics, Harvard T.H. Chan School of Public Health（哈佛T.H. Chan公共卫生学院生物统计学系）
Wearable sensors are widely used to collect physiological data and develop stress detection models. However, most studies focus on a single dataset, rarely evaluating model reproducibility across devices, populations, or study conditions. We previously assessed the reproducibility of stress detection models across multiple studies, testing models trained on one dataset against others using heart rate (with R-R interval) and electrodermal activity (EDA). In this study, we extended our stress detection reproducibility to consumer wearable sensors. We compared validated research-grade devices, to…
When Adaptation Hurts: Split Sensitivity and Person-Level Negative Transfer in Federated Wearable Onboarding
Jamia Hamdard（贾米亚哈姆达德大学）；Homi Bhabha National Institute（霍米·巴巴国家研究所）；Variable Energy Cyclotron Centre（可变能量回旋加速器中心）；Gargi Memorial Institute of Technology（加尔吉纪念理工学院）；Maulana Abul Kalam Azad University of Technology（毛拉纳·阿布·卡拉姆·阿扎德技术大学）
Since stress contributes to a broad range of mental and physical health problems, the objective assessment of stress is essential for behavioral and physiological studies. Although several studies have evaluated stress levels in controlled settings, objective stress assessment in everyday settings is still largely under-explored due to challenges arising from confounding contextual factors and limited adherence for self-reports. In this paper, we explore the objective prediction of stress levels in everyday settings based on heart rate (HR) and heart rate variability (HRV) captured via low-cos…
The advent of IoT has enabled the design of connected and integrated smart health monitoring systems. These smart health monitoring systems could be realized in a smart home context to render long-term care to the elderly population. In this paper, we present the design of a wearable health monitoring system suitable for older adults in a smart home context. The proposed system offers solutions to monitor the stress, blood pressure, and location of an individual within a smart home environment. The stress detection model proposed in this work uses Electrodermal Activity (EDA), Photoplethysmogr…
Stress Detection Using Wearable Physiological and Sociometric Sensors
Dept. of Electronics, Computer Technology and Projects, Polytechnic University of Cartagena（电子工程与计算机技术项目系，卡塔赫纳理工大学）；Faculty of Automatic Control and Computer Science, Politehnica University of Bucharest（自动控制与计算机科学系，布加勒斯特理工大学）；Division of Psychology, Nottingham Trent University（心理学系，诺丁汉特伦特大学）；Department of Psychology, Lancaster University（心理学系，兰卡斯特大学）；School of Computer Science, University of Lincoln（计算机科学学院，林肯大学）
Multimodal wearable physiological data in daily life have been used to estimate self-reported stress labels. However, missing data modalities in data collection makes it challenging to leverage all the collected samples. Besides, heterogeneous sensor data and labels among individuals add challenges in building robust stress detection models. In this paper, we proposed a modality fusion network (MFN) to train models and infer self-reported binary stress labels under both complete and incomplete modality conditions. In addition, we applied personalized attention (PA) strategy to leverage persona…
The prevalence of wearable sensors (e.g., smart wristband) is creating unprecedented opportunities to not only inform health and wellness states of individuals, but also assess and infer personal attributes, including demographic and personality attributes. However, the data captured from wearables, such as heart rate or number of steps, present two key challenges: 1) the time series is often of variable-length and incomplete due to different data collection periods (e.g., wearing behavior varies by person); and 2) inter-individual variability to external factors like stress and environment. T…
With recent developments in smart technologies, there has been a growing focus on the use of artificial intelligence and machine learning for affective computing to further enhance the user experience through emotion recognition. Typically, machine learning models used for affective computing are trained using manually extracted features from biological signals. Such features may not generalize well for large datasets and may be sub-optimal in capturing the information from the raw input data. One approach to address this issue is to use fully supervised deep learning methods to learn latent r…
Introducing WARM-VR: Benchmark Dataset for Multimodal Wearable Affect Recognition in Virtual Reality
School of Electrical Engineering and Computer Science, University of Ottawa（Ottawa 大学电气工程与计算机科学学院）；Computer Science, University of Ottawa（Ottawa 大学计算机科学系）；Computer Vision Department, Mohamed bin Zayed University of Artificial Intelligence（摩根·bin·扎耶德人工智能大学计算机视觉部门）
With the growing popularity of wearable devices, the ability to utilize physiological data collected from these devices to predict the wearer's mental state such as mood and stress suggests great clinical applications, yet such a task is extremely challenging. In this paper, we present a general platform for personalized predictive modeling of behavioural states like students' level of stress. Through the use of Auto-encoders and Multitask learning we extend the prediction of stress to both sequences of passive sensor data and high-level covariates. Our model outperforms the state-of-the-art i…
Eindhoven University of Technology（埃因霍温理工大学）；Philips Research（飞利浦研究院）
Stress can be seen as a physiological response to everyday emotional, mental and physical challenges. A long-term exposure to stressful situations can have negative health consequences, such as increased risk of cardiovascular diseases and immune system disorder. Therefore, a timely stress detection can lead to systems for better management and prevention in future circumstances. In this paper, we suggest a multi-task learning based neural network approach (with hard parameter sharing of mutual representation and task-specific layers) for personalized stress recognition using skin conductance …
Physiological measurements involves observing variables that attribute to the normative functioning of human systems and subsystems directly or indirectly. The measurements can be used to detect affective states of a person with aims such as improving human-computer interactions. There are several methods of collecting physiological data, but wearable sensors are a common, non-invasive tool for accurate readings. However, valuable information is hard to extract from the raw physiological data, especially for affective state detection. Machine Learning techniques are used to detect the affectiv…
Electrodermal Activity as a Unimodal Signal for Aerobic Exercise Detection in Wearable Sensors
Odle Middle School（Odle中学）；ImagineQ Labs（ImagineQ实验室）；Cambridge Center for International（剑桥国际中心）；bellevue, WA, USA（西雅图，华盛顿州，美国）；Research, United Kingdom（英国研究）
University of California Irvine（加州大学尔湾分校）；University of California, Irvine（加州大学尔湾分校）
Monitoring and understanding affective states are important aspects of healthy functioning and treatment of mood-based disorders. Recent advancements of ubiquitous wearable technologies have increased the reliability of such tools in detecting and accurately estimating mental states (e.g., mood, stress, etc.), offering comprehensive and continuous monitoring of individuals over time. Previous attempts to model an individual's mental state were limited to subjective approaches or the inclusion of only a few modalities (i.e., phone, watch). Thus, the goal of our study was to investigate the capa…
Smartwatches have rapidly evolved towards capabilities to accurately capture physiological signals. As an appealing application, stress detection attracts many studies due to its potential benefits to human health. It is propitious to investigate the applicability of deep neural networks (DNN) to enhance human decision-making through physiological signals. However, manually engineering DNN proves a tedious task especially in stress detection due to the complex nature of this phenomenon. To this end, we propose an optimized deep neural network training scheme using neural architecture search me…
Swiss Federal Institute of Technology Lausanne（洛桑联邦理工学院）
Continuous and multimodal stress detection has been performed recently through wearable devices and machine learning algorithms. However, a well-known and important challenge of working on physiological signals recorded by conventional monitoring devices is missing data due to sensors insufficient contact and interference by other equipment. This challenge becomes more problematic when the user/patient is mentally or physically active or stressed because of more frequent conscious or subconscious movements. In this paper, we propose ReLearn, a robust machine learning framework for stress detec…
University of California, Irvine（加利福尼亚大学欧文分校）；School of Nursing（护理学院）
The stress detection problem is receiving great attention in related research communities. This is due to its essential part in behavioral studies for many serious health problems and physical illnesses. There are different methods and algorithms for stress detection using different physiological signals. Previous studies have already shown that Galvanic Skin Response (GSR), also known as Electrodermal Activity (EDA), is one of the leading indicators for stress. However, the GSR signal itself is not trivial to analyze. Different features are extracted from GSR signals to detect stress in peopl…
Real-Time Stress Detection via Photoplethysmogram Signals: Implementation of a Combined Continuous Wavelet Transform and Convolutional Neural Network on Resource-Constrained Microcontrollers
University of Tehran（德黑兰大学）；Kettering University（凯特林大学）
Automatic Detection of Stress from Speech in the Trier Social Stress Test
Human-Centered Artificial Intelligence Group, Faculty of Technology, Bielefeld University（比勒费尔德大学技术学院人本人工智能研究组）；Department of Cognitive Psychology, Faculty of Psychology, Ruhr University Bochum（波鸿鲁尔大学心理学院认知心理学系）
Wearable data from subjects playing Super Mario, sitting university exams, or performing physical exercise help detect acute mood episodes via self-supervised learning
School of Informatics, University of Edinburgh（爱丁堡大学信息学院）；Hospital Clínic de Barcelona, University of Barcelona（巴塞罗那大学巴塞罗那临床医院）；Institute of Psychiatry, Psychology and Neuroscience, King’s College London（伦敦国王学院精神病学、心理学与神经科学研究所）；Division of Psychiatry, University of Edinburgh（爱丁堡大学精神病学系）
