Human Stress Assessment: A Comprehensive Review of Methods Using Wearable Sensors and Non-wearable Techniques
Fatima Jinnah Women University（法蒂玛·真纳女子大学）；University of Engineering and Technology, Taxila（塔克西拉工程技术大学）；Bahria University（巴哈里亚大学）；Children’s National Hospital（国家儿童医院）；George Washington University（乔治华盛顿大学）；Electronics and Telecommunications Research Institute (ETRI)（电子与电信研究所（ETRI））
Aamir Arsalan, Muhammad Majid, Imran Fareed Nizami, Waleed Manzoor, Syed Muhammad Anwar, Jihyoung Ryu
This paper presents a comprehensive review of methods covering significant subjective and objective human stress detection techniques available in the literature. The methods for measuring human stress responses could include subjective questionnaires (developed by psychologists) and objective markers observed using data from wearable and non-wearable sensors. In particular, wearable sensor-based methods commonly use data from electroencephalography, electrocardiogram, galvanic skin response, electromyography, electrodermal activity, heart rate, heart rate variability, and photoplethysmography both individually and in multimodal fusion strategies. Whereas, methods based on non-wearable sensors include strategies such as analyzing pupil dilation and speech, smartphone data, eye movement, body posture, and thermal imaging. Whenever a stressful situation is encountered by an individual, physiological, physical, or behavioral change is induced which help in coping with the challenge at hand. A wide range of studies has attempted to establish a relationship between these stressful situations and the response of human beings by using different kinds of psychological, physiological, physical, and behavioral measures. Inspired by the lack of availability of a definitive verdict about the relationship of human stress with these different kinds of markers, a detailed survey about human stress detection methods is conducted in this paper. In particular, we explore how stress detection methods can benefit from artificial intelligence utilizing relevant data from various sources. This review will prove to be a reference document that would provide guidelines for future research enabling effective detection of human stress conditions.
Wearable Meets LLM for Stress Management: A Duoethnographic Study Integrating Wearable-Triggered Stressors and LLM Chatbots for Personalized Interventions
University of Memphis（孟菲斯大学）；Virginia Tech（弗吉尼亚理工大学）
Affect recognition aims to detect a person's affective state based on observables, with the goal to e.g. provide reasoning for decision making or support mental wellbeing. Recently, besides approaches based on audio, visual or text information, solutions relying on wearable sensors as observables (recording mainly physiological and inertial parameters) have received increasing attention. Wearable systems offer an ideal platform for long-term affect recognition applications due to their rich functionality and form factor. However, existing literature lacks a comprehensive overview of state-of-t…
CogAdapt: Adapting Clinical ECG Foundation Models for Wearable Cognitive Load Assessment
Department of Computer Science, College of AI, Cyber and Computing, The University of Texas at San Antonio（计算机科学系，人工智能、网络与计算学院，德克萨斯大学圣安东尼奥分校）；Department of Educational Psychology, College of Education and Human Development, The University of Texas at San Antonio（教育心理学系，教育与人类发展学院，德克萨斯大学圣安东尼奥分校）
With the development of wearable technologies, a new kind of healthcare data has become valuable as medical information. These data provide meaningful information regarding an individual's physiological and psychological states, such as activity level, mood, stress, and cognitive health. These biomarkers are named digital since they are collected from digital devices integrated with various sensors. In this study, we explore digital biomarkers related to stress modality by examining data collected from mobile phones and smartwatches. We utilize machine learning techniques on the Tesserae datas…
Khoury College of Computer Sciences, Northeastern University（东北大学计算机科学学院）；Bouvé College of Health Sciences, Northeastern University（东北大学健康科学学院）；Department of Biostatistics, Harvard T.H. Chan School of Public Health（哈佛T.H. Chan公共卫生学院生物统计学系）
Wearable sensors are widely used to collect physiological data and develop stress detection models. However, most studies focus on a single dataset, rarely evaluating model reproducibility across devices, populations, or study conditions. We previously assessed the reproducibility of stress detection models across multiple studies, testing models trained on one dataset against others using heart rate (with R-R interval) and electrodermal activity (EDA). In this study, we extended our stress detection reproducibility to consumer wearable sensors. We compared validated research-grade devices, to…
Fatigue is a broad, multifactorial concept that includes the subjective perception of reduced physical and mental energy levels. It is also one of the key factors that strongly affect patients' health-related quality of life. To date, most fatigue assessment methods were based on self-reporting, which may suffer from many factors such as recall bias. To address this issue, in this work, we recorded multi-modal physiological data (including ECG, accelerometer, skin temperature and respiratory rate, as well as demographic information such as age, BMI) in free-living environments and developed au…
Past research on recognizing human affect has made use of a variety of physiological sensors in many ways. Nonetheless, how affective dynamics are influenced in the context of human daily life has not yet been explored. In this work, we present a wearable affective life-log system (ALIS), that is robust as well as easy to use in daily life to detect emotional changes and determine their cause-and-effect relationship on users' lives. The proposed system records how a user feels in certain situations during long-term activities with physiological sensors. Based on the long-term monitoring, the s…
The incorporation of empathic systems in everyday life draws a lot of attention from society. Specifically, the use of wearables to perform stress regulation is a growing field of research. Among techniques explored, the haptic emulation of lowered physiological signals has been suggested to be promising. However, some discrepancies remain in empirical research focusing on such biofeedback (BF) regarding their efficacy, and the mechanisms underlying the effects of these wearables remains unclear. Moreover, the influence of individual traits on the efficiency of BF has been marginally studied, …
The rapid growth of the availability of wearable biosensors has created the opportunity for using biological signals to measure worker performance. An important question is how to use such signals to not just measure, but actually predict worker performance on a task under stressful and potentially high risk conditions. Here we show that the biological signal known as galvanic skin response (GSR) allows such a prediction. We conduct an experiment where subjects answer arithmetic questions under low and high stress conditions while having their GSR monitored using a wearable biosensor. Using on…
The advent of IoT has enabled the design of connected and integrated smart health monitoring systems. These smart health monitoring systems could be realized in a smart home context to render long-term care to the elderly population. In this paper, we present the design of a wearable health monitoring system suitable for older adults in a smart home context. The proposed system offers solutions to monitor the stress, blood pressure, and location of an individual within a smart home environment. The stress detection model proposed in this work uses Electrodermal Activity (EDA), Photoplethysmogr…
Aalto University（阿尔托大学）；Helsinki University Hospital（赫尔辛基大学医院）；University of Helsinki（赫尔辛基大学）；Tampere University（坦佩雷大学）
Infant motility assessment using intelligent wearables is a promising new approach for assessment of infant neurophysiological development, and where efficient signal analysis plays a central role. This study investigates the use of different end-to-end neural network architectures for processing infant motility data from wearable sensors. We focus on the performance and computational burden of alternative sensor encoder and time-series modelling modules and their combinations. In addition, we explore the benefits of data augmentation methods in ideal and non-ideal recording conditions. The ex…
University of Maryland, Baltimore County（马里兰大学巴尔的摩县分校）；University of Maryland, Baltimore（马里兰大学巴尔的摩分校）
Cognitive impairment has become epidemic in older adult population. The recent advent of tiny wearable and ambient devices, a.k.a Internet of Things (IoT) provides ample platforms for continuous functional and cognitive health assessment of older adults. In this paper, we design, implement and evaluate AutoCogniSys, a context-aware automated cognitive health assessment system, combining the sensing powers of wearable physiological (Electrodermal Activity, Photoplethysmography) and physical (Accelerometer, Object) sensors in conjunction with ambient sensors. We design appropriate signal process…
Newcastle University（纽卡斯尔大学）；Great North Childrens Hospital（大北方儿童医院）；Georgia Institute of Technology（佐治亚理工学院）
Perinatal stroke (PS) is a serious condition that, if undetected and thus untreated, often leads to life-long disability, in particular Cerebral Palsy (CP). In clinical settings, Prechtl's General Movement Assessment (GMA) can be used to classify infant movements using a Gestalt approach, identifying infants at high risk of developing PS. Training and maintenance of assessment skills are essential and expensive for the correct use of GMA, yet many practitioners lack these skills, preventing larger-scale screening and leading to significant risks of missing opportunities for early detection and…
State Anxiety Biomarker Discovery: Electrooculography and Electrodermal Activity in Stress Monitoring
Andrew and Peggy Cherng Department of Medical Engineering, Division of Engineering and Applied Science, California Institute of Technology（加州理工学院工程与应用科学分院安德鲁和佩奇·切尔格医学工程系）；Dartmouth Hitchcock Medical Center and Clinics（达特茅斯-希区柯克医疗中心及诊所）
Hainan Rural Credit Union（海南省农村信用社联合社）；University of Warwick（华威大学）；Nanjing Normal University（南京师范大学）；Newcastle University（纽卡斯尔大学）
Stroke is known as a major global health problem, and for stroke survivors it is key to monitor the recovery levels. However, traditional stroke rehabilitation assessment methods (such as the popular clinical assessment) can be subjective and expensive, and it is also less convenient for patients to visit clinics in a high frequency. To address this issue, in this work based on wearable sensing and machine learning techniques, we develop an automated system that can predict the assessment score in an objective manner. With wrist-worn sensors, accelerometer data is collected from 59 stroke surv…
Being able to assess dog personality can be used to, for example, match shelter dogs with future owners, and personalize dog activities. Such an assessment typically relies on experts or psychological scales administered to dog owners, both of which are costly. To tackle that challenge, we built a device called "Patchkeeper" that can be strapped on the pet's chest and measures activity through an accelerometer and a gyroscope. In an in-the-wild deployment involving 12 healthy dogs, we collected 1300 hours of sensor activity data and dog personality test results from two validated questionnaire…
ECG is an attractive option to assess stress in serious Virtual Reality (VR) applications due to its non-invasive nature. However, the existing Machine Learning (ML) models perform poorly. Moreover, existing studies only perform a binary stress assessment, while to develop a more engaging biofeedback-based application, multi-level assessment is necessary. Existing studies annotate and classify a single experience (e.g. watching a VR video) to a single stress level, which again prevents design of dynamic experiences where real-time in-game stress assessment can be utilized. In this paper, we re…
Stress detection and classification from wearable sensor data is an emerging area of research with significant implications for individuals' physical and mental health. In this work, we introduce a new dataset, ADARP, which contains physiological data and self-report outcomes collected in real-world ambulatory settings involving individuals diagnosed with alcohol use disorders. We describe the user study, present details of the dataset, establish the significant correlation between physiological data and self-reported outcomes, demonstrate stress classification, and make our dataset public to …
Energy Autonomous Wearable Sensors (EAWS) have attracted a large interest due to their potential to provide reliable measurements and continuous bioelectric signals, which help to reduce health risk factors early on, ongoing assessment for disease prevention, and maintaining optimum, lifelong health quality. This review paper presents recent developments and state-of-the-art research related to three critical elements that enable an EAWS. The first element is wearable sensors, which monitor human body physiological signals and activities. Emphasis is given on explaining different types of tran…
Wearables equipped with pervasive sensors enable us to monitor physiological and behavioral signals in our everyday life. We propose the WellAff system able to recognize affective states for wellbeing support. It also includes health care scenarios, in particular patients with chronic kidney disease (CKD) suffering from bipolar disorders. For the need of a large-scale field study, we revised over 50 off-the-shelf devices in terms of usefulness for emotion, stress, meditation, sleep, and physical activity recognition and analysis. Their usability directly comes from the types of sensors they po…
Eindhoven University of Technology（埃因霍温理工大学）；Philips Research（飞利浦研究院）
Stress can be seen as a physiological response to everyday emotional, mental and physical challenges. A long-term exposure to stressful situations can have negative health consequences, such as increased risk of cardiovascular diseases and immune system disorder. Therefore, a timely stress detection can lead to systems for better management and prevention in future circumstances. In this paper, we suggest a multi-task learning based neural network approach (with hard parameter sharing of mutual representation and task-specific layers) for personalized stress recognition using skin conductance …
In today's fast-paced world, stress has become a growing health concern. While more automatic stress tracking technologies have recently become available on wearable or mobile devices, there is still a limited understanding of how they are actually used in everyday life. This paper presents an empirical study of automatic stress-tracking technologies in use in China, based on semi-structured interviews with 17 users. The study highlights three challenges of stress-tracking data engagement that prevent effective technology usage: the lack of immediate awareness, the lack of pre-required knowled…
Software development is intellectual, based on collaboration, and performed in a highly demanding economic market. As such, it is dominated by time pressure, stress, and emotional trauma. While studies of affect are emerging and rising in software engineering research, stress has yet to find its place in the literature despite that it is highly related to affect. In this paper, we study stress coping with the affect-laden framework of Salutogenesis, which is a validated psychological framework for enhancing mental health through a feeling of coherence. We propose a controlled experiment for te…
Emotion Recognition in Older Adults with Quantum Machine Learning and Wearable Sensors
Department of Electrical Engineering and Computer Science（电气工程与计算机科学系）；University of Tennessee, Knoxville, TN, USA（田纳西大学，诺克斯维尔分校）；Quantum Science Center, Oak Ridge National Laboratory, Oak Ridge, TN, USA（橡树岭国家实验室量子科学中心）
University of California, Irvine（加利福尼亚大学欧文分校）；School of Nursing（护理学院）
The stress detection problem is receiving great attention in related research communities. This is due to its essential part in behavioral studies for many serious health problems and physical illnesses. There are different methods and algorithms for stress detection using different physiological signals. Previous studies have already shown that Galvanic Skin Response (GSR), also known as Electrodermal Activity (EDA), is one of the leading indicators for stress. However, the GSR signal itself is not trivial to analyze. Different features are extracted from GSR signals to detect stress in peopl…
