arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.09385cs.LGcs.AIeess.SP
收藏

采用多模态机器学习进行压力检测

Employing Multimodal Machine Learning for Stress Detection

Symbiosis Institute of Technology, Symbiosis International (Deemed University);Symbiosis Centre for Applied Artificial Intelligence, Symbiosis International (Deemed University)

Rahee Walambe, Pranav Nayak, Ashmit Bhardwaj, Ketan Kotecha

AI总结:

针对久坐职业引发的压力识别难题,提出融合多模态传感器数据的AI框架检测压力及程度、识别长期压力模式,测试准确率达96.09%,为久坐人群压力监测提供有效方案。

摘要:

当今时代,人类生活方式愈发以知识为导向,催生了久坐型职业,进而引发了诸多健康与精神障碍。心理健康是当今世界最受忽视却至关重要的领域之一,心理问题既会直接也会间接影响人体生理的其他部分,阻碍个人的日常活动与表现。然而,识别个体的压力并找出可能导致严重精神疾病的压力趋势颇具挑战性,且涉及多重因素。通过融合源自行为模式的这些多模态数据(由各类因素产生),可精准实现此类识别。现有文献已提出部分相关技术,但针对这类多模态融合任务,基于机器学习的方法仍十分有限。本研究提出了一种基于多模态AI的框架,用于监测个体的工作行为与压力水平。我们提出了一种方法,通过拼接异构原始传感器数据流(如面部表情、姿势、心率、计算机交互数据),高效检测由工作负荷引发的压力。这些数据可被安全存储与分析,以理解并发现导致精神紧张与疲劳的个性化独特行为模式。本研究的贡献有两点:一是提出基于多模态AI的融合策略以检测压力及其程度,二是识别一段时间内的压力模式。我们在压力检测与分类的测试集上达到了96.09%的准确率,此外,利用这些模态将压力量表预测模型的损失降至0.036。本研究对广大群体,尤其是从事久坐工作的人群监测与识别压力水平具有重要意义,在当前COVID-19疫情背景下尤为突出。

英文摘要:

In the current age, human lifestyle has become more knowledge oriented leading to generation of sedentary employment. This has given rise to a number of health and mental disorders. Mental wellness is one of the most neglected but crucial aspects of today's world. Mental health issues can, both directly and indirectly, affect other sections of human physiology and impede an individual's day-to-day activities and performance. However, identifying the stress and finding the stress trend for an individual leading to serious mental ailments is challenging and involves multiple factors. Such identification can be achieved accurately by fusing these multiple modalities (due to various factors) arising from behavioral patterns. Certain techniques are identified in the literature for this purpose; however, very few machine learning-based methods are proposed for such multimodal fusion tasks. In this work, a multimodal AI-based framework is proposed to monitor a person's working behavior and stress levels. We propose a methodology for efficiently detecting stress due to workload by concatenating heterogeneous raw sensor data streams (e.g., face expressions, posture, heart rate, computer interaction). This data can be securely stored and analyzed to understand and discover personalized unique behavioral patterns leading to mental strain and fatigue. The contribution of this work is twofold; proposing a multimodal AI-based strategy for fusion to detect stress and its level and secondly identify a stress pattern over a period of time. We were able to achieve 96.09% accuracy on the test set in stress detection and classification. Further, we reduce the stress scale prediction model loss to 0.036 using these modalities. This work can prove important for the community at large, specifically those working sedentary jobs to monitor and identify stress levels, especially in current times of COVID-19.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑