arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.04142cs.HC
收藏

基于360°视频的脑电图信号人类情绪分析与识别

Human Emotions Analysis and Recognition Using EEG Signals in Response to 360$^\circ$ Videos

Haseeb ur Rahman Abbasi, Zeeshan Rashid, Muhammad Majid, Syed Muhammad Anwar

AI总结:

本研究利用EEG信号和VR环境,通过四阶段方法(数据采集、预处理、特征提取、分类)构建3D VR数据集,实现情绪识别,10折交叉验证平均准确率85.54%,测试准确率82.03%。

摘要:

情绪识别(ER)技术是开发诸如嗜睡检测和健康监测等创新应用不可或缺的组成部分,这些应用在当代社会中发挥着关键作用。本研究深入探讨了在沉浸式虚拟现实(VR)环境中使用脑电图(EEG)进行情绪识别的方法。我们提出的方法主要包括四个阶段:数据采集、预处理、特征提取和情绪分类。鉴于现有2D数据集的局限性,我们引入了一个开创性的3D VR数据集,以提升情绪诱发的精确度。利用Interaxon Muse头带进行EEG记录,并使用Oculus Quest 2呈现VR刺激,我们精心记录了40名参与者的数据,优先选择无报告精神疾病的受试者。预处理阶段包括严格的清洁、统一截断以及对EEG数据应用Savitzky-Golay滤波器。特征提取涵盖了对功率谱密度、相关性、有理不对称性和分式不对称性以及功率谱等指标的全面分析。为确保模型的稳健性,我们采用了10折交叉验证,结果显示平均验证准确率为85.54%,其中最佳折的显著最高准确率达到90.20%。随后,训练好的模型在测试集上展现了令人称赞的82.03%准确率,预示着良好的应用前景。

英文摘要:

Emotion recognition (ER) technology is an integral part for developing innovative applications such as drowsiness detection and health monitoring that plays a pivotal role in contemporary society. This study delves into ER using electroencephalography (EEG), within immersive virtual reality (VR) environments. There are four main stages in our proposed methodology including data acquisition, pre-processing, feature extraction, and emotion classification. Acknowledging the limitations of existing 2D datasets, we introduce a groundbreaking 3D VR dataset to elevate the precision of emotion elicitation. Leveraging the Interaxon Muse headband for EEG recording and Oculus Quest 2 for VR stimuli, we meticulously recorded data from 40 participants, prioritizing subjects without reported mental illnesses. Pre-processing entails rigorous cleaning, uniform truncation, and the application of a Savitzky-Golay filter to the EEG data. Feature extraction encompasses a comprehensive analysis of metrics such as power spectral density, correlation, rational and divisional asymmetry, and power spectrum. To ensure the robustness of our model, we employed a 10-fold cross-validation, revealing an average validation accuracy of 85.54\%, with a noteworthy maximum accuracy of 90.20\% in the best fold. Subsequently, the trained model demonstrated a commendable test accuracy of 82.03\%, promising favorable outcomes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑