Mazed and Confused:一项VR真实行走任务期间的晕动症、工作记忆、心理负荷、生理负荷与注意力数据集
Mazed and Confused: A Dataset of Cybersickness, Working Memory, Mental Load, Physical Load, and Attention During a Real Walking Task in VR
AI总结:
本研究发布了含39名受试者VR真实行走场景下多模态数据与认知、生理负荷及晕动症标注的开放数据集,经实验验证其可支撑高准确率的晕动症分类,为相关模型开发与VR体验优化提供数据基础。
摘要:
虚拟现实(VR)正迅速在培训、教育、医疗和娱乐等多个行业落地,这些场景中用户通常需要开展多项复杂的认知与身体活动。然而,认知活动、身体活动与常见的晕动症感受之间的关联尚不明确,因此对开发者而言具备不可预测性。此前研究者已提供了用户静止状态下用于预测晕动症的标注数据集,但针对用户真实行走过程中晕动症的标注数据集仍十分匮乏。\n为此,我们招募了39名受试者,采集了他们在VR环境中的头部朝向、头部位置、眼动追踪数据、图像、外部传感器获取的生理读数,以及自我报告的晕动症严重程度、生理负荷和心理负荷数据。在整个数据采集过程中,受试者通过真实行走穿越迷宫,并完成考验其注意力和工作记忆的任务。为验证该数据集的实用性,我们开展了训练分类器的案例研究,最终在晕动症严重程度分类任务上达到了95%的准确率。简易分类器的出色表现表明该数据集非常适合后续研究者开发晕动症检测与缓解模型。为进一步明确助力分类的关键特征,我们进行了SHAP(SHapley Additive exPlanations,沙普利可加性解释)分析,凸显了行走过程中眼动追踪和生理测量指标对晕动症预测的重要性。\n该开放数据集可供后续研究者研究晕动症与认知负荷之间的关联,并开发预测模型。它还将帮助未来的VR开发者优化认知负荷管理、最大程度降低晕动症,从而设计出高效实用的虚拟环境。
英文摘要:
Virtual Reality (VR) is quickly establishing itself in various industries, including training, education, medicine, and entertainment, in which users are frequently required to carry out multiple complex cognitive and physical activities. However, the relationship between cognitive activities, physical activities, and familiar feelings of cybersickness is not well understood and thus can be unpredictable for developers. Researchers have previously provided labeled datasets for predicting cybersickness while users are stationary, but there have been few labeled datasets on cybersickness while users are physically walking. Thus, from 39 participants, we collected head orientation, head position, eye tracking, images, physiological readings from external sensors, and the self-reported cybersickness severity, physical load, and mental load in VR. Throughout the data collection, participants navigated mazes via real walking and performed tasks challenging their attention and working memory. To demonstrate the dataset's utility, we conducted a case study of training classifiers in which we achieved 95% accuracy for cybersickness severity classification. The noteworthy performance of the straightforward classifiers makes this dataset ideal for future researchers to develop cybersickness detection and reduction models. To better understand the features that helped with classification, we performed SHAP(SHapley Additive exPlanations) analysis, highlighting the importance of eye tracking and physiological measures for cybersickness prediction while walking. This open dataset can allow future researchers to study the connection between cybersickness and cognitive loads and develop prediction models. This dataset will empower future VR developers to design efficient and effective Virtual Environments by improving cognitive load management and minimizing cybersickness.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。