arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.08237cs.HCcs.CY
收藏

扩展现实中的认知评估与训练:多模态系统、临床效用及当前挑战

Cognitive Assessment and Training in Extended Reality: Multimodal Systems, Clinical Utility, and Current Challenges

Palmira Victoria González-Erena, Sara Fernández-Guinea, Panagiotis Kourtesis

AI总结:

本综述梳理了XR技术在认知评估与训练中的应用优势、多模态系统现状、临床推广面临的挑战及优化方向,为相关工具改进以服务多元群体提供参考。

摘要:

扩展现实(XR)技术涵盖虚拟现实(VR)、增强现实(AR)和混合现实(MR),通过提供模拟真实世界任务的沉浸式交互环境,正在变革认知评估与训练领域。XR在提升生态效度的同时,还能通过皮肤电反应(GSR)、脑电图(EEG)、眼动追踪(ET)、手部追踪和身体追踪等工具实现实时多模态数据采集。这使得研究人员能够更全面地理解认知和情绪过程,并为用户提供自适应的个性化干预方案。尽管取得了这些进展,当前的XR应用往往未能充分发挥多模态整合的潜力,主要依赖视觉和听觉输入。晕动症、可用性问题以及可及性障碍等挑战进一步限制了XR工具在认知科学和临床实践中的广泛应用。本综述梳理了基于XR的认知评估与训练研究,重点阐述了其相较于传统方法的优势,包括生态效度、参与度和自适应性。同时探讨了尚未解决的挑战,如系统可用性、成本以及多模态反馈整合的需求。综述最后指出了优化XR工具的机遇,以改善认知评估和康复效果,尤其是针对老年人群和认知障碍患者等多元群体。

英文摘要:

Extended reality (XR) technologies-encompassing virtual reality (VR), augmented reality (AR), and mixed reality (MR) are transforming cognitive assessment and training by offering immersive, interactive environments that simulate real-world tasks. XR enhances ecological validity while enabling real-time, multimodal data collection through tools such as galvanic skin response (GSR), electroencephalography (EEG), eye tracking (ET), hand tracking, and body tracking. This allows for a more comprehensive understanding of cognitive and emotional processes, as well as adaptive, personalized interventions for users. Despite these advancements, current XR applications often underutilize the full potential of multimodal integration, relying primarily on visual and auditory inputs. Challenges such as cybersickness, usability concerns, and accessibility barriers further limit the widespread adoption of XR tools in cognitive science and clinical practice. This review examines XR-based cognitive assessment and training, focusing on its advantages over traditional methods, including ecological validity, engagement, and adaptability. It also explores unresolved challenges such as system usability, cost, and the need for multimodal feedback integration. The review concludes by identifying opportunities for optimizing XR tools to improve cognitive evaluation and rehabilitation outcomes, particularly for diverse populations, including older adults and individuals with cognitive impairments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑