基于视觉的认知训练会话中疲劳与参与度估计
Vision-based Estimation of Fatigue and Engagement in Cognitive Training Sessions
AI总结:
本研究提出循环视频变换器(RVT)方法,通过视频面部手势实时监测轻度认知障碍老年人在认知训练中的精神疲劳,达到78%平衡准确率,为个性化训练奠定基础。
摘要:
计算机化认知训练(CCT)是一种可扩展且耐受性良好的干预措施,有望减缓认知衰退。然而,CCT的效果受到缺乏有效参与的限制,而精神疲劳等因素会降低参与度,尤其是在有痴呆风险的老年人中。因此,需要可扩展的自动化措施来监测CCT期间的精神疲劳。在此,我们开发并验证了一种新颖的循环视频变换器(RVT)方法,用于通过CCT期间视频记录的面部手势实时监测轻度认知障碍老年人的精神疲劳。与先前最先进的模型相比,RVT模型在精神疲劳的二分类和多分类任务中取得了最高的平衡准确率(78%)和精确率(0.82),并通过与CCT反应时间的显著关联(p=0.023)进一步验证。通过利用动态时间信息,RVT模型展示了准确测量实时精神疲劳的潜力,为未来个性化CCT以提高有效参与奠定了基础。
英文摘要:
Computerized cognitive training (CCT) is a scalable, well-tolerated intervention that has promise for slowing cognitive decline. Outcomes from CCT are limited by a lack of effective engagement, which is decreased by factors such as mental fatigue, particularly in older adults at risk for dementia. There is a need for scalable, automated measures that can monitor mental fatigue during CCT. Here, we develop and validate a novel Recurrent Video Transformer (RVT) method for monitoring real-time mental fatigue in older adults with mild cognitive impairment from video-recorded facial gestures during CCT. The RVT model achieved the highest balanced accuracy(78%) and precision (0.82) compared to the prior state-of-the-art models for binary and multi-class classification of mental fatigue and was additionally validated via significant association (p=0.023) with CCT reaction time. By leveraging dynamic temporal information, the RVT model demonstrates the potential to accurately measure real-time mental fatigue, laying the foundation for future personalized CCT that increase effective engagement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。