以自我为中心的视频:一种在家中捕捉脊髓损伤个体手部使用情况的新工具
Egocentric Video: A New Tool for Capturing Hand Use of Individuals with Spinal Cord Injury at Home
AI总结:
本文提出一种基于可穿戴以自我为中心摄像和计算机视觉算法的系统,用于在家中定量监测颈段脊髓损伤患者的功能性手部使用,并通过实验验证了其可行性与有效性。
摘要:
目前针对颈段脊髓损伤(cSCI)个体的上肢结果测量方法缺乏在家庭和社区环境中直接收集定量信息的能力。本文提出了一种可穿戴的第一人称(以自我为中心)摄像系统,该系统能够在临床环境之外监测功能性手部使用情况。该系统基于计算机视觉算法,能够检测手部、分割手部轮廓、区分用户的左手或右手,并在日常生活活动中检测手部与物体的功能性交互。该算法使用来自9名cSCI参与者在家庭模拟实验室中获得的以自我为中心的视频记录进行评估。该系统基于反映手部运动线索、手部形状和场景颜色特征的特征,为每个视频帧生成一个二值的手-物交互决策。该输出与视频的人工标注进行了比较,左手获得的F1分数为0.74 ± 0.15,右手为0.73 ± 0.15。从所得的逐帧二值数据中提取了功能性手部使用指标:总交互量占测试时间的百分比、交互的平均持续时间(以秒为单位)以及每小时交互次数。将这些输出指标与人工标注结果进行比较时,发现了中等且显著的相关性,ρ分别为0.40、0.54和0.55。这些结果表明,可穿戴的以自我为中心摄像系统在捕捉家庭中手部使用的定量指标方面具有潜力。
英文摘要:
Current upper extremity outcome measures for persons with cervical spinal cord injury (cSCI) lack the ability to directly collect quantitative information in home and community environments. A wearable first-person (egocentric) camera system is presented that can monitor functional hand use outside of clinical settings. The system is based on computer vision algorithms that detect the hand, segment the hand outline, distinguish the user's left or right hand, and detect functional interactions of the hand with objects during activities of daily living. The algorithm was evaluated using egocentric video recordings from 9 participants with cSCI, obtained in a home simulation laboratory. The system produces a binary hand-object interaction decision for each video frame, based on features reflecting motion cues of the hand, hand shape and colour characteristics of the scene. This output was compared with a manual labelling of the video, yielding F1-scores of 0.74 $\pm$ 0.15 for the left hand and 0.73 $\pm$ 0.15 for the right hand. From the resulting frame-by-frame binary data, functional hand use measures were extracted: the amount of total interaction as a percentage of testing time, the average duration of interactions in seconds, and the number of interactions per hour. Moderate and significant correlations were found when comparing these output measures to the results of the manual labelling, with $ρ$ = 0.40, 0.54 and 0.55 respectively. These results demonstrate the potential of a wearable egocentric camera for capturing quantitative measures of hand use at home.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。