arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.23265cs.HC
收藏

VRSL:探索360度摄像机 feed 在虚拟现实中用于手语交流的可理解性

VRSL:Exploring the Comprehensibility of 360-Degree Camera Feeds for Sign Language Communication in Virtual Reality

Rochester Institue of Technology(罗切斯特理工学院)

Gauri Umesh Rajmane, Ziming Li, Tae Oh, Roshan Peiris

AI总结:

本研究通过分析不同摄像位置对VR中手语可理解性的影响,发现肩部摄像位置效果最佳,但需优化摄像角度和减少失真以提升手语交流的可及性。

摘要:

本研究探讨如何将手语融入虚拟现实(VR)中,通过分析使用身体佩戴式360度摄像机录制的美国手语(ASL)视频的可理解性和用户体验。十名参与者从三个身体佩戴位置(头部、肩部和胸部)录制的视频中识别手语符号。结果显示,肩部佩戴的摄像机取得了最高准确性(85%),但不同位置之间的差异在统计上并不显著。参与者指出,360度视频中的边缘失真影响了清晰度,凸显了改进的必要性。尽管存在挑战,83.3%的整体理解成功率显示了基于视频的ASL在VR中的潜力。反馈强调需要优化摄像角度、减少失真并探索其他安装位置。参与者表达了在VR中更倾向于手语而非基于文本的交流,突显了开发此方法以增强聋人和听力障碍者在虚拟环境中的可及性和协作的重要性。

英文摘要:

This study explores integrating sign language into virtual reality (VR) by examining the comprehensibility and user experience of viewing American Sign Language (ASL) videos captured with body-mounted 360-degree cameras. Ten participants identified ASL signs from videos recorded at three body-mounted positions: head, shoulder, and chest. Results showed the shoulder-mounted camera achieved the highest accuracy (85%), though differences between positions were not statistically significant. Participants noted that peripheral distortion in 360-degree videos impacted clarity, highlighting areas for improvement. Despite challenges, the overall comprehension success rate of 83.3% demonstrates the potential of video-based ASL communication in VR. Feedback emphasized the need to refine camera angles, reduce distortion, and explore alternative mounting positions. Participants expressed a preference for signing over text-based communication in VR, highlighting the importance of developing this approach to enhance accessibility and collaboration for Deaf and Hard of Hearing (DHH) users in virtual environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑