流状态绑定用于手语识别
Stream State-tying for Sign Language Recognition
AI总结:
本文提出基于六路同步数据流状态绑定的手语识别方法,在5177个中文手语上实现94.8%实时孤立识别率和91.4%连续识别词正确率。
摘要:
本文提出了一种新颖的手语识别方法,该方法基于在每个数据流中进行状态绑定。在该框架中,假设手部手势信号由六个同步数据流表示,即左手/右手位置、左手/右手方向以及左手/右手手形。这种方法提供了对手语空间的非常准确的表示,同时保持参数数量合理较小,有利于快速解码。实验针对5177个中文手语进行。实时孤立识别率为94.8%。对于连续手语识别,词正确率为91.4%。关键词:手语识别;自动手语翻译;手部手势识别;隐马尔可夫模型;状态绑定;多模态用户界面;虚拟现实;人机系统。
英文摘要:
In this paper, a novel approach to sign language recognition based on state tying in each of data streams is presented. In this framework, it is assumed that hand gesture signal is represented in terms of six synchronous data streams, i.e., the left/right hand position, left/right hand orientation and left/right handshape. This approach offers a very accurate representation of the sign space and keeps the number of parameters reasonably small in favor of a fast decoding. Experiments were carried out for 5177 Chinese signs. The real time isolated recognition rate is 94.8%. For continuous sign recognition, the word correct rate is 91.4%. Keywords: Sign language recognition; Automatic sign language translation; Hand gesture recognition; Hidden Markov models; State-tying; Multimodal user interface; Virtual reality; Man-machine systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。