arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1809.05911cs.HC
收藏

物体遮挡下实时的手势识别的鲁棒定制方法

Robust and customized methods for real-time hand gesture recognition under object-occlusion

Zhishuai Han, Xiaojuan Ban, Xiaokun Wang, Di wu

摘要:

动态手部跟踪和手势识别是一项艰巨的任务,因为手指上有许多关节,每个关节拥有许多自由度。此外,目标遮挡也是手指跟踪和姿态识别中的一个棘手问题。因此,我们提出了一个强大的和定制的系统,实时手跟踪和手势识别遮挡环境下。首先对手部关键点之间的角度进行建模并编码其相对坐标向量,然后引入GAN生成原始离散序列数据集。其次,我们提出了一种时间序列预测方法来预测定义的手部关键点位置。最后,我们定义了一个滑动窗口匹配的方法来完成手势识别。我们分析了11种典型的手势,并展示了如何执行手势识别所提出的方法。我们的工作可以达到最先进的结果,并有助于建立一个框架,以实现定制的手势识别任务。

英文摘要:

Dynamic hand tracking and gesture recognition is a hard task since there are many joints on the fingers and each joint owns many degrees of freedom. Besides, object occlusion is also a thorny issue in finger tracking and posture recognition. Therefore, we propose a robust and customized system for realtime hand tracking and gesture recognition under occlusion environment. First, we model the angles between hand keypoints and encode their relative coordinate vectors, then we introduce GAN to generate raw discrete sequence dataset. Secondly we propose a time series forecasting method in the prediction of defined hand keypoint location. Finally, we define a sliding window matching method to complete gesture recognition. We analyze 11 kinds of typical gestures and show how to perform gesture recognition with the proposed method. Our work can reach state of the art results and contribute to build a framework to implement customized gesture recognition task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑