arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.09134cs.HC
收藏

使用基于头部运动的手势的非接触式打字

Touchless Typing Using Head Movement-based Gestures

Shivam Rustagi, Aakash Garg, Pranay Raj Anand, Rajesh Kumar, Yaman Kumar, Rajiv Ratn Shah

摘要:

在本文中,我们提出了一种新的非接触式打字界面,利用屏幕上的QWERTY键盘和智能手机摄像头。键盘被分为九个颜色编码的集群。用户将头移向群集,群集包含他们想要键入的字母。一个前置智能手机摄像头记录了头部的运动。采用基于双向GRU的模型将记录转换为聚类序列,该模型使用预先训练的富含头部姿势特征的嵌入。该模型实现了96.78%和86.81%的准确率下,内部和用户间的情况下,分别从22个用户收集的2234个视频序列的数据集。

英文摘要:

In this paper, we propose a novel touchless typing interface that makes use of an on-screen QWERTY keyboard and a smartphone camera. The keyboard was divided into nine color-coded clusters. The user moved their head toward clusters, which contained the letters that they wanted to type. A front-facing smartphone camera recorded the head movements. A bidirectional GRU based model which used pre-trained embedding rich in head pose features was employed to translate the recordings into cluster sequences. The model achieved an accuracy of 96.78% and 86.81% under intra- and inter-user scenarios, respectively, over a dataset of 2234 video sequences collected from 22 users.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑