arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.01755cs.HCcs.AIcs.SYeess.SY
收藏

基于非接触电容传感的运动手势识别实时的界面控制

Real-time Interface Control with Motion Gesture Recognition based on Non-contact Capacitive Sensing

Georgia State University(佐治亚州立大学)

Hunmin Lee, Jaya Krishna Mandivarapu, Nahom Ogbazghi, Yingshu Li

摘要:

电容式传感是一种突出的技术,与现有的传感系统相比,它具有成本效益高、功耗低、识别速度快的特点。由于这些优点,电容感测在触摸感测、定位、存在检测和接触感测接口应用(诸如人机交互)领域中得到了广泛的研究和商业化。然而,由于非接触式接近感测方案容易受到外围物体或周围环境的干扰的影响,因此它需要比接触感测相当敏感的数据处理,从而限制了其进一步利用的使用。本文提出了一种基于非接触式手势识别的实时的【形】界面控制框架,通过对原始信号进行处理,采用自适应阈值检测电容传感器附近手势运动所触发的电场扰动,并提取重要信号帧,覆盖真实信号区间,检测率和帧校正率分别为98.8%和98.4%。通过GRU模型与提取的信号帧训练,我们分类的10个手部运动姿态类型与98.79%的准确率。该框架传输分类结果,并根据输入操纵前台进程的界面。本研究提出了直观界面技术的可行性,它适应了灵活的人机之间的交互类似于自然用户界面,并提升了商业化的可能性的基础上测量电场干扰通过非接触式接近传感,这是最先进的传感技术。

英文摘要:

Capacitive sensing is a prominent technology that is cost-effective and low power consuming with fast recognition speed compared to existing sensing systems. On account of these advantages, Capacitive sensing has been widely studied and commercialized in the domains of touch sensing, localization, existence detection, and contact sensing interface application such as human-computer interaction. However, as a non-contact proximity sensing scheme is easily affected by the disturbance of peripheral objects or surroundings, it requires considerable sensitive data processing than contact sensing, limiting the use of its further utilization. In this paper, we propose a real-time interface control framework based on non-contact hand motion gesture recognition through processing the raw signals, detecting the electric field disturbance triggered by the hand gesture movements near the capacitive sensor using adaptive threshold, and extracting the significant signal frame, covering the authentic signal intervals with 98.8% detection rate and 98.4% frame correction rate. Through the GRU model trained with the extracted signal frame, we classify the 10 hand motion gesture types with 98.79% accuracy. The framework transmits the classification result and maneuvers the interface of the foreground process depending on the input. This study suggests the feasibility of intuitive interface technology, which accommodates the flexible interaction between human to machine similar to Natural User Interface, and uplifts the possibility of commercialization based on measuring the electric field disturbance through non-contact proximity sensing which is state-of-the-art sensing technology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑