arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.11346cs.HC
收藏

智能眼镜的非语言免提控制:基于牙齿点击

Non-verbal Hands-free Control for Smart Glasses using Teeth Clicks

Payal Mohapatra, Ali Aroudi, Anurag Kumar, Morteza Khaleghimeybodi

AI总结:

针对智能眼镜传统控制方式不隐蔽且受噪声影响的问题,提出基于牙齿点击振动感知的STEALTHsense方法,利用轻量神经网络实现免提控制,跨人准确率达0.93。

摘要:

智能眼镜正成为一种流行的可穿戴计算平台,有可能彻底改变下一代人机交互。智能眼镜的广泛采用创造了对隐蔽且免提控制方法的迫切需求。传统输入技术,如语音命令或触觉手势,可能具有侵入性且不够隐蔽。此外,基于语音的控制在嘈杂的声学环境中可能无法良好运行。我们提出了一种新颖、隐蔽、非语言且非触觉的方法,通过牙齿点击在皮肤上引起的微妙振动来控制智能眼镜。我们证明,这些振动可以被嵌入眼镜中的加速度计配合低开销预测模型感知。我们提出的方法名为STEALTHsense,利用基于时间广播的神经网络架构,仅需88K可训练参数和每次推理单元7.14M乘加运算(MMAC)。我们将提出的STEALTHsense与最先进的深度学习方法及传统低开销机器学习方法进行了基准比较。我们开展了一项涉及21名参与者的研究,收集两种不同牙齿点击模式及许多非模式的代表性样本,以对STEALTHsense进行稳健训练,实现了平均跨人准确率0.93。现场测试证实了其有效性,即使在嘈杂条件下也是如此,凸显了STEALTHsense在实际应用中的潜力,为智能眼镜交互提供了一种有前景的解决方案。

英文摘要:

Smart glasses are emerging as a popular wearable computing platform potentially revolutionizing the next generation of human-computer interaction. The widespread adoption of smart glasses has created a pressing need for discreet and hands-free control methods. Traditional input techniques, such as voice commands or tactile gestures, can be intrusive and non-discreet. Additionally, voice-based control may not function well in noisy acoustic conditions. We propose a novel, discreet, non-verbal, and non-tactile approach to controlling smart glasses through subtle vibrations on the skin induced by teeth clicking. We demonstrate that these vibrations can be sensed by accelerometers embedded in the glasses with a low-footprint predictive model. Our proposed method, called STEALTHsense, utilizes a temporal broadcasting-based neural network architecture with just 88K trainable parameters and 7.14M Multiply and Accumulate (MMAC) per inference unit. We benchmark our proposed STEALTHsense against state-of-the-art deep learning approaches and traditional low-footprint machine learning approaches. We conducted a study across 21 participants to collect representative samples for two distinct teeth-clicking patterns and many non-patterns for robust training of STEALTHsense, achieving an average cross-person accuracy of 0.93. Field testing confirmed its effectiveness, even in noisy conditions, underscoring STEALTHsense's potential for real-world applications, offering a promising solution for smart glasses interaction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑