arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.26508cs.HCcs.CV
收藏

预算感知的无键盘交互

Budget-Aware Keyboardless Interaction

University of Science, Ho Chi Minh city, Vietnam(胡志明市科学大学);Vietnam National University, Ho Chi Minh city, Vietnam(越南国家大学)

Quang-Thang Nguyen, Gia-Phuc Song-Dong, Minh-Triet Tran, Trung-Nghia Le

AI总结:

提出一种仅用标准摄像头和打印键盘布局的虚拟键盘系统,结合现代分割检测与传统图像处理实现低成本键盘交互。

摘要:

与计算机交互通常依赖于传统输入设备,如键盘、鼠标和显示器,这对于寻求更高移动性的用户来说可能很笨重。虚拟键盘已被探索来解决这些限制,但它们通常涉及复杂的设置或昂贵的设备。本文提出了一种新颖的虚拟键盘系统,仅利用标准摄像头和带有打印键盘布局的纸张。与之前需要复杂校准或特殊照明条件的方法不同,我们的方法可以使用现代计算机视觉技术在标准环境中工作。将现代分割和检测模型与传统图像处理算法相结合,我们高效地识别键盘区域。触摸检测通过分析用户指甲颜色的算法进行。实验表明,我们提出的键盘和按键检测解决方案在实际应用中取得了有希望的结果。参加我们用户研究的参与者也觉得所提出的系统很有趣。

英文摘要:

Interacting with computers typically relies on traditional input devices such as keyboards, mice, and monitors, which can be cumbersome for users seeking greater mobility. Virtual keyboards have been explored to address these limitations, but they often involve complex setups or expensive equipment. This paper proposes a novel virtual keyboard system that leverages only a standard camera and a paper with a printed keyboard layout. Unlike previous methods requiring complex calibration or special lighting conditions, our approach can work on standard environment using modern computer vision technologies. Combining modern segmentation and detection models with traditional image processing algorithms, we efficiently identify the keyboard region. Touch detection is performed using an algorithm analyzing the color of the user's fingernail. Experiments demonstrated a promising results our proposed solution of keyboard and keystroke detection for practical applications. Participants attended our user study also found the proposed system interesting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑