WhisperWand:同步语音和手势跟踪界面
WhisperWand: Simultaneous Voice and Gesture Tracking Interface
摘要:
本文介绍了WhisperWand的设计和实现,一个全面的语音和运动跟踪接口的语音助手。与之前的作品不同,WhisperWand是一个精确的跟踪接口,可以与低采样率语音助手上的语音接口共存。以手写为具体应用,它还可以在只占用单一频率的情况下捕捉自然笔画和个性化的书写风格。核心技术包括一种称为交叉频率连续波(CFCW)声纳的精确声学测距方法,使语音助手能够使用超声波作为测距信号,同时使用语音助手的常规麦克风系统作为接收器。我们还设计了一个新的优化算法,只需要一个单一的频率的到达时间差。WhisperWand原型在使用语音助理中使用的麦克风阵列的声学信标的1D测距中实现了73 um的中值误差,在3D跟踪中实现了1.4 mm的中值误差。我们实现的空中手写界面实现了94.1%的准确率与自动手写到文本软件,类似于在纸上书写(96.6%)。与此同时,基于语音的用户认证的出错率仅从6.26%增加到8.28%。
英文摘要:
This paper presents the design and implementation of WhisperWand, a comprehensive voice and motion tracking interface for voice assistants. Distinct from prior works, WhisperWand is a precise tracking interface that can co-exist with the voice interface on low sampling rate voice assistants. Taking handwriting as a specific application, it can also capture natural strokes and the individualized style of writing while occupying only a single frequency. The core technique includes an accurate acoustic ranging method called Cross Frequency Continuous Wave (CFCW) sonar, enabling voice assistants to use ultrasound as a ranging signal while using the regular microphone system of voice assistants as a receiver. We also design a new optimization algorithm that only requires a single frequency for time difference of arrival. WhisperWand prototype achieves 73 um of median error for 1D ranging and 1.4 mm of median error in 3D tracking of an acoustic beacon using the microphone array used in voice assistants. Our implementation of an in-air handwriting interface achieves 94.1% accuracy with automatic handwriting-to-text software, similar to writing on paper (96.6%). At the same time, the error rate of voice-based user authentication only increases from 6.26% to 8.28%.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。