arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1608.07323cs.HC
收藏

比较触摸屏手机上两种语言的语音和键盘文本输入

Comparing Speech and Keyboard Text Entry for Short Messages in Two Languages on Touchscreen Phones

Sherry Ruan, Jacob O. Wobbrock, Kenny Liou, Andrew Ng, James Landay

摘要:

随着智能手机等移动触摸屏设备的普及,出现了两种广泛使用的文本输入方法:基于触摸的小型键盘和语音识别。尽管语音识别已经在台式计算机上可用多年,但是它继续以快速的步伐改进,并且目前不知道今天的现代语音识别器与最先进的移动触摸键盘相比如何,后者也从其开始以来已经有了相当大的改进。为了发现这两种方法的“上限性能”,我们在实验室环境中在Apple iPhone 6 Plus上用英语和普通话对它们进行了评估。我们的实验是使用百度的Deep Speech 2(一种基于深度学习的语音识别系统)和内置的QWERTY(英语)或拼音(普通话)Apple iOS键盘进行的。我们发现,在实验室条件下,对于这两种方法,使用语音识别,英语输入速度比键盘快2.93倍(153对52 WPM),普通话输入速度比键盘快2.87倍(123对43 WPM)。此外,虽然语音在输入过程中错误较少(5.30%对11.22%的纠正出错率),但在最终转录文本中留下的错误略多(1.30%对0.79%的未纠正出错率)。我们的研究结果表明,相对而言,在两种方法的理想条件下,上限语音识别性能相比以前的系统有了很大的提高,并可能在未来看到更大的吸收,虽然需要进一步的研究,以量化两种方法在非实验室环境中的性能。

英文摘要:

With the ubiquity of mobile touchscreen devices like smartphones, two widely used text entry methods have emerged: small touch-based keyboards and speech recognition. Although speech recognition has been available on desktop computers for years, it has continued to improve at a rapid pace, and it is currently unknown how today's modern speech recognizers compare to state-of-the-art mobile touch keyboards, which also have improved considerably since their inception. To discover both methods' "upper-bound performance," we evaluated them in English and Mandarin Chinese on an Apple iPhone 6 Plus in a laboratory setting. Our experiment was carried out using Baidu's Deep Speech 2, a deep learning-based speech recognition system, and the built-in Qwerty (English) or Pinyin (Mandarin) Apple iOS keyboards. We found that with speech recognition, the English input rate was 2.93 times faster (153 vs. 52 WPM), and the Mandarin Chinese input rate was 2.87 times faster (123 vs. 43 WPM) than the keyboard for short message transcription under laboratory conditions for both methods. Furthermore, although speech made fewer errors during entry (5.30% vs. 11.22% corrected error rate), it left slightly more errors in the final transcribed text (1.30% vs. 0.79% uncorrected error rate). Our results show that comparatively, under ideal conditions for both methods, upper-bound speech recognition performance has greatly improved compared to prior systems, and might see greater uptake in the future, although further study is required to quantify performance in non-laboratory settings for both methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑