arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.03582cs.HC
收藏

不同类型的语音用户界面故障可能导致不同程度的挫折感

Different Types of Voice User Interface Failures May Cause Different Degrees of Frustration

Shiyoh Goetsu, Tetsuya Sakai

摘要:

我们报告的调查如何在语音用户界面(VUI)不同类型的故障影响用户的挫折。为此,我们进行了一项试点用户研究($n=10$)和一项主要用户研究($n=30$),这两项研究都使用了我们使用Alexa Skills Kit构建的简单语音操作日历应用程序。在我们的试点研究中,我们确定了用户感知的三种主要故障类型,即原因未知,语音识别错误和话语模式匹配失败,以及从开发人员的角度来看更细粒度的故障类型,如意图模式匹配失败和意图错误分类。然后,在我们的主要研究中,我们设置了三个用户任务,每个任务都被设计成一种特定的失败类型,并收集了每个任务的用户挫折评分。我们的主要发现是:(a)用户可能对用户感知的语音误识别相对容忍,而对用户感知的原因未知和话语模板匹配失败不那么容忍;(b)关于开发人员感知的和用户感知的失败类型之间的关系,68.8%的开发人员感知的意图误分类实例导致用户感知的原因未知失败。从(a)和(b)中,一个实际的设计含义是试图通过仔细制作每个意图的话语模式来防止意图错误分类的发生。

英文摘要:

We report on an investigation into how different types of failures in a voice user interface (VUI) affects user frustration. To this end, we conducted a pilot user study ($n=10$) and a main user study ($n=30$), both with a simple voice-operated calendar application that we built using the Alexa Skills Kit. In our pilot study, we identified three major failure types as perceived by the users, namely, Reason Unknown, Speech Misrecognition, and Utterance Pattern Match Failure, along with more fine-grained failure types from the developer's viewpoint such as Intent Pattern Match Failure and Intent Misclassification. Then, in our main study, we set up three user tasks that were designed to each induce a specific failure type, and collected user frustration ratings for each task. Our main findings are: (a)Users may be relatively tolerant to user-perceived Speech Misrecognition, and not so to user-perceived Reason Unknown and Utterance Mattern Match Failures; (b)Regarding the relationship between developer-perceived and user-perceived failure types, 68.8\% of developer-perceived Intent Misclassification instances caused user-perceived Reason Unkown failures. From (a) and (b), a practical design implication would be to try to prevent Intent Misclassification from happening by carefully crafting the utterance patterns for each intent.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑