人类在交互时听到什么?用于评估口语对话系统ASR的选择性听力实验
What Do Humans Hear When Interacting? Experiments on Selective Listening for Evaluating ASR of Spoken Dialogue Systems
AI总结:
本研究通过实验确认人类在生成对话响应时存在选择性听力,并探讨利用该特性评估ASR系统与人类转录能力差距的新方法。
摘要:
口语对话系统(SDSs)在其处理流程的前端使用自动语音识别(ASR)。ASR在SDSs中的作用是适当识别与响应生成相关的用户语音中的信息。考察人类的选择性听力——即在对话过程中聚焦并听取重要部分的能力——将使我们能够识别SDSs所需的ASR能力并对其进行评估。在本研究中,我们通过比较人类为生成对话响应而进行的转录与参考转录,实验性地确认了人类在生成对话响应时的选择性听力。基于我们的实验结果,我们讨论了一种利用人类选择性听力的新型ASR评估方法的可能性,该方法能够识别ASR系统与人类之间转录能力的差距。
英文摘要:
Spoken dialogue systems (SDSs) utilize automatic speech recognition (ASR) at the front end of their pipeline. The role of ASR in SDSs is to recognize information in user speech related to response generation appropriately. Examining selective listening of humans, which refers to the ability to focus on and listen to important parts of a conversation during the speech, will enable us to identify the ASR capabilities required for SDSs and evaluate them. In this study, we experimentally confirmed selective listening when humans generate dialogue responses by comparing human transcriptions for generating dialogue responses and reference transcriptions. Based on our experimental results, we discuss the possibility of a new ASR evaluation method that leverages human selective listening, which can identify the gap between transcription ability between ASR systems and humans.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。