arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.04641eess.AScs.CL
收藏

基于音频前缀低秩适配语言模型的推测式语音识别

Speculative Speech Recognition by Audio-Prefixed Low-Rank Adaptation of Language Models

Google Inc.(谷歌公司);Bogazici University(海峡大学);Brno University of Technology(布尔诺理工大学)

Bolaji Yusuf, Murali Karthick Baskar, Andrew Rosenberg, Bhuvana Ramabhadran

AI总结:

本文提出推测式语音识别(SSR),通过将RNN-Transducer ASR与音频前缀语言模型结合,使识别器能先于音频预测转录补全,实验证明该方法可有效降低ASR延迟。

摘要:

本文探讨推测式语音识别(SSR),我们赋予传统自动语音识别(ASR)推测能力,使识别器能够先于音频运行。我们引入了一种衡量SSR性能的指标,并提出了一种模型,该模型通过将基于RNN-Transducer的ASR系统与音频前缀语言模型(LM)相结合来实现SSR。ASR系统转录正在进行的音频,并将生成的转录文本连同音频相关前缀一起输入LM,由LM推测转录文本的可能补全。我们在多种ASR数据集上进行了实验,结果表明了我们的方法的有效性以及SSR作为降低ASR延迟方法的可行性。

英文摘要:

This paper explores speculative speech recognition (SSR), where we empower conventional automatic speech recognition (ASR) with speculation capabilities, allowing the recognizer to run ahead of audio. We introduce a metric for measuring SSR performance and we propose a model which does SSR by combining a RNN-Transducer-based ASR system with an audio-prefixed language model (LM). The ASR system transcribes ongoing audio and feeds the resulting transcripts, along with an audio-dependent prefix, to the LM, which speculates likely completions for the transcriptions. We experiment with a variety of ASR datasets on which show the efficacy our method and the feasibility of SSR as a method of reducing ASR latency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑