arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.05689cs.CLcs.SDeess.AS
收藏

UCorrect:一种用于自动语音识别纠错的无监督框架

UCorrect: An Unsupervised Framework for Automatic Speech Recognition Error Correction

Huawei(华为)

Jiaxin Guo, Minghan Wang, Xiaosong Qiao, Daimeng Wei, Hengchao Shang, Zongyao Li, Zhengzhe Yu, Yinglu Li, Chang Su, Min Zhang, Shimin Tao, Hao Yang

AI总结:

本文提出无监督ASR纠错框架UCorrect,通过检测-生成-选择机制不依赖配对数据即可显著降低词错误率,并具有低延迟和跨模型通用性。

摘要:

纠错技术已被用于优化自动语音识别(ASR)模型的输出句子,并实现更低的词错误率(WER)。以往的工作通常采用端到端模型,并且对伪配对数据和原始配对数据有很强的依赖。然而,当仅在伪配对数据上进行预训练时,以往的模型会对纠错产生负面影响。而在原始配对数据上进行微调时,源端数据必须由一个训练良好的ASR模型转录,这需要大量时间且不具有通用性。在本文中,我们提出UCorrect,一种用于ASR纠错的无监督检测器-生成器-选择器框架。UCorrect不依赖于前述训练数据。整个过程首先是检测字符是否存在错误,然后生成一些候选字符,最后选择置信度最高的字符来替换错误字符。在公开的AISHELL-1数据集和WenetSpeech数据集上的实验表明了UCorrect在ASR纠错方面的有效性:1)它实现了显著的WER降低,即使不进行微调也能达到6.83%的降低,微调后达到14.29%的降低;2)它以具有竞争力的低延迟大幅优于流行的非自回归(NAR)纠错模型;3)它是一种通用方法,因为它降低了采用不同解码策略的ASR模型的所有WER,并降低了在不同规模数据集上训练的ASR模型的所有WER。

英文摘要:

Error correction techniques have been used to refine the output sentences from automatic speech recognition (ASR) models and achieve a lower word error rate (WER). Previous works usually adopt end-to-end models and has strong dependency on Pseudo Paired Data and Original Paired Data. But when only pre-training on Pseudo Paired Data, previous models have negative effect on correction. While fine-tuning on Original Paired Data, the source side data must be transcribed by a well-trained ASR model, which takes a lot of time and not universal. In this paper, we propose UCorrect, an unsupervised Detector-Generator-Selector framework for ASR Error Correction. UCorrect has no dependency on the training data mentioned before. The whole procedure is first to detect whether the character is erroneous, then to generate some candidate characters and finally to select the most confident one to replace the error character. Experiments on the public AISHELL-1 dataset and WenetSpeech dataset show the effectiveness of UCorrect for ASR error correction: 1) it achieves significant WER reduction, achieves 6.83\% even without fine-tuning and 14.29\% after fine-tuning; 2) it outperforms the popular NAR correction models by a large margin with a competitive low latency; and 3) it is an universal method, as it reduces all WERs of the ASR model with different decoding strategies and reduces all WERs of ASR models trained on different scale datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑