arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.16757eess.AScs.CL
收藏

利用单通道语音进行多通道端到端语音识别的比较研究

Exploiting Single-Channel Speech for Multi-Channel End-to-End Speech Recognition: A Comparative Study

Tsinghua University(清华大学);TasiTech Co., Ltd.(塔斯科技有限公司)

Keyu An, Ji Xiao, Zhijian Ou

摘要:

近年来,端到端的多通道语音识别训练方法已显示出其有效性,该方法通常由波束形成前端和识别后端组成。然而,由于多个模块的集成,端到端的训练变得更加困难,特别是考虑到真实环境中记录的多通道语音数据在大小上是有限的。这就提出了利用单通道数据进行多通道端到端ASR的需求。在本文中,我们系统地比较了三种方案的性能,利用外部单通道数据的多通道端到端ASR,即后端预训练,数据调度和数据模拟,在不同的设置,如单通道数据的大小和前端的选择。在CHiME-4和AISHELL-4数据集上进行的大量实验表明,虽然这三种方法都提高了多通道端到端语音识别性能,但数据模拟优于其他两种方法,代价是更长的训练时间。数据调度的性能略优于后端预训练,但几乎是一致的,这可能是因为在预训练阶段,后端往往过拟合单通道数据,特别是当单通道数据大小很小时。

英文摘要:

Recently, the end-to-end training approach for multi-channel ASR has shown its effectiveness, which usually consists of a beamforming front-end and a recognition back-end. However, the end-to-end training becomes more difficult due to the integration of multiple modules, particularly considering that multi-channel speech data recorded in real environments are limited in size. This raises the demand to exploit the single-channel data for multi-channel end-to-end ASR. In this paper, we systematically compare the performance of three schemes to exploit external single-channel data for multi-channel end-to-end ASR, namely back-end pre-training, data scheduling, and data simulation, under different settings such as the sizes of the single-channel data and the choices of the front-end. Extensive experiments on CHiME-4 and AISHELL-4 datasets demonstrate that while all three methods improve the multi-channel end-to-end speech recognition performance, data simulation outperforms the other two, at the cost of longer training time. Data scheduling outperforms back-end pre-training marginally but nearly consistently, presumably because that in the pre-training stage, the back-end tends to overfit on the single-channel data, especially when the single-channel data size is small.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑