基于 Transformer 的模型最近在端到端(E2E)自动语音识别(ASR)的应用中取得了显著成就。借助基于 Transformer 的模型,将 E2E ASR 系统部署在智能设备上成为可能。然而这些模型仍然存在需要大量模型参数的缺点。为了克服 Universal Transformer 模型在边缘设备上应用 ASR 的缺陷,我们提出了一种可以在 Transformer 模型中重用块的解决方案,适用于小占用空间的 ASR 系统,这满足了在不损害识别准确率的情况下适应资源限制的目标。具体来说,我们为语音 Transformer(BRST)设计了一种新颖的块重用策略以提高参数的有效性,并提出了一种适配器模块(ADM),该模块在每次重用块时仅伴随少量额外的可训练参数,即可生成紧凑且适应性强的模型。我们在公开的 AISHELL-1 语料库上使用所提出的方法进行了实验,结果表明,该方法在无 ADM 和有 ADM 的情况下,分别仅使用 7.6M/8.3M 参数,就实现了 9.3%/6.63% 的字符错误率(CER)。此外,我们还进行了更深入的分析,以展示 ADM 在通用块重用方法中的作用。
英文摘要:
Transformer-based models have recently made significant achievements in the application of end-to-end (E2E) automatic speech recognition (ASR). It is possible to deploy the E2E ASR system on smart devices with the help of Transformer-based models. While these models still have the disadvantage of requiring a large number of model parameters. To overcome the drawback of universal Transformer models for the application of ASR on edge devices, we propose a solution that can reuse the block in Transformer models for the occasion of the small footprint ASR system, which meets the objective of accommodating resource limitations without compromising recognition accuracy. Specifically, we design a novel block-reusing strategy for speech Transformer (BRST) to enhance the effectiveness of parameters and propose an adapter module (ADM) that can produce a compact and adaptable model with only a few additional trainable parameters accompanying each reusing block. We conducted an experiment with the proposed method on the public AISHELL-1 corpus, and the results show that the proposed approach achieves the character error rate (CER) of 9.3%/6.63% with only 7.6M/8.3M parameters without and with the ADM, respectively. In addition, we also make a deeper analysis to show the effect of ADM in the general block-reusing method.
Dynamic Attention Based Generative Adversarial Network with Phase Post-Processing for Speech Enhancement
Institute of Acoustics, Chinese Academy of Sciences(中国科学院声学研究所);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学)
An Exploration of ECAPA-TDNN and x-vector Speaker Representations in Zero-shot Multi-speaker TTS
NTIS Research Centre(NTIS研究中心);Department of Cybernetics, Faculty of Applied Sciences, University of West Bohemia in Pilsen, Czechia(应用科学学院控制系,西波西米亚大学在比斯伦分校,捷克)