arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.02382cs.CLcs.SDeess.AS

基于N-Skipgram和位置一元语法匹配的无监督语音识别

Unsupervised Speech Recognition with N-Skipgram and Positional Unigram Matching

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);KAIST(韩国科学技术院)

Liming Wang, Mark Hasegawa-Johnson, Chang D. Yoo

AI总结:

针对无监督语音识别训练中GAN不稳定、音文不对齐及内存需求大的问题,提出结合低阶N-skipgram与位置一元语法统计的ESPUM系统,在TIMIT基准上取得有竞争力的ASR和音素分割性能,且代码已开源。

摘要:

训练无监督语音识别系统面临与GAN相关的不稳定性、语音与文本不对齐以及内存需求大的挑战。为解决这些问题,我们提出了一种新型ASR系统ESPUM。该系统利用低阶N-skipgram(最高N=3)的能力,结合从少量样本批次中收集的位置一元语法统计信息。在TIMIT基准上评估,我们的模型在ASR和音素分割任务中展现出具有竞争力的性能。可通过https://github.com/lwang114/GraphUnsupASR获取我们公开的代码。

英文摘要:

Training unsupervised speech recognition systems presents challenges due to GAN-associated instability, misalignment between speech and text, and significant memory demands. To tackle these challenges, we introduce a novel ASR system, ESPUM. This system harnesses the power of lower-order N-skipgrams (up to N=3) combined with positional unigram statistics gathered from a small batch of samples. Evaluated on the TIMIT benchmark, our model showcases competitive performance in ASR and phoneme segmentation tasks. Access our publicly available code at https://github.com/lwang114/GraphUnsupASR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑