arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.14788cs.SDcs.CLeess.AS
收藏

低资源语言语音识别中增加数据量的方法

Methods to Increase the Amount of Data for Speech Recognition for Low Resource Languages

NVIDIA(英伟达);Buymie

Alexan Ayrapetyan, Sofia Kostandian, Ara Yeroyan, Mher Yerznkanyan, Nikolay Karpov, Nune Tadevosyan, Vitaly Lavrukhin, Boris Ginsburg

AI总结:

本文以亚美尼亚语和格鲁吉亚语为例,研究低资源语言语音识别数据扩展方法,发现付费众包在成本与质量间平衡最佳,扩展数据训练的FastConformer模型词错误率分别降至5.73%和9.9%,并开源了模型。

摘要:

本研究探索了通过众包、伪标签、先进的数据预处理以及多种许可数据源(如有声书、Common Voice、YouTube)来增加低资源语言数据量的方法。尽管这些方法在高资源语言中已得到充分探索,但它们在低资源语言中的应用仍未得到充分研究。以亚美尼亚语和格鲁吉亚语作为案例研究,我们展示了语言特性和资源特定特征如何影响这些方法的成功。这项工作为研究人员选择具有成本效益且质量驱动的低资源语言数据集扩展策略提供了实用指导。从各种数据扩展方法中得出的关键结论是,付费众包在成本与质量之间提供了最佳平衡,优于志愿众包、开源有声书和无标签数据的使用。消融研究表明,在扩展数据集上训练的模型优于现有基线,并且使用相对较小的FastConformer架构,格鲁吉亚语ASR词错误率达到5.73%,亚美尼亚语达到9.9%。我们开源了亚美尼亚语和格鲁吉亚语模型,以支持进一步的研究和实际应用。

英文摘要:

This study explores methods to increase data volume for low-resource languages using techniques such as crowdsourcing, pseudo-labeling, advanced data preprocessing and various permissive data sources such as audiobooks, Common Voice, YouTube. While these methods are well-explored for highresource languages, their application for low-resource languages remains underexplored. Using Armenian and Georgian as case studies, we demonstrate how linguistic and resource-specific characteristics influence the success of these methods. This work provides practical guidance for researchers to choose cost-effective and quality-driven dataset extension strategies for low-resource languages. The key takeaway from various data extension approaches is that paid crowd-sourcing offers the best balance between cost and quality, outperforming volunteer crowd-sourcing, open-source audiobooks, and unlabeled data usage. Ablation study shows that models trained on the expanded datasets outperform existing baselines and achieve 5.73% for Gergian and 9.9% for Armenian ASR word error rate using a relatively small FastConformer architecture. We open-sourced both the Armenian and Georgian models to allow further research and practical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑